20080509 webresearch lifshits_lecture01

37
The Architecture of the Web Yury Lifshits Caltech http://yury.name St.Petersburg, May 2008 CS Club at Steklov Institute of Mathematics 1 / 26

Transcript of 20080509 webresearch lifshits_lecture01

Page 1: 20080509 webresearch lifshits_lecture01

The Architecture of the Web

Yury LifshitsCaltech

http://yury.name

St.Petersburg, May 2008CS Club at Steklov Institute of Mathematics

1 /26

Page 2: 20080509 webresearch lifshits_lecture01

Wkipedia: The Web is a system of interlinkedhypertext documents accessed via theInternet.

This definition is now outdated!

Modern Version: The Web is a system ofdata, people and software connected via theInternet and mobile networks.

2 /26

Page 3: 20080509 webresearch lifshits_lecture01

Wkipedia: The Web is a system of interlinkedhypertext documents accessed via theInternet.

This definition is now outdated!

Modern Version: The Web is a system ofdata, people and software connected via theInternet and mobile networks.

2 /26

Page 4: 20080509 webresearch lifshits_lecture01

Outline

1 Brief Tour to Web Standards

2 Conceptual Stuff

3 Ongoing Project: Better Online Marketing

4 Thoughts on Future

3 /26

Page 5: 20080509 webresearch lifshits_lecture01

Outline

1 Brief Tour to Web Standards

2 Conceptual Stuff

3 Ongoing Project: Better Online Marketing

4 Thoughts on Future

3 /26

Page 6: 20080509 webresearch lifshits_lecture01

Outline

1 Brief Tour to Web Standards

2 Conceptual Stuff

3 Ongoing Project: Better Online Marketing

4 Thoughts on Future

3 /26

Page 7: 20080509 webresearch lifshits_lecture01

Outline

1 Brief Tour to Web Standards

2 Conceptual Stuff

3 Ongoing Project: Better Online Marketing

4 Thoughts on Future

3 /26

Page 8: 20080509 webresearch lifshits_lecture01

1Brief Tour to Web Standards

4 /26

Page 9: 20080509 webresearch lifshits_lecture01

W3C StandardsName them!

URI (URL, URN)

HTTP, SOAP

HTML, XHTML

CSS

XML, RDF

5 /26

Page 10: 20080509 webresearch lifshits_lecture01

W3C StandardsName them!

URI (URL, URN)

HTTP, SOAP

HTML, XHTML

CSS

XML, RDF

5 /26

Page 11: 20080509 webresearch lifshits_lecture01

W3C StandardsName them!

URI (URL, URN)

HTTP, SOAP

HTML, XHTML

CSS

XML, RDF

5 /26

Page 12: 20080509 webresearch lifshits_lecture01

OpenId

Glossary: identity provider, relying party

2005: Started by Brad Fitzpatrick inLiveJournal project

2007: OpenID Foundation6 /26

Page 13: 20080509 webresearch lifshits_lecture01

RSS

Full name

Really Simple Syndication

RDF Site Summary

Started in 1999 by Ramanathan V. Guha

List of feeds: OPML

Attention profile: APML

Challenges: filtering, discovery

7 /26

Page 14: 20080509 webresearch lifshits_lecture01

RSS

Full nameReally Simple Syndication

RDF Site Summary

Started in 1999 by Ramanathan V. Guha

List of feeds: OPML

Attention profile: APML

Challenges: filtering, discovery

7 /26

Page 15: 20080509 webresearch lifshits_lecture01

RSS

Full nameReally Simple Syndication

RDF Site Summary

Started in 1999 by Ramanathan V. Guha

List of feeds: OPML

Attention profile: APML

Challenges: filtering, discovery

7 /26

Page 16: 20080509 webresearch lifshits_lecture01

OAuth

Open standard for access delegation

Started in November 2006, first draft inOctober 2007

Glossary: User, Consumer, ServiceProvider, Protected Resources

Challenges: phishing attack, DoS attack8 /26

Page 17: 20080509 webresearch lifshits_lecture01

FOAF

Mission: creating machine-readable pagesdescribing people, the links between themand the things they create and do

Started in 2000 by Libby Miller and DanBrickley

Tim Berners-Lee: FOAF is a basis forGlobal Giant Graph

9 /26

Page 18: 20080509 webresearch lifshits_lecture01

Microformats

Grassroots approach to Semantic Web

Notable microformats: hCalendar, hCard,hReview, hResume, XFN, XOXOhttp://tantek.com/presentations/2006/07/what-are-microformats/

10 /26

Page 19: 20080509 webresearch lifshits_lecture01

Social Graph API

Brad Fitzpatrick presents Social Graph API:http://www.youtube.com/watch?v=LabCylbapuM

11 /26

Page 20: 20080509 webresearch lifshits_lecture01

Facebook Platform

A framework for creating third-partyapplications that interact with coreFacebook features. Launched in May 2007

Interface (API), Query (FQL), Markup(FBML)

Anatomy: about, left nav, Facebookcanvas pages, profile box, profile actionlinks, privacy settings, news feed, alerts,message attachments, requests

AppFactory funding program

12 /26

Page 21: 20080509 webresearch lifshits_lecture01

Other Standards and APIs

OpenSocial

Firefox extensions, userscripts

iPhone OS

iGoogle, Netwibes, Yahoo Pipes

Wordpress & Drupal, Salesforce.com,

Yelp API

Yahoo Search API, Yandex XML

OASIS standards: XRI, XDI13 /26

Page 22: 20080509 webresearch lifshits_lecture01

2Conceptual Stuff

14 /26

Page 23: 20080509 webresearch lifshits_lecture01

Web OS

Web office: Google Docs, Zoho

Social platforms: Facebook, OpenSocial

DesktopTwo, Netvibes, iGoogle, myYahoo

Firefox Gran Paradiso

CMS as Web OS?

15 /26

Page 24: 20080509 webresearch lifshits_lecture01

DataPortability.org

Participants: Google, Facebook, Plaxo,Drupal, Netvibes, Mystrands, LinkedIn,Flickr, Six Apart, Twitter, Digg, Microsoft

Started: November 2007

Standards involved: APML, FOAF, hCard,OAuth, OpenID, OPML, RDF, RSS, SIOC,XFN, XRI, and XDI.

Next goal: DataPortability referencedesign

16 /26

Page 25: 20080509 webresearch lifshits_lecture01

3Ongoing Project:

Better Online Marketing

17 /26

Page 26: 20080509 webresearch lifshits_lecture01

Market GraphMarket Graph is a graph of relationsbetween people, businesses and products.

What is the right business model for Market Graph?

What are the incentives for consumers, companiesand web developers?

Who is responsible for maintaining Market Graph?

Data reliability: How duplication andmisinformation are handled?

Can two identities from different providers create arelation?

What will be the killer app for Market Graph?

What interesting stuff can we do in marketcomputing?

18 /26

Page 27: 20080509 webresearch lifshits_lecture01

Market GraphMarket Graph is a graph of relationsbetween people, businesses and products.

What is the right business model for Market Graph?

What are the incentives for consumers, companiesand web developers?

Who is responsible for maintaining Market Graph?

Data reliability: How duplication andmisinformation are handled?

Can two identities from different providers create arelation?

What will be the killer app for Market Graph?

What interesting stuff can we do in marketcomputing?

18 /26

Page 28: 20080509 webresearch lifshits_lecture01

Open Advertising Platform

Open alternative to Google AdSense:

A publisher installs an ad frame

Every page visit send a request with contextvariables (page content, information about user) toadvertising engine

Engine performs an auction between applicationsand the winner takes the spot

19 /26

Page 29: 20080509 webresearch lifshits_lecture01

Enterprise Web Programming

Workflow:

Create userbase

Provide API for identity space and graph ofrelations

Define clear rules for application distribution

20 /26

Page 30: 20080509 webresearch lifshits_lecture01

4Thoughts on Future

21 /26

Page 31: 20080509 webresearch lifshits_lecture01

Emerging Technologies in the Web

Augmented reality, Geoweb

Vector graphics, 3D

Internet TV, video

Ubiquitious computing

Semantic web

Artificial intelligence, question answering

Machine translation

Intelligent agents

New interfaces (HCI)

Reflection web

22 /26

Page 32: 20080509 webresearch lifshits_lecture01

Emerging Technologies in the Web

Augmented reality, Geoweb

Vector graphics, 3D

Internet TV, video

Ubiquitious computing

Semantic web

Artificial intelligence, question answering

Machine translation

Intelligent agents

New interfaces (HCI)

Reflection web

22 /26

Page 33: 20080509 webresearch lifshits_lecture01

Emerging Technologies in the Web

Augmented reality, Geoweb

Vector graphics, 3D

Internet TV, video

Ubiquitious computing

Semantic web

Artificial intelligence, question answering

Machine translation

Intelligent agents

New interfaces (HCI)

Reflection web22 /26

Page 34: 20080509 webresearch lifshits_lecture01

Research Challenges

Semantic publishing

Protection mechanisms

Search (crawling, sorting)

Identity re-integration

23 /26

Page 35: 20080509 webresearch lifshits_lecture01

Links

Homepage http://yury.nameMinicourse page: http://yury.name/newweb.html

http://businessconsumer.net/files/marketing-agenda.pdfResearch Agenda in Online Marketing [Working paper]

http://yury.name/reputation.htmlTutorial on Reputation Systems

http://businessconsumer.net

Our research project in online marketing

24 /26

Page 36: 20080509 webresearch lifshits_lecture01

References

Conferences: WWW, WSDM, EC, Web 2.0 Expo, Web2.0 Summit, The Next Web, Techcrunch50, ETech, TED

Videos: Brad Fitzpatrick (Socil Graph API), Jeff Bezos(TED), OpenSocial Launch Event, Mark Zuckerberg (F8Keynote)

Blogs: Techcrunch, ReadWriteWeb, Mashable!,Valleywag, Techmeme, VentureBeat, Greg Linden

People: Kevin Marks, Brad Fitzpatrick, Tantek Celik,David Recordon, Joseph Smarr, Matt Mullenweg, MarkZuckerberg, Kevin Rose, Dries Buytaert, Chris Messina,Nova Spivack, Dick Hardt, Chris Saad

25 /26

Page 37: 20080509 webresearch lifshits_lecture01

Summary

Thanks for your attention!Questions?

26 /26