Social Fabric of Semantics - SemTech 2010

60
The Social Fabric of Semantics Jamie Taylor, Ph.D.

description

Vocabulary construction is critical to the success of semantic technologies. Can we learn from communities where practical vocabularies have emerged?

Transcript of Social Fabric of Semantics - SemTech 2010

Page 1: Social Fabric of Semantics - SemTech 2010

The Social Fabric of SemanticsJamie Taylor, Ph.D.

Page 3: Social Fabric of Semantics - SemTech 2010
Page 4: Social Fabric of Semantics - SemTech 2010
Page 5: Social Fabric of Semantics - SemTech 2010

Explicit Semantics in Surprising Places

Page 6: Social Fabric of Semantics - SemTech 2010

microformats

HTML5 MicroData

Open Graph Protocol

RDFa

Page 7: Social Fabric of Semantics - SemTech 2010
Page 8: Social Fabric of Semantics - SemTech 2010
Page 9: Social Fabric of Semantics - SemTech 2010
Page 10: Social Fabric of Semantics - SemTech 2010
Page 11: Social Fabric of Semantics - SemTech 2010
Page 12: Social Fabric of Semantics - SemTech 2010

We have overlooked the human “stack”

Page 13: Social Fabric of Semantics - SemTech 2010

The Crisis of Vocabulary

Much formal analysis of knowledge representation

Little guidance on what actually works

Page 14: Social Fabric of Semantics - SemTech 2010

education

nationality

contained-by

education

member-of

eventalbums

label

contained-by

contains

member-of

The arrangement of entities in a graph is not predetermined by a higher being

Page 15: Social Fabric of Semantics - SemTech 2010

containscontained-by

eventmember-ofnationalityeducationalbums

Vocabulary is a social process

Page 16: Social Fabric of Semantics - SemTech 2010

Semantics: To communicate meaning, resulting in an action

Or at least so Blue Guy can write code that responds to the graph in a way consistent with Red Guy's expectations

Page 17: Social Fabric of Semantics - SemTech 2010
Page 18: Social Fabric of Semantics - SemTech 2010

Vocabulary

"All the types of things you can say about something"

Page 20: Social Fabric of Semantics - SemTech 2010

Alison Hewson

EDUNMount Temple

Comprehensive School

May 10, 1960

U2

Million Dollar Hotel

End of Violence

Elevation Partners

Show 8

Dublin

spouse

date of birth

founder

performer

educ

ation

founder

producerperformer

born in

mem

ber o

f

Semantics are in the Links

Page 21: Social Fabric of Semantics - SemTech 2010

Alison Hewson

EDUNMount Temple

Comprehensive School

May 10, 1960

U2

Million Dollar Hotel

End of Violence

Elevation Partners

Show 8

Dublin

spouse

date of birth

founder

performer

educ

ation

founder

producerperformer

born in

mem

ber o

f

Semantics are in the Links

Page 22: Social Fabric of Semantics - SemTech 2010

Do you understand the words that are coming out of

my mouth?

Page 23: Social Fabric of Semantics - SemTech 2010

The Twitter Vocabulary

@

#

Short URLs

Page 24: Social Fabric of Semantics - SemTech 2010

Pivot on @

Page 25: Social Fabric of Semantics - SemTech 2010

Pivot on Short URL

Page 26: Social Fabric of Semantics - SemTech 2010

Pivot on #

Page 27: Social Fabric of Semantics - SemTech 2010

#

Page 28: Social Fabric of Semantics - SemTech 2010

Broadcast: U(n) = n

Page 29: Social Fabric of Semantics - SemTech 2010

Telephone:

Metcalfe's Law

U(n) = n2

Page 30: Social Fabric of Semantics - SemTech 2010

Group Network Formation:

Reed's Law

U(n) = 2n

Page 31: Social Fabric of Semantics - SemTech 2010

Reed's Law

N

Value N

N^22^N

Page 32: Social Fabric of Semantics - SemTech 2010

N

Value

N N2

2N

Broadcast Email Chatrooms

Page 33: Social Fabric of Semantics - SemTech 2010

N

Value

N N2

2N

Tweets #tagsFeeds

#tags are a USER invention!

Page 34: Social Fabric of Semantics - SemTech 2010

N

Value

N N2

2N

Folksonomy ???Ontology

Page 35: Social Fabric of Semantics - SemTech 2010

Twannotations

Tweets have "type"

Name/Value Structure

What's the vocabulary?

•Anything you want

•Lead by example

Page 36: Social Fabric of Semantics - SemTech 2010

Vocabulary and VisibilityPros: Feedback, Incentive, Training, Convergence

Page 37: Social Fabric of Semantics - SemTech 2010

Vocabulary and VisibilityCons: Usage for side effects

Page 38: Social Fabric of Semantics - SemTech 2010

Lessons from everyday vocabulary

Wikipedia Word Frequency

0

2000000

4000000

6000000

8000000

10000000

12000000

14000000

16000000

18000000

20000000

0 20 40 60 80 100 120

Rank

Freq

uen

cy

Data from Victor S. Grishchenko

Page 39: Social Fabric of Semantics - SemTech 2010

Zipf’s Law

!Plot by Victor Grishchenko

Page 40: Social Fabric of Semantics - SemTech 2010

Zipf’s Explanation

Law of Least Effort:

Use a few common words to communicate main concept

Use a few rare words to disambiguate concepts

Satisficing

Page 41: Social Fabric of Semantics - SemTech 2010
Page 42: Social Fabric of Semantics - SemTech 2010

535,393 Categories

2k French Films

Page 43: Social Fabric of Semantics - SemTech 2010

17 films

Page 44: Social Fabric of Semantics - SemTech 2010
Page 45: Social Fabric of Semantics - SemTech 2010

Schema Principle #1

Use Types Liberally:

Use a few large, encompassing Types to provide general information

Use several smaller, fine grained Types to provide detailed information

Page 46: Social Fabric of Semantics - SemTech 2010
Page 47: Social Fabric of Semantics - SemTech 2010

The Freebase Commons·American football ·Internet·Anime/Manga ·Language·Architecture ·Law·Astronomy ·Library·Automotive ·Location·Aviation ·Martial Arts·Awards ·Measurement Unit·Baseball ·Media Common·Basketball ·Medicine·Bicycles ·Metaweb Types·Biology ·Meteorology·Boats ·Military·Broadcast ·Music·Business ·Olympics·Celebrities ·Opera·Chemistry ·Organization·Comics ·People·Common ·Geography·Computers ·Projects·Conferences ·Protected Places·Cricket ·Publishing·Data World ·Radio·Digicams ·Rail·Education ·Religion·Engineering ·Royalty·Event ·Soccer·Clothing and Textiles ·Spaceflight·Fictional Universes ·Sports·Film ·Symbols·Food & Drink ·Tennis·Freebase ·Theater·Games ·Time·Geology ·Transportation·Government ·Travel·Hobbies and Interests ·TV·Ice Hockey ·Video Games·Influence ·Visual Art

Top-level domains

schema = vocabulary

Page 48: Social Fabric of Semantics - SemTech 2010

Ontologies you design will be too complicated because almost all people will use a small subset of it

Ontologies you design will be too simple because there will be a long tail of users who will want to express something you didn’t cover

--Colin Evans (Metaweb)

Solution:

• Provide a core

• Let the community tune the specifics to their needs

Page 49: Social Fabric of Semantics - SemTech 2010

What is a Politician?

Page 50: Social Fabric of Semantics - SemTech 2010

Schema Principle #2

Avoid Types which "carve out" categories of things

Page 51: Social Fabric of Semantics - SemTech 2010

"Original TV Program"

• Is a TV Program

• Isn't an adaptation of a film

• Isn't an adaptation of a book

• Isn't an adaptation of a play

• Wasn't spun off from another TV Program

• Hasn't spun off any other TV Programs

Page 52: Social Fabric of Semantics - SemTech 2010
Page 53: Social Fabric of Semantics - SemTech 2010
Page 54: Social Fabric of Semantics - SemTech 2010

"Original TV Program"[{

  "name": null,  "type": "/tv/tv_program",  "b:type": {    "id":       "/media_common/adaptation",    "optional": "forbidden"  },  "spun_off_from": [{    "id":       null,    "optional": "forbidden"  }],  "spin_offs": [{    "id":       null,    "optional": "forbidden"  }]}]

Show as Two Viewsnot a MQL query

Page 55: Social Fabric of Semantics - SemTech 2010

Principle #2 Corollary

Strive for bright lines between Types• Let queries and simple types do the work

• Better, easier to maintain data quality

Page 56: Social Fabric of Semantics - SemTech 2010

What are you sitting on?

Chair

Furniture

Folding Chair

Natural Category

Added Features?

What does one look like?

Eleanor Rosch

Page 57: Social Fabric of Semantics - SemTech 2010

HTML5 MicroData

Open Graph Protocol

#

Page 58: Social Fabric of Semantics - SemTech 2010

Addendum

Page 59: Social Fabric of Semantics - SemTech 2010

Social Network Analysis Resources

Wikipedia

Jon Kleinberg

http://www.cs.cornell.edu/home/kleinber

Twitter

Kwak et al. WWW2010

http://an.kaist.ac.kr/traces/WWW2010.html

Page 60: Social Fabric of Semantics - SemTech 2010

Modeling ResourcesMcGuinness & Noy's Ontologies 101

Attend when possible!

http://ksl.stanford.edu/people/dlm/papers/ontology101

Toward Principles for the Design of Ontologies Used for Knowledge Sharing

http://tomgruber.org/writing/onto-design.htm

Allemang & Hendler

Semantic Web for the Working Ontologist