Linked Data Under the Hood

119
Under the hood Richard Wallis Talis @rjw Linked Data #talisldod

description

Presented at the Talis Linked Data Open Day in San Francisco on 1st June 2011 by Richard Wallis

Transcript of Linked Data Under the Hood

Page 1: Linked Data Under the Hood

Under the hoodRichard WallisTalis@rjw

Linked Data

#talisldod

Page 2: Linked Data Under the Hood

http://www.flickr.com/photos/ferretsunlimited/499495786

Linked Data

Page 3: Linked Data Under the Hood

http://www.flickr.com/photos/ferretsunlimited/499495786

Linked Data

Page 4: Linked Data Under the Hood

Identifying things

Page 5: Linked Data Under the Hood

Identifying things

Page 6: Linked Data Under the Hood

Identifying things

1969-059A

Page 7: Linked Data Under the Hood

Identifying things

spacecraft/1969-059A

1969-059A

Page 8: Linked Data Under the Hood

Identifying things

spacecraft/1969-059A

nasa.dataincubator.org/spacecraft/1969-059A

1969-059A

Page 9: Linked Data Under the Hood

Identifying things

spacecraft/1969-059A

nasa.dataincubator.org/spacecraft/1969-059A

http://nasa.dataincubator.org/spacecraft/1969-059A

1969-059A

Page 10: Linked Data Under the Hood

Identifying things

spacecraft/1969-059A

nasa.dataincubator.org/spacecraft/1969-059A

http://nasa.dataincubator.org/spacecraft/1969-059A

1969-059A

with URIs

Page 11: Linked Data Under the Hood

Things have attributeshttp://nasa.dataincubator.org/spacecraft/1969-059A

Page 12: Linked Data Under the Hood

Things have attributeshttp://nasa.dataincubator.org/spacecraft/1969-059A

28801.0kg

Page 13: Linked Data Under the Hood

Things have attributeshttp://nasa.dataincubator.org/spacecraft/1969-059A

28801.0kg

Columbia

Page 14: Linked Data Under the Hood

Things have attributeshttp://nasa.dataincubator.org/spacecraft/1969-059A

28801.0kg

Columbia

Apollo 11 CSM

CSM-107

United States

Cape Canaveral

Saturn 5

Page 15: Linked Data Under the Hood

http://nasa.dataincubator.org/spacecraft/1969-059A

Page 16: Linked Data Under the Hood

.../1969-059A

http://nasa.dataincubator.org/spacecraft/1969-059A

Page 17: Linked Data Under the Hood

.../1969-059Ahttp://nasa.dataincubator.org/spacecraft/1969-059A

Page 18: Linked Data Under the Hood

.../1969-059A

⤵mass

28801.0

http://nasa.dataincubator.org/spacecraft/1969-059A

Page 19: Linked Data Under the Hood

.../1969-059A

⤵mass

28801.0

Apollo 11 CSM⤵name

http://nasa.dataincubator.org/spacecraft/1969-059A

Page 20: Linked Data Under the Hood

.../1969-059A

⤵mass

28801.0

Apollo 11 CSM⤵ Columbia⤵name name

http://nasa.dataincubator.org/spacecraft/1969-059A

Page 21: Linked Data Under the Hood

.../1969-059A

⤵⤵

mass

../launch:1969-059

28801.0

Apollo 11 CSM⤵ Columbia⤵name name

launchhttp://nasa.dataincubator.org/spacecraft/1969-059A

Page 22: Linked Data Under the Hood

.../1969-059A

⤵⤵

mass

../launch:1969-059

28801.0

Apollo 11 CSM⤵ Columbia⤵name name

launch

16 July 1969⤵date

http://nasa.dataincubator.org/spacecraft/1969-059A

Page 23: Linked Data Under the Hood

.../1969-059A

⤵Cape

Canaveral

⤵mass

../launch:1969-059

28801.0

Apollo 11 CSM⤵ Columbia⤵name name

launch

16 July 1969⤵date

⤵site

http://nasa.dataincubator.org/spacecraft/1969-059A

Page 24: Linked Data Under the Hood

.../1969-059A

⤵Cape

Canaveral

⤵mass

../launch:1969-059

28801.0

Apollo 11 CSM⤵ Columbia⤵name name

launch

16 July 1969⤵date

⤵site

N 28° 27' 31''⤵lat

http://nasa.dataincubator.org/spacecraft/1969-059A

Page 25: Linked Data Under the Hood

.../1969-059A

⤵Cape

Canaveral

⤵mass

../launch:1969-059

28801.0

Apollo 11 CSM⤵ Columbia⤵name name

launch

16 July 1969⤵date

⤵site

N 28° 27' 31''

W 80° 31' 59''

⤵⤵lat

long

http://nasa.dataincubator.org/spacecraft/1969-059A

Page 26: Linked Data Under the Hood

.../1969-059A

⤵Cape

Canaveral

⤵mass

../launch:1969-059

28801.0

Apollo 11 CSM⤵ Columbia⤵name name

launch

16 July 1969⤵date

⤵site<../1969-059A> mass 28801.0 .<../1969-059A> name “Apollo 11 CSM” .<../1969-059A> name “Columbia” .<../1969-059A> launch <../launch/1969-059> .<../launch/1969-059> date 1969-07-16 .<../launch/1969-059> site <..site/capecanaveral> .<..site/capecanaveral> lat “N 28° 27' 31''” .<..site/capecanaveral> long “W 80° 31' 59''” .

N 28° 27' 31''

W 80° 31' 59''

⤵⤵lat

long

http://nasa.dataincubator.org/spacecraft/1969-059A

Page 27: Linked Data Under the Hood

.../1969-059A

⤵Cape

Canaveral

⤵mass

../launch:1969-059

28801.0

Apollo 11 CSM⤵ Columbia⤵name name

launch

16 July 1969⤵date

⤵site<../1969-059A> mass 28801.0 .<../1969-059A> name “Apollo 11 CSM” .<../1969-059A> name “Columbia” .<../1969-059A> launch <../launch/1969-059> .<../launch/1969-059> date 1969-07-16 .<../launch/1969-059> site <..site/capecanaveral> .<..site/capecanaveral> lat “N 28° 27' 31''” .<..site/capecanaveral> long “W 80° 31' 59''” .

RDF

N 28° 27' 31''

W 80° 31' 59''

⤵⤵lat

long

http://nasa.dataincubator.org/spacecraft/1969-059A

Page 28: Linked Data Under the Hood
Page 29: Linked Data Under the Hood
Page 30: Linked Data Under the Hood

RDF Triple

Page 31: Linked Data Under the Hood

RDF Triple

Thing attribute value

Page 32: Linked Data Under the Hood

RDF Triple

Thing valueproperty

Page 33: Linked Data Under the Hood

RDF Triple

Thing value

Thing property Thing

property

Page 34: Linked Data Under the Hood

RDF Triple

Thing value

Thing property Thing

property

../person/A

Page 35: Linked Data Under the Hood

RDF Triple

Thing value

Thing property Thing

property

../person/A hasParent

Page 36: Linked Data Under the Hood

RDF Triple

Thing value

Thing property Thing

property

../person/B../person/A hasParent

Page 37: Linked Data Under the Hood

RDF Triple

Thing value

Thing property Thing

property

../person/B

../person/B

../person/A hasParent

Page 38: Linked Data Under the Hood

RDF Triple

Thing value

Thing property Thing

property

../person/B

name../person/B

../person/A hasParent

Page 39: Linked Data Under the Hood

“Eric”

RDF Triple

Thing value

Thing property Thing

property

../person/B

name../person/B

../person/A hasParent

Page 40: Linked Data Under the Hood

“Eric”

RDF Triple

Thing value

Thing property Thing

property

../person/B

name../person/B

../person/A hasParent

Merging

Page 41: Linked Data Under the Hood

“Eric”

RDF Triple

Thing value

Thing property Thing

property

name../person/B../person/A hasParent

Merging

Page 42: Linked Data Under the Hood

RDF TripleMerging

Page 43: Linked Data Under the Hood

RDF TripleMerging

The same identifier in a different place is still the same thing

Page 44: Linked Data Under the Hood
Page 45: Linked Data Under the Hood

A Property is a Thing too!

Page 46: Linked Data Under the Hood

A Property is a Thing too!

name

Page 47: Linked Data Under the Hood

A Property is a Thing too!

name

http://xmlns.com/foaf/0.1/name

Page 48: Linked Data Under the Hood

A Property is a Thing too!

name

foaf:name

http://xmlns.com/foaf/0.1/name

Page 49: Linked Data Under the Hood

A Property is a Thing too!

name

foaf:name

http://xmlns.com/foaf/0.1/name

“Eric”foaf:name../person/B

Page 50: Linked Data Under the Hood

http://www.flickr.com/photos/jwilde/3499946512

Page 51: Linked Data Under the Hood

http://www.flickr.com/photos/jwilde/3499946512

Opening up access to data

Page 52: Linked Data Under the Hood

http://www.flickr.com/photos/jwilde/3499946512

Opening up access to data

Data API

Page 53: Linked Data Under the Hood

http://www.flickr.com/photos/jwilde/3499946512

Opening up access to data

Data API}All have APIs

Page 54: Linked Data Under the Hood

http://www.flickr.com/photos/jwilde/3499946512

Opening up access to data

Data API}All have APIs

All different!

Page 55: Linked Data Under the Hood

http://www.flickr.com/photos/jwilde/3499946512

Opening up access to data

Data API}All have APIs

The key to access Linked Data

All different!

Page 56: Linked Data Under the Hood

http://www.flickr.com/photos/jwilde/3499946512

Opening up access to data

Data API}All have APIs

Web StandardsThe key to access

Linked Data

All different!

Page 57: Linked Data Under the Hood

Web Standards

Page 58: Linked Data Under the Hood

The power of the link

Page 59: Linked Data Under the Hood

The power of the link

Page 60: Linked Data Under the Hood

The power of the link

Page 61: Linked Data Under the Hood

The power of the link

Page 62: Linked Data Under the Hood

The power of the link

Page 63: Linked Data Under the Hood

The power of the link

Page 64: Linked Data Under the Hood

The power of the link

Page 65: Linked Data Under the Hood

The power of the link

Page 66: Linked Data Under the Hood
Page 67: Linked Data Under the Hood

RDF in many forms

Page 68: Linked Data Under the Hood

RDF in many forms

• RDF/XML

Page 69: Linked Data Under the Hood

RDF in many forms

• RDF/XML Machine to machine

Page 70: Linked Data Under the Hood

RDF in many forms

• RDF/XML

• N-Triples

Machine to machine

Page 71: Linked Data Under the Hood

RDF in many forms

• RDF/XML

• N-Triples

Machine to machine

Processing

Page 72: Linked Data Under the Hood

RDF in many forms

• RDF/XML

• N-Triples

• Turtle

Machine to machine

Processing

Page 73: Linked Data Under the Hood

RDF in many forms

• RDF/XML

• N-Triples

• Turtle

Machine to machine

Processing

Human readable

Page 74: Linked Data Under the Hood

RDF in many forms

• RDF/XML

• N-Triples

• Turtle

• RDFa

Machine to machine

Processing

Human readable

Page 75: Linked Data Under the Hood

RDF in many forms

• RDF/XML

• N-Triples

• Turtle

• RDFa

Machine to machine

Processing

Human readable

Html embedded

Page 76: Linked Data Under the Hood

RDF in many forms

• RDF/XML

• N-Triples

• Turtle

• RDFa

Machine to machine

Processing

Human readable

Html embedded

All valid RDFCape Canaveral

../launch:1969-059

16 July 1969⤵date

⤵site

Page 77: Linked Data Under the Hood

RDF creation

Page 78: Linked Data Under the Hood

RDF creation

• Database / spreadsheet export

Page 79: Linked Data Under the Hood

RDF creation

• Database / spreadsheet export

- Script/program convert

Page 80: Linked Data Under the Hood

RDF creation

• Database / spreadsheet export

- Script/program convert

• Pull content from sites

Page 81: Linked Data Under the Hood

RDF creation

• Database / spreadsheet export

- Script/program convert

• Pull content from sites

- Content-negotiation to RDF/XML

Page 82: Linked Data Under the Hood

RDF creation

• Database / spreadsheet export

- Script/program convert

• Pull content from sites

- Content-negotiation to RDF/XML

• Google Refine

Page 83: Linked Data Under the Hood

RDF creation

• Database / spreadsheet export

- Script/program convert

• Pull content from sites

- Content-negotiation to RDF/XML

• Google Refine

- Facet analysis

Page 84: Linked Data Under the Hood

RDF creation

• Database / spreadsheet export

- Script/program convert

• Pull content from sites

- Content-negotiation to RDF/XML

• Google Refine

- Facet analysis

- Reconciliation API

Page 85: Linked Data Under the Hood

Modelling aids

Page 86: Linked Data Under the Hood

Modelling aids

• prefix.cc

Page 87: Linked Data Under the Hood

Modelling aids

• prefix.cc

- namespace lookup

Page 88: Linked Data Under the Hood

Modelling aids

• prefix.cc

- namespace lookup

• schemapedia.com

Page 89: Linked Data Under the Hood

Modelling aids

• prefix.cc

- namespace lookup

• schemapedia.com

- vocabulary search

Page 90: Linked Data Under the Hood

Modelling aids

• prefix.cc

- namespace lookup

• schemapedia.com

- vocabulary search

• sindice.com ckan.net LOD Diagram

Page 91: Linked Data Under the Hood

Modelling aids

• prefix.cc

- namespace lookup

• schemapedia.com

- vocabulary search

• sindice.com ckan.net LOD Diagram

- identify data sets to link with

Page 92: Linked Data Under the Hood

Modelling aids

• prefix.cc

- namespace lookup

• schemapedia.com

- vocabulary search

• sindice.com ckan.net LOD Diagram

- identify data sets to link with

• Kasabi

Page 93: Linked Data Under the Hood

Modelling aids

• prefix.cc

- namespace lookup

• schemapedia.com

- vocabulary search

• sindice.com ckan.net LOD Diagram

- identify data sets to link with

• Kasabi

- Linked Data Marketplace

Page 94: Linked Data Under the Hood

The process

Page 95: Linked Data Under the Hood

The process

Model

Page 96: Linked Data Under the Hood

The process

NameModel

Page 97: Linked Data Under the Hood

The process

DescribeNameModel

Page 98: Linked Data Under the Hood

The process

ConvertDescribeNameModel

Page 99: Linked Data Under the Hood

Publish

The process

ConvertDescribeNameModel

Page 100: Linked Data Under the Hood

SPARQL

Page 101: Linked Data Under the Hood

RDF Query LanguageSPARQL

Page 102: Linked Data Under the Hood

RDF Query LanguageSPARQL

• Triple pattern matching

Page 103: Linked Data Under the Hood

RDF Query LanguageSPARQL

• Triple pattern matching

- uses Turtle

Page 104: Linked Data Under the Hood

RDF Query LanguageSPARQL

• Triple pattern matching

- uses Turtle

• Requires a SPARQL-endpoint

Page 105: Linked Data Under the Hood

RDF Query LanguageSPARQL

• Triple pattern matching

- uses Turtle

• Requires a SPARQL-endpoint

• Backed by a Triple Store

Page 106: Linked Data Under the Hood

RDF Query LanguageSPARQL

• Triple pattern matching

- uses Turtle

• Requires a SPARQL-endpoint

• Backed by a Triple Store

- Local hosted

Page 107: Linked Data Under the Hood

RDF Query LanguageSPARQL

• Triple pattern matching

- uses Turtle

• Requires a SPARQL-endpoint

• Backed by a Triple Store

- Local hosted

- Hosted

Page 108: Linked Data Under the Hood

RDF Query LanguageSPARQL

• Triple pattern matching

- uses Turtle

• Requires a SPARQL-endpoint

• Backed by a Triple Store

- Local hosted

- Hosted

- Managed Service - Talis

Page 109: Linked Data Under the Hood

http://www.flickr.com/photos/ferretsunlimited/499495786

Linked Data

Page 110: Linked Data Under the Hood

http://www.flickr.com/photos/ferretsunlimited/499495786

Linked Data

Identifying Things with URIs

Page 111: Linked Data Under the Hood

http://www.flickr.com/photos/ferretsunlimited/499495786

Linked Data

Identifying Things with URIs• Things have attributes/properties

Page 112: Linked Data Under the Hood

http://www.flickr.com/photos/ferretsunlimited/499495786

Linked Data

Identifying Things with URIs• Things have attributes/properties

- Properties are Things too!

Page 113: Linked Data Under the Hood

http://www.flickr.com/photos/ferretsunlimited/499495786

Linked Data

Identifying Things with URIs• Things have attributes/properties

- Properties are Things too!

• URIs Merge - wherever

Page 114: Linked Data Under the Hood

http://www.flickr.com/photos/ferretsunlimited/499495786

Linked Data

Identifying Things with URIs• Things have attributes/properties

- Properties are Things too!

• URIs Merge - wherever

• Linked Data is the API

Page 115: Linked Data Under the Hood

http://www.flickr.com/photos/ferretsunlimited/499495786

Linked Data

Identifying Things with URIs• Things have attributes/properties

- Properties are Things too!

• URIs Merge - wherever

• Linked Data is the API- Web Standards - http, RDF, ...

Page 116: Linked Data Under the Hood

http://www.flickr.com/photos/ferretsunlimited/499495786

Linked Data

Identifying Things with URIs• Things have attributes/properties

- Properties are Things too!

• URIs Merge - wherever

• Linked Data is the API- Web Standards - http, RDF, ...

• Many open data/tools

Page 117: Linked Data Under the Hood

http://www.flickr.com/photos/ferretsunlimited/499495786

Linked Data

Identifying Things with URIs• Things have attributes/properties

- Properties are Things too!

• URIs Merge - wherever

• Linked Data is the API- Web Standards - http, RDF, ...

• Many open data/tools

• Model➞Name➞Describe➞Convert➞Publish

Page 118: Linked Data Under the Hood

http://www.flickr.com/photos/ferretsunlimited/499495786

Linked Data

Identifying Things with URIs• Things have attributes/properties

- Properties are Things too!

• URIs Merge - wherever

• Linked Data is the API- Web Standards - http, RDF, ...

• Many open data/tools

• Model➞Name➞Describe➞Convert➞Publish

• SPARQL endpoints for query

Page 119: Linked Data Under the Hood

http://www.flickr.com/photos/ferretsunlimited/499495786

Linked Data

Identifying Things with URIs• Things have attributes/properties

- Properties are Things too!

• URIs Merge - wherever

• Linked Data is the API- Web Standards - http, RDF, ...

• Many open data/tools

• Model➞Name➞Describe➞Convert➞Publish

• SPARQL endpoints for query

• Managed Hosting