Linked Data + Drupal for Oceanographic data management

87
LINKED DATA + DRUPAL FOR OCEANOGRAPHIC DATA MANAGEMENT ADAM SHEPHERD & STÉPHANE CORLOSQUET CASE STUDIES WEDNESDAY 2:15PM JUNE 4 TH

description

For ocean science researchers, the success of data discovery revolves around the capability to ask complex questions of data centers like BCO-DMO. Our ability to accurately respond depends on our system's capability to understand the question, interpret its relevancy to what we know, and return those results in a way a human can digest. As the needs for responding to the grand challenges of science become more interdisciplinary, data discovery will become more dependent on information from a variety of sources to enable researchers to reliably access the data they need. To do this effectively, all data and their metadata require context, cooperation and semantic interoperability. This talk explores the current landscape of data discovery, the questions researchers ask of our software, how bad our software is at responding, and how Linked Data is a viable solution for improving those responses. Watch this presentation at: https://www.youtube.com/watch?v=wEllMpcNQFg https://austin2014.drupal.org/session/linked-data-drupal-oceanographic-data-management http://www.bco-dmo.org http://lod.bco-dmo.org/sparql

Transcript of Linked Data + Drupal for Oceanographic data management

Page 1: Linked Data + Drupal for Oceanographic data management

LINKED DATA + DRUPALFOR OCEANOGRAPHIC DATA MANAGEMENT

ADAM SHEPHERD & STÉPHANE CORLOSQUET

CASE STUDIES

WEDNESDAY 2:15PM JUNE 4TH

Page 2: Linked Data + Drupal for Oceanographic data management

LINKED DATA + DRUPALFOR OCEANOGRAPHIC DATA MANAGEMENT

ADAM SHEPHERD & STÉPHANE CORLOSQUET

Page 3: Linked Data + Drupal for Oceanographic data management

LINKED DATA + DRUPALFOR OCEANOGRAPHIC DATA MANAGEMENT

➢ WELCOME TO THE JUNGLE (WE’VE GOT FUN N’ GAMES)

➢ HOW & WHY LINKED DATA HELPS

➢ USING LINKED DATA IN DRUPAL

Page 4: Linked Data + Drupal for Oceanographic data management

http://4.bp.blogspot.com/-gQWSBV6EnBo/TiRcN9unwbI/AAAAAAAAPXs/tydq754TRoI/s1600/vgdvd3.jpg

It’s 1984 ...

Page 5: Linked Data + Drupal for Oceanographic data management

http://i.telegraph.co.uk/multimedia/archive/01594/corey-haim_1594267c.jpg

Friday night

Page 6: Linked Data + Drupal for Oceanographic data management

http://img2.timeinc.net/people/i/2006/celebdatabase/patrickdempsey/patrick_dempsey5_180_240.jpghttp://img.timeinc.net/time/daily/2009/0901/360_elm_street_0105.jpg

MISSION: PIZZA

“What’s their address?”

“1428 Elm St.”

“Be there in 30 mins or less...or it’s free.”

Page 7: Linked Data + Drupal for Oceanographic data management

http://media-cache-ak0.pinimg.com/736x/07/57/b1/0757b14109002ff196eefbbe8e39bb6c.jpg

Page 8: Linked Data + Drupal for Oceanographic data management

http://swhomevid.site40.net/vhs_anh1.jpg

MISSION: MOVIE

“GET THE ONE WITH…”

➢ Righteous girl + bodacious dude

➢ Light beams flying everywhere

➢ The one with the “Force”

Page 9: Linked Data + Drupal for Oceanographic data management

The search begins...

https://deadlymovies.files.wordpress.com/2012/01/photo-2.jpg

Page 10: Linked Data + Drupal for Oceanographic data management

http://www.chud.com/wp-content/uploads/2012/07/MEGAFORCE-FRONT-copy.jpg

MOVIE: FOUND!

✓ Righteous girl + bodacious dude

✓ light beams flying everywhere

✓ The one with the “Force”

Page 11: Linked Data + Drupal for Oceanographic data management

BACK AT THE HOUSE…

http://static.guim.co.uk/sys-images/Film/Pix/pictures/2010/2/24/1267010697702/Winona-Ryder-Kim-Walker-L-001.jpg

Page 12: Linked Data + Drupal for Oceanographic data management

A Tale of Two Elm Streets

Which ‘Elm St’ was that?

http://i.huffpost.com/gen/1594554/thumbs/o-PIZZA-facebook.jpghttp://themaindamie.files.wordpress.com/2013/10/a-nightmare-on-elm-street-2010-horror-movies-11384409-720-297.jpghttp://img.timeinc.net/time/daily/2009/0901/360_elm_street_0105.jpg

Page 13: Linked Data + Drupal for Oceanographic data management

ELM ST. near Austin, TX

http://brooklynsteez.com/products/square/81690.pnghttp://tinyurl.com/mtmlbpx

#1

#2

Page 14: Linked Data + Drupal for Oceanographic data management

http://www.chud.com/wp-content/uploads/2012/07/MEGAFORCE-FRONT-copy.jpg

At least, you haveMEGAFORCE

✓ Righteous girl + bodacious dude

✓ light beams flying everywhere

✓ The one with the “Force”

Page 15: Linked Data + Drupal for Oceanographic data management

http://images.sodahead.com/slideshows/000000228/betamax-11979413784_xlarge.jpeghttp://upload.wikimedia.org/wikipedia/commons/thumb/3/3c/Betavhs2.jpg/220px-Betavhs2.jpg

Betamax vs. VHS

Page 16: Linked Data + Drupal for Oceanographic data management

WHAT HAPPENED, DUDE?

Page 17: Linked Data + Drupal for Oceanographic data management

PIZZA bad or no results = ambiguous query

MEGA FORCE got results, not what was expected

BETAMAX results weren’t useful

WHAT HAPPENED, DUDE?

Page 18: Linked Data + Drupal for Oceanographic data management

It’s A Hard Knock Life

http://2.bp.blogspot.com/_9ROOpn4epE0/SwHye-JfXYI/AAAAAAAADQo/mjKOBuVL3EU/s1600/02.jpg

Page 19: Linked Data + Drupal for Oceanographic data management

Livin’ on a Prayer➢ “Grand Challenges” require data

➢ Right data has been hard to find

http://4.bp.blogspot.com/-ymbRRrq5G-4/Uy99LJEuPTI/AAAAAAAAIzA/GbuMaLcLd1c/s1600/the-life-aquatic-with-steve-zissou-1024x435.png

Page 20: Linked Data + Drupal for Oceanographic data management

Zooplankton abundance

Page 21: Linked Data + Drupal for Oceanographic data management

http://fallmeeting.agu.org/2012/eposters/eposter/in43b-1506/

Page 22: Linked Data + Drupal for Oceanographic data management

PEOPLE & ORGANIZATIONS

http://www.thelifeaquatic.org/images/walking.jpg

Page 23: Linked Data + Drupal for Oceanographic data management

CRUISES & LOCATIONS

http://www.whoi.edu/main/ships/knorrhttp://www.whoi.edu/cruiseplanning/files/1355434346284_5722_Cruise_track_121312.jpg

R/V KNORR

Page 24: Linked Data + Drupal for Oceanographic data management

INSTRUMENTS & MEASUREMENTS

http://globec.whoi.edu/globec-dir/reports/al9906/Image29.gif http://www.whoi.edu/cms/images/instruments/2004/8/vpr_advanced_1383.gif

Page 25: Linked Data + Drupal for Oceanographic data management

FUNDING

http://thewartburgwatch.com/wp/wp-content/uploads/2012/05/fan-of-dollars1.jpg

Page 26: Linked Data + Drupal for Oceanographic data management

BCO-DMO on Drupal

http://www.bco-dmo.org

Page 27: Linked Data + Drupal for Oceanographic data management

AHA #1: Data needs CONTEXT

http://www.oocities.org/sunsetstrip/4426/visual/faces.gif

What is it:

2 faces

- or -

1 candlestick

Page 28: Linked Data + Drupal for Oceanographic data management

CONTEXTinfluences the understanding of a subject

by adding surrounding information.

Page 29: Linked Data + Drupal for Oceanographic data management

CONTEXTinfluences the understanding of a subject

by adding surrounding information.

Page 30: Linked Data + Drupal for Oceanographic data management

CONTEXT: Related Links

http://www.whoi.edu/oceanus/feature/deep-western-boundary-current

Page 31: Linked Data + Drupal for Oceanographic data management

http://www.whoi.edu/oceanus/feature/deep-western-boundary-current

CONTEXT: Related Links

Page 32: Linked Data + Drupal for Oceanographic data management

http://www.themightyginge.com/blog/wp-content/uploads/2014/04/porthole.jpghttp://compartmaps.com/images/415_World_Oceanflat.jpg

Geospatial CONTEXT

Page 33: Linked Data + Drupal for Oceanographic data management

http://www.themightyginge.com/blog/wp-content/uploads/2014/04/porthole.jpghttp://compartmaps.com/images/415_World_Oceanflat.jpg

Geospatial CONTEXT

Page 34: Linked Data + Drupal for Oceanographic data management

VISUALIZING the CONTENT

Page 35: Linked Data + Drupal for Oceanographic data management

VISUALIZING the CONTENT

Page 36: Linked Data + Drupal for Oceanographic data management

VISUALIZING the CONTENT,

Page 37: Linked Data + Drupal for Oceanographic data management

“STILL HAVEN’T FOUND WHAT I’M LOOKING FOR…”

http://4.bp.blogspot.com/-mTbIH1IeLpw/Uxvh-es_ifI/AAAAAAAAFEg/BtRDO0w9U6w/s1600/I-wonder-if-it-remembers-me.-life-aquatic-with-steve-zissou-2004.gif

Page 38: Linked Data + Drupal for Oceanographic data management

Addressing the “Grand Challenges” requires interoperable systems

to aid in the discovery &

exchange of information.

AHA #2: Cooperative Data

Page 39: Linked Data + Drupal for Oceanographic data management

Somewhere out there… where dreams come true.

Page 40: Linked Data + Drupal for Oceanographic data management

Express Yourself

What does it mean to be “friends”?

What does “connected” mean?

➢ Family are “friends”➢ Co-workers are “friends”➢ High-school acquaintances are “friends”

Page 41: Linked Data + Drupal for Oceanographic data management

Example: Walking on the Moon

http://astrobob.areavoices.com/files/2011/08/Moon-May-3-AS-Del1-1024x776.jpg

Page 42: Linked Data + Drupal for Oceanographic data management

Copernicus plotted

http://stko.geog.ucsb.edu/location_linked_data

Is that the moon?

Page 43: Linked Data + Drupal for Oceanographic data management

“One small step for man...” in South Sudan

APOLLO 11

http://dbpedia.oobian.com/#/OobianMaps/VPIN/dbp%253aCopernicus_(lunar_crater)

Page 44: Linked Data + Drupal for Oceanographic data management

http://www.leftcoastgrassfed.com/

Example: Grass-fed beef supplier

Page 45: Linked Data + Drupal for Oceanographic data management

SEARCH: “COASTAL BEEF”

http://www.leftcoastgrassfed.com/

Page 46: Linked Data + Drupal for Oceanographic data management

IS “COASTAL BEEF” DEADLY?

http://tinyurl.com/laawqgvhttp://i343.photobucket.com/albums/o465/MattLeader/Biggie-ReadyToDie-CD.jpg

Page 47: Linked Data + Drupal for Oceanographic data management

AHA #3: Reliable data exchange needs semantic interoperability

Page 48: Linked Data + Drupal for Oceanographic data management

AHA #3: Reliable data exchange needs semantic interoperability

➢ Sender knows Ready To Die is a “MusicalWork”

Page 49: Linked Data + Drupal for Oceanographic data management

AHA #3: Reliable data exchange needs semantic interoperability

➢ Sender knows Ready To Die is a “MusicalWork”

➢ Receiver should interpret Ready To Die as a “MusicalWork”

Page 50: Linked Data + Drupal for Oceanographic data management

Semantic interoperability

means shared UNDERSTANDING

throughout content exchange.

Page 51: Linked Data + Drupal for Oceanographic data management

If your content is worthy of a website,then it deserves to be understood.

http://drupal.org/files/druplicon.small_.pnghttp://www.mouthymag.com/wp-content/uploads/2013/11/tumblr_inline_mjwd8k0Zjs1qz4rgp.jpghttp://deployment.googleapps.com/_/rsrc/1326052805286/Home/user-resources/google-icons-and-logos/google_logo_3D_online_medium.png http://www.wildsoundmovies.com/images/terminator_logo.jpg

HUMANS MEDIATORS MACHINES

Page 52: Linked Data + Drupal for Oceanographic data management

SCREENCAST

LINKED DATA in ACTION

https://www.youtube.com/watch?v=_bn4muKqXv0

Page 53: Linked Data + Drupal for Oceanographic data management

MapServer

OpenSearch

Linked Data

Drupal

What’s the Stack, Yo?

http://mapserver.org/http://www.opensearch.org/http://www.w3.org/standards/semanticweb/datahttps://drupal.org/

Page 54: Linked Data + Drupal for Oceanographic data management

LINKED DATA

http://www.ibiblio.org/hhalpin/homepage/presentations/tpac2008/rdf.png

What’s the big deal?

Page 55: Linked Data + Drupal for Oceanographic data management

➢ Some facets are built from 3rd party

❏ Instruments by Type❏ Parameters by Type

Linked Data: The Deal

Page 56: Linked Data + Drupal for Oceanographic data management

➢ repository of oceanographic terms

➢ vetted by oceanographers(pan-European project)

➢ exposed as Linked Data by BODC

SeaDataNet @ BODC

http://vocab.nerc.ac.uk/http://www.seadatanet.org/extension/seadatanet2/design/skin-seadatanet2/images/Logo_SeaDataNet_fond_transparent.png

Page 57: Linked Data + Drupal for Oceanographic data management

One consumer was across the ‘pond’ - 3,000 miles away

It was assumed that SeaDataNet terms would be useful to others

Page 58: Linked Data + Drupal for Oceanographic data management

1. Context through RDF vocabularies

2. Cooperation via common framework (RDF)

3. Cooperation without coordination

4. Semantic Interoperability through HTTP URIs for naming things

LINKED DATA

http://www.ibiblio.org/hhalpin/homepage/presentations/tpac2008/rdf.png

Page 59: Linked Data + Drupal for Oceanographic data management

LINKED DATA + DRUPAL

http://www.ibiblio.org/hhalpin/homepage/presentations/tpac2008/rdf.pnghttp://fc03.deviantart.net/fs71/i/2011/179/c/d/vector_tree_by_axelintu-d3kedq3.pnghttp://drupal.org/files/druplicon.small_.png

Page 60: Linked Data + Drupal for Oceanographic data management

RDF (core)➢ Entities have globally unique URIs

➢ Content Types = RDF Vocabulary Classes

➢ Fields = RDF Vocabulary Class Properties

http://calexis.com/blog/wp-content/uploads/2010/06/My-Name-Is.jpg

CONTEXT

Page 61: Linked Data + Drupal for Oceanographic data management

RDFx (contrib)➢ Serializes content in RDF data model

(“structured data”)

○ 1 model = many formats■ HTML■ JSON■ XML■ TEXT

○ RestWSsupport

http://calexis.com/blog/wp-content/uploads/2010/06/My-Name-Is.jpghttp://www.contestheat.com/wp-content/uploads/2013/03/lays-flavor-walgreens-giveaway.png

COOPERATION

Page 62: Linked Data + Drupal for Oceanographic data management

RDF UI (rdfx)

https://drupal.org/files/issues/835350-8-rdf-ui-form-fields.jpg

Page 63: Linked Data + Drupal for Oceanographic data management

TimBL: Linked Data is a Bag of Chips

https://www.youtube.com/watch?v=ga1aSJXCFe0

Page 64: Linked Data + Drupal for Oceanographic data management

Vocabularies @ BCO-DMO

Ocean Data Ontology cruises, ships, instrumentation, measurements, funding

Dublin Core generic metadata

DCAT dataset catalog

FOAF people & organizations

VoID linking data

GeoSPARQL geospatial features

PROV-O provenance (revisions & activity)

For info on creating your own vocabulary, try this presentation: http://www.slideshare.net/OpenDataSupport/model-your-data-metadata

Page 65: Linked Data + Drupal for Oceanographic data management

Enable rdf and rdfx modules for immediate semantic interoperability

POWER-UP #1

http://images.clipartlogo.com/files/images/32/325521/mushroom-vector-power_f.pnghttp://37.media.tumblr.com/08e90c026242fbee0c7704b078219359/tumblr_mu1gb4NKee1sw8d3mo6_400.pnghttp://newsupermariobrosu.nintendo.com/_ui/img/powerups/art1b.png

Page 66: Linked Data + Drupal for Oceanographic data management

QUERYING LINKED DATA

http://www.cedar-project.nl/wp-content/uploads/alibobo_w3cSPARQL-logo.png

OpenSearch

Linked Data

Page 67: Linked Data + Drupal for Oceanographic data management

rdf_indexer (contrib)➢ Index data in triple store

➢ Uses Search API

➢ SPARQL endpoint

Page 68: Linked Data + Drupal for Oceanographic data management

rdf_indexer (contrib)➢ Uses Search API

Page 69: Linked Data + Drupal for Oceanographic data management

rdf_indexer (contrib)➢ SPARQL endpoint

Page 70: Linked Data + Drupal for Oceanographic data management

rdf_indexer (contrib)

➢ Extensible for support of external RDF stores

○ BCO-DMO uses Virtuoso RDF store

○ submitted Virtuoso extension as a patch (https://drupal.org/node/2029717)

■ BCO-DMO SPARQL endpoint:

http://lod.bco-dmo.org/sparql

Page 71: Linked Data + Drupal for Oceanographic data management

Enable rdf_indexer to make your data queryable.

POWER-UP #2

http://img2.wikia.nocookie.net/__cb20131129222600/mario/images/5/5d/Fireflower3dworld.pnghttp://newsupermariobrosu.nintendo.com/_ui/img/powerups/art1b.pnghttp://img3.wikia.nocookie.net/__cb20120718023604/fantendo/images/thumb/c/c7/NSMB2_Fire_Mario.png/1024px-NSMB2_Fire_Mario.png

Page 72: Linked Data + Drupal for Oceanographic data management

LINKED DATA: External Links

Page 73: Linked Data + Drupal for Oceanographic data management

LINKED DATA: External Links

Page 74: Linked Data + Drupal for Oceanographic data management

LINKED DATA: External Links

Page 75: Linked Data + Drupal for Oceanographic data management

LINKED DATA: External Links

Page 76: Linked Data + Drupal for Oceanographic data management

Generate value by creating links from your data to others.

POWER-UP #3

http://newsupermariobros2.nintendo.com/mobile/_ui/img/power-ups/carousel/super-star.pnghttp://newsupermariobrosu.nintendo.com/_ui/img/powerups/art1b.pnghttp://www.mariowiki.com/images/thumb/8/85/Nsmb2_starman_mario.png/220px-Nsmb2_starman_mario.png

http://dbpedia.org

https://www.freebase.com

http://www.wikidata.org

Page 77: Linked Data + Drupal for Oceanographic data management

DATA is out there...

http://datavisualization.ch/wp-content/uploads/2011/01/lod-wikipedia.png

Page 78: Linked Data + Drupal for Oceanographic data management

New York Times: Innovation Report

“...there are substantial costs to waiting.”

http://www.niemanlab.org/2014/05/the-leaked-new-york-times-innovation-report-is-one-of-the-key-documents-of-this-media-age/

Page 79: Linked Data + Drupal for Oceanographic data management

New York Times: Innovation Report

RECIPES aren’t properly tagged

by ingredients and cooking time

“We can do it now,

but only after spending a huge sum

to retroactively structure the data.”

http://www.niemanlab.org/2014/05/the-leaked-new-york-times-innovation-report-is-one-of-the-key-documents-of-this-media-age/

Page 80: Linked Data + Drupal for Oceanographic data management

New York Times: Innovation Report

“The lack of structured data helps explain why we are...“

1. unable to automate the sale of our photos

2. continually struggle to attain higher rankings on search engines.

http://www.niemanlab.org/2014/05/the-leaked-new-york-times-innovation-report-is-one-of-the-key-documents-of-this-media-age/

Page 81: Linked Data + Drupal for Oceanographic data management

New York Times: Innovation Report

“We need to reclaim our industry-leading position,

but right now our needs are far more basic.

We must expand the structured data we create.”

http://www.niemanlab.org/2014/05/the-leaked-new-york-times-innovation-report-is-one-of-the-key-documents-of-this-media-age/

Page 82: Linked Data + Drupal for Oceanographic data management

“I like a good story, well told.” -Mark Twain

Page 83: Linked Data + Drupal for Oceanographic data management

CONTEXT with CONTENT

Page 84: Linked Data + Drupal for Oceanographic data management

REFERENCES

Linked Data by David Wood (Manning)

Learning SPARQL by Bob DuCharme (O’Reilly)

Definitive Guide to Drupal 7 Chapter 28 by Stéphane Corlosquet (Apress)

http://www.manning.com/dwood/http://www.learningsparql.com/http://definitivedrupal.org/

Page 85: Linked Data + Drupal for Oceanographic data management

BoF: LINKED DATA & RDF IN DRUPAL

Time: Thursday · 11:45-01:00

Room: 10B - Blink Reaction | 3rd floor

Page 86: Linked Data + Drupal for Oceanographic data management

QUESTIONS? Twitter: @ashep_15drupal.org: ashepherd

Twitter: @scorlosquetdrupal.org: scor

Page 87: Linked Data + Drupal for Oceanographic data management

WHAT DID YOU THINK?

EVALUATE THIS SESSION: AUSTIN2014.DRUPAL.ORG/SCHEDULE

Thank you!

LINKED DATA + DRUPALFOR OCEANOGRAPHIC DATA MANAGEMENT