Making The Most of Existing and Mashable Data Sources
-
Upload
dimitri-van-hees -
Category
Data & Analytics
-
view
76 -
download
6
description
Transcript of Making The Most of Existing and Mashable Data Sources
![Page 1: Making The Most of Existing and Mashable Data Sources](https://reader033.fdocuments.us/reader033/viewer/2022042715/5583898ed8b42a282c8b4a9f/html5/thumbnails/1.jpg)
Making The Most of Existing and Mashable Data Sources
Dimitri van Hees, APIcon UK 2014
![Page 2: Making The Most of Existing and Mashable Data Sources](https://reader033.fdocuments.us/reader033/viewer/2022042715/5583898ed8b42a282c8b4a9f/html5/thumbnails/2.jpg)
About me
• Technical Architect• Data Specialist• Freshheads BV• API supporter
![Page 3: Making The Most of Existing and Mashable Data Sources](https://reader033.fdocuments.us/reader033/viewer/2022042715/5583898ed8b42a282c8b4a9f/html5/thumbnails/3.jpg)
About me
“The only bad thing about API is that it’s the inverse of IPA”
![Page 4: Making The Most of Existing and Mashable Data Sources](https://reader033.fdocuments.us/reader033/viewer/2022042715/5583898ed8b42a282c8b4a9f/html5/thumbnails/4.jpg)
About me
• Brewmaster• MQTT API driven brewery
“De Brouwtoren”
![Page 5: Making The Most of Existing and Mashable Data Sources](https://reader033.fdocuments.us/reader033/viewer/2022042715/5583898ed8b42a282c8b4a9f/html5/thumbnails/5.jpg)
![Page 6: Making The Most of Existing and Mashable Data Sources](https://reader033.fdocuments.us/reader033/viewer/2022042715/5583898ed8b42a282c8b4a9f/html5/thumbnails/6.jpg)
Buzzwords
• #BigData• #OpenData• #LinkedOpenData• #SemanticWeb• #Web30• #IoT
![Page 7: Making The Most of Existing and Mashable Data Sources](https://reader033.fdocuments.us/reader033/viewer/2022042715/5583898ed8b42a282c8b4a9f/html5/thumbnails/7.jpg)
Buzzwords
• #BigData: lots of data• #OpenData: free data• #LinkedOpenData: free Linked Data• #SemanticWeb: Linked Data• #Web30: Linked Data• #IoT: Connected devices, sensor data
![Page 8: Making The Most of Existing and Mashable Data Sources](https://reader033.fdocuments.us/reader033/viewer/2022042715/5583898ed8b42a282c8b4a9f/html5/thumbnails/8.jpg)
Real world
Quality
PriceQuantity
![Page 9: Making The Most of Existing and Mashable Data Sources](https://reader033.fdocuments.us/reader033/viewer/2022042715/5583898ed8b42a282c8b4a9f/html5/thumbnails/9.jpg)
Data quality
• Machine readable?• Accessible via webservices?• Up-to-date?• Verified?
![Page 10: Making The Most of Existing and Mashable Data Sources](https://reader033.fdocuments.us/reader033/viewer/2022042715/5583898ed8b42a282c8b4a9f/html5/thumbnails/10.jpg)
Data quantity
• Can we store it?• Can we process it?• Is it representative?
![Page 11: Making The Most of Existing and Mashable Data Sources](https://reader033.fdocuments.us/reader033/viewer/2022042715/5583898ed8b42a282c8b4a9f/html5/thumbnails/11.jpg)
Data price
• What does it cost?• Do we need an API key?• Are we allowed to use it?• And also for commercial purposes?
![Page 12: Making The Most of Existing and Mashable Data Sources](https://reader033.fdocuments.us/reader033/viewer/2022042715/5583898ed8b42a282c8b4a9f/html5/thumbnails/12.jpg)
Privacy
![Page 13: Making The Most of Existing and Mashable Data Sources](https://reader033.fdocuments.us/reader033/viewer/2022042715/5583898ed8b42a282c8b4a9f/html5/thumbnails/13.jpg)
![Page 14: Making The Most of Existing and Mashable Data Sources](https://reader033.fdocuments.us/reader033/viewer/2022042715/5583898ed8b42a282c8b4a9f/html5/thumbnails/14.jpg)
Freebase
![Page 15: Making The Most of Existing and Mashable Data Sources](https://reader033.fdocuments.us/reader033/viewer/2022042715/5583898ed8b42a282c8b4a9f/html5/thumbnails/15.jpg)
Freebase
• REST interface• MQL (Metaweb Query Language)• Free API key• Free RDF download• Search widget• http://www.freebase.com/m/09889g• https://
www.googleapis.com/freebase/v1/topic/m/09889g
![Page 16: Making The Most of Existing and Mashable Data Sources](https://reader033.fdocuments.us/reader033/viewer/2022042715/5583898ed8b42a282c8b4a9f/html5/thumbnails/16.jpg)
DBPedia
![Page 17: Making The Most of Existing and Mashable Data Sources](https://reader033.fdocuments.us/reader033/viewer/2022042715/5583898ed8b42a282c8b4a9f/html5/thumbnails/17.jpg)
DBPedia
• Wikipedia as Linked Data• Synchronizes Wikipedia periodically• Free RDF download• SPARQL endpoint (dbpedia-owl:wikiPageID)• DBPedia lookup API• http://
lookup.dbpedia.org/api/search.asmx/KeywordSearch?QueryString=Michael%20Jackson• http://dbpedia.org/sparql
![Page 18: Making The Most of Existing and Mashable Data Sources](https://reader033.fdocuments.us/reader033/viewer/2022042715/5583898ed8b42a282c8b4a9f/html5/thumbnails/18.jpg)
Semantic API’s
• Dandelion.eu• 1000 free requests/day• Provides links to DBPedia as well• https
://dandelion.eu/products/datatxt/nex/demo/?exec=true#
![Page 19: Making The Most of Existing and Mashable Data Sources](https://reader033.fdocuments.us/reader033/viewer/2022042715/5583898ed8b42a282c8b4a9f/html5/thumbnails/19.jpg)
Or just add it yourself…
…but never ever re-invent the wheel!
![Page 20: Making The Most of Existing and Mashable Data Sources](https://reader033.fdocuments.us/reader033/viewer/2022042715/5583898ed8b42a282c8b4a9f/html5/thumbnails/20.jpg)
Thank you!
• Twitter: http://twitter.com/dvh• E-mail: [email protected]• GitHub: http://github.com/dvh• LinkedIn: https://linkedin.com/in/dimitrivanhees
![Page 21: Making The Most of Existing and Mashable Data Sources](https://reader033.fdocuments.us/reader033/viewer/2022042715/5583898ed8b42a282c8b4a9f/html5/thumbnails/21.jpg)
Thank you!
• Twitter: http://twitter.com/dvh• E-mail: [email protected]• GitHub: http://github.com/dvh• LinkedIn: https://linkedin.com/in/dimitrivanhees
• Brewery: http://facebook.com/brouwtoren