Aos china keizer-2010-10-30

44
10 years Agricultural Ontology Initiative: Building Blocks for a Linked Data Infrastructure Dr. Johannes Keizer FAO of the United Nations Office of Knowledge Exchange, Research and Extension Team Leader “Knowledge Standards and Services”

description

Presentation at the Chinese AOS workshop, Beijing, 2010, October 30-31

Transcript of Aos china keizer-2010-10-30

Page 1: Aos china keizer-2010-10-30

10 years Agricultural Ontology Initiative: Building Blocks for a Linked Data Infrastructure

Dr. Johannes Keizer

FAO of the United Nations

Office of Knowledge Exchange, Research and Extension

Team Leader “Knowledge Standards and Services”

Page 2: Aos china keizer-2010-10-30

dr johannes keizer - FAO of the United Nations - knowledge and capacity for development

Chinese Agricultural Ontology Service WS, Beijing 2010-10-30

The Internet!

Page 3: Aos china keizer-2010-10-30

dr johannes keizer - FAO of the United Nations - knowledge and capacity for development

Chinese Agricultural Ontology Service WS, Beijing 2010-10-30

Page 4: Aos china keizer-2010-10-30

dr johannes keizer - FAO of the United Nations - knowledge and capacity for development

Chinese Agricultural Ontology Service WS, Beijing 2010-10-30

Aggregation States of Knowledge

Page 5: Aos china keizer-2010-10-30

dr johannes keizer - FAO of the United Nations - knowledge and capacity for development

Chinese Agricultural Ontology Service WS, Beijing 2010-10-30

Data Flows and Repositories in Research

Page 6: Aos china keizer-2010-10-30

dr johannes keizer - FAO of the United Nations - knowledge and capacity for development

Chinese Agricultural Ontology Service WS, Beijing 2010-10-30

“... FAO’s principle task is to work to ensure that the world’s knowledge of food and

agriculture is available to those who need it when they need it and in a form which they can

access and use ...”

Page 7: Aos china keizer-2010-10-30

dr johannes keizer - FAO of the United Nations - knowledge and capacity for development

Chinese Agricultural Ontology Service WS, Beijing 2010-10-30

AOS Vision in 2001

Page 8: Aos china keizer-2010-10-30

dr johannes keizer - FAO of the United Nations - knowledge and capacity for development

Chinese Agricultural Ontology Service WS, Beijing 2010-10-30

..from thesaurus to Ontologies….

Page 9: Aos china keizer-2010-10-30

dr johannes keizer - FAO of the United Nations - knowledge and capacity for development

Chinese Agricultural Ontology Service WS, Beijing 2010-10-30

Our push of AGROVOC to the Semantic Web had enormous positive effects, among others

From 4 to 20 language versions

Defacto standard for indexing in many areas

More than 2000 downloads only in 2009

SKOS incorporated all our requirements

For many purposes we need semantics on a lower level than of a fully elaborated ontology – but we need them urgently

The development of specific Ontologies should be always application driven – a demand economy

Lessons Learned

Page 10: Aos china keizer-2010-10-30

dr johannes keizer - FAO of the United Nations - knowledge and capacity for development

Chinese Agricultural Ontology Service WS, Beijing 2010-10-30

AOS - TodaySemanticsTools

Linked DataCommunity

Page 11: Aos china keizer-2010-10-30

dr johannes keizer - FAO of the United Nations - knowledge and capacity for development

Chinese Agricultural Ontology Service WS, Beijing 2010-10-30

Community

Page 12: Aos china keizer-2010-10-30

dr johannes keizer - FAO of the United Nations - knowledge and capacity for development

Chinese Agricultural Ontology Service WS, Beijing 2010-10-30

The AOS Community

Page 13: Aos china keizer-2010-10-30

dr johannes keizer - FAO of the United Nations - knowledge and capacity for development

Chinese Agricultural Ontology Service WS, Beijing 2010-10-30

http://aims.fao.org/community/home

Page 14: Aos china keizer-2010-10-30

dr johannes keizer - FAO of the United Nations - knowledge and capacity for development

Chinese Agricultural Ontology Service WS, Beijing 2010-10-30

Better Semantics

Page 15: Aos china keizer-2010-10-30

dr johannes keizer - FAO of the United Nations - knowledge and capacity for development

Chinese Agricultural Ontology Service WS, Beijing 2010-10-30

around 30,000 concepts

600000 labels in around 20 languages.

one-stop shop for terminological knowledge related to agriculture in general

a knowledge base of related concepts organized in ontological relationships (hierarchical, associative, equivalence)

Is a concept/term/string based system

Concepts may be organized in multiple categories.

AGROVOC concept scheme

Page 16: Aos china keizer-2010-10-30

dr johannes keizer - FAO of the United Nations - knowledge and capacity for development

Chinese Agricultural Ontology Service WS, Beijing 2010-10-30

Further schemes in FAO

skos:broader

:bar

has_synonymhas_translation

skos:literalForm “maize”:foomaïs (fr)

:foo

has_synonymskos:literalForm “corn”

:bar

8171

1474

skosxl:altLabel

skosxl:prefLabel

skos:broader

has_synonym

SKOS Label

The AGROVOC concept scheme

SKOSConcept

rdf:type

rdf:type

6211

skos:broader

AGROVOCConceptScheme

skos:topConceptOf

skos:inScheme

Another scheme in FAO

Other scheme in FAO

skos:inScheme

12332

Page 17: Aos china keizer-2010-10-30

dr johannes keizer - FAO of the United Nations - knowledge and capacity for development

Chinese Agricultural Ontology Service WS, Beijing 2010-10-30

Work Expression Manifestation Item

Subjects

Corporate Bodies

Conferences Journals

Series

FAO Projects

FAO FRBR Model & Authority Data

Page 18: Aos china keizer-2010-10-30

dr johannes keizer - FAO of the United Nations - knowledge and capacity for development

Chinese Agricultural Ontology Service WS, Beijing 2010-10-30

Journal(URI–Concept)

CorporateBody (URI)

SpellingVariant

City

Geopoliti cal Ontology (URI)

isSpatiallyIncludedIn

isPublishedByISSN

ISSN-L

isOtherLanguageEditionOf

isFollowedBy/Follows

Label

Journal(URI–Concept)

Other URIs…

EXAMPLE: JOURNAL CONTENT MODEL

Page 19: Aos china keizer-2010-10-30

dr johannes keizer - FAO of the United Nations - knowledge and capacity for development

Chinese Agricultural Ontology Service WS, Beijing 2010-10-30

A Model to create Linked Data

Rich set of relationships Easier implementation of concept-based thesauri and authority data

FAO OAFRBR

RDFLLD

Page 20: Aos china keizer-2010-10-30

dr johannes keizer - FAO of the United Nations - knowledge and capacity for development

Chinese Agricultural Ontology Service WS, Beijing 2010-10-30

Geopolitical Ontology

OEKM FAO of the UN 20

Page 21: Aos china keizer-2010-10-30

dr johannes keizer - FAO of the United Nations - knowledge and capacity for development

Chinese Agricultural Ontology Service WS, Beijing 2010-10-30

Fishery Ontologies

Page 22: Aos china keizer-2010-10-30

dr johannes keizer - FAO of the United Nations - knowledge and capacity for development

Chinese Agricultural Ontology Service WS, Beijing 2010-10-30

What Partners have done…..

Rice Knowledge Models

Rice Production Ontology

ASFA Thesaurus

VIVO Ontologies

Look to the many presentations on this workshop

Page 23: Aos china keizer-2010-10-30

dr johannes keizer - FAO of the United Nations - knowledge and capacity for development

Chinese Agricultural Ontology Service WS, Beijing 2010-10-30

Tools

Page 24: Aos china keizer-2010-10-30

dr johannes keizer - FAO of the United Nations - knowledge and capacity for development

Chinese Agricultural Ontology Service WS, Beijing 2010-10-30

The Concept Scheme Work Bench

Page 25: Aos china keizer-2010-10-30

dr johannes keizer - FAO of the United Nations - knowledge and capacity for development

Chinese Agricultural Ontology Service WS, Beijing 2010-10-30

Drupal

AgriDrupal is a “suite of solutions” for agricultural information management and dissemination, built on the Drupal CMS by different

Institutions and individuals who are now sharing their experiences in the AgriDrupal community

Drupal, a semantic web enabled CMS General purpose CMS necessary

Drupal has flexibility to manage all information types

Drupal has a strong user community

Version 7 natively with RDF backbone, but semantic applications already possible with version 6

Drupal can be a producer and consumer of Linked Data

Page 26: Aos china keizer-2010-10-30

dr johannes keizer - FAO of the United Nations - knowledge and capacity for development

Chinese Agricultural Ontology Service WS, Beijing 2010-10-30

Drupal Query run on a Drupal website from a Virtuoso test environment at http://demo.openlinksw.com/sparql_demo/

SPARQL endpoint

RDF triples

Drupal website

Page 27: Aos china keizer-2010-10-30

dr johannes keizer - FAO of the United Nations - knowledge and capacity for development

Chinese Agricultural Ontology Service WS, Beijing 2010-10-30

• Objectives:• Assure quality in metadata creation • Sharing information in a standardized manner • Use of common semantics and interoperable

syntaxes• Use of more sophisticated and specialized

metadata • Use of controlled, multilingual vocabularies

• Requirements:• AGRIS AP compliancy• AGROVOC

AgriOcean Dspace – a tool for Repositories

Page 28: Aos china keizer-2010-10-30

dr johannes keizer - FAO of the United Nations - knowledge and capacity for development

Chinese Agricultural Ontology Service WS, Beijing 2010-10-30

AgriOceanDspace – Thesaurus plug in

• Developed by Kasetsart University (Bangkok, Thailand)

• Thesaurus plug-ino Web services: use local or remote version of AGROVOC

thesaurus/SKOS

Page 29: Aos china keizer-2010-10-30

dr johannes keizer - FAO of the United Nations - knowledge and capacity for development

Chinese Agricultural Ontology Service WS, Beijing 2010-10-30

Linking Data

Page 30: Aos china keizer-2010-10-30

dr johannes keizer - FAO of the United Nations - knowledge and capacity for development

Chinese Agricultural Ontology Service WS, Beijing 2010-10-30

The Linked Data Universe: http://www.linkeddata.org (july 2010)

Page 31: Aos china keizer-2010-10-30

dr johannes keizer - FAO of the United Nations - knowledge and capacity for development

Chinese Agricultural Ontology Service WS, Beijing 2010-10-30

http://agris.fao.org/agris-search/search/display.do?f=2004/ZA/ZA04002.xml;ZA2004000049

Page 32: Aos china keizer-2010-10-30

dr johannes keizer - FAO of the United Nations - knowledge and capacity for development

Chinese Agricultural Ontology Service WS, Beijing 2010-10-30

AGROVOC EUROVOC UNBIS Relationship

http://aims.fao.org/aos/agrovoc/c_207

http://eurovoc.europa.eu/219055

agroforestry skos:exactMatch/ owl:sameAs

http://aims.fao.org/aos/agrovoc/c_4826

http://eurovoc.europa.eu/220018

MILK skos:exactMatch/ owl:sameAs

http://aims.fao.org/aos/agrovoc/c_12332

http://eurovoc.europa.eu/219871

MAIZE skos:exactMatch/ owl:sameAs

Linking vocabularies

Page 33: Aos china keizer-2010-10-30

dr johannes keizer - FAO of the United Nations - knowledge and capacity for development

Chinese Agricultural Ontology Service WS, Beijing 2010-10-30

http://aims.fao.org/aos/agrovoc/c_7825

http://eurovoc.europa.eu/218754

Page 34: Aos china keizer-2010-10-30

dr johannes keizer - FAO of the United Nations - knowledge and capacity for development

Chinese Agricultural Ontology Service WS, Beijing 2010-10-30

http://eurovoc.europa.eu/219871

Maize

skosxl: literalForm

Maize

http://aims.fao.org/aos/agrovoc/c_12332

AGROVOC

skosxl: literalFormMaize

http://aims.fao.org/aos/agrovoc/c_12332 owl:sameAs http://eurovoc.europa.eu/219871

owl:sameAs/exactMatch

http://agris.fao.org/agris-search/search/display.do?f=1996/TR/TR96001.xml;TR9600026

Linking data through common URIs

skosxl: literalForm

owl:sameAs/exactMatch

http://eur-lex.europa.eu/LexUriServ/LexUriServ.do?uri=OJ:L:2010:202:0011:0015:EN:PDF

http://unbisnet.un.org:8080/ipac20/ipac.jsp?session=128F308557F34.283092&profile=bib&uri=full=3100001~!685149~!1&ri=1&aspect=subtab124&menu=search&source=~!horizon

Maize

Eurovoc

UNBIS

Page 35: Aos china keizer-2010-10-30

dr johannes keizer - FAO of the United Nations - knowledge and capacity for development

Chinese Agricultural Ontology Service WS, Beijing 2010-10-30

What are we doing with unstructured data?

• We have enormous amounts of unstructured material

• Still most of the documents that we are producing are mostly semantically unstructured

• Human work to catalogue and index is becoming always more rare

• We need machines to do automatic semantic mark ups of text

• If machines are trained and based on concept schemes, ther are able to do so

Page 36: Aos china keizer-2010-10-30

dr johannes keizer - FAO of the United Nations - knowledge and capacity for development

Chinese Agricultural Ontology Service WS, Beijing 2010-10-30

Page 37: Aos china keizer-2010-10-30

dr johannes keizer - FAO of the United Nations - knowledge and capacity for development

Chinese Agricultural Ontology Service WS, Beijing 2010-10-30

• Does Concept identification in unstructured texts

• Uses Agrovoc as a controlled vocabulary

• Prototype under testing with excellent results (entire repository of ICARDA indexed)

• Will produce in future Structured RDF files that can be used to link data like “open Calais”

AgroTagger

Page 38: Aos china keizer-2010-10-30

dr johannes keizer - FAO of the United Nations - knowledge and capacity for development

Chinese Agricultural Ontology Service WS, Beijing 2010-10-30

Page 39: Aos china keizer-2010-10-30

dr johannes keizer - FAO of the United Nations - knowledge and capacity for development

Chinese Agricultural Ontology Service WS, Beijing 2010-10-30

Page 40: Aos china keizer-2010-10-30

dr johannes keizer - FAO of the United Nations - knowledge and capacity for development

Chinese Agricultural Ontology Service WS, Beijing 2010-10-30

Page 41: Aos china keizer-2010-10-30

dr johannes keizer - FAO of the United Nations - knowledge and capacity for development

Chinese Agricultural Ontology Service WS, Beijing 2010-10-30

Life Demo: Semantic mark ups:

http://viewer.opencalais.com/

http://agropedialabs.iitk.ac.in/Tagger/Agrotagger_text.php

Page 42: Aos china keizer-2010-10-30

dr johannes keizer - FAO of the United Nations - knowledge and capacity for development

Chinese Agricultural Ontology Service WS, Beijing 2010-10-30

The CIARD RING

Page 43: Aos china keizer-2010-10-30

dr johannes keizer - FAO of the United Nations - knowledge and capacity for development

Chinese Agricultural Ontology Service WS, Beijing 2010-10-30

AGRIS Linked Data

Page 44: Aos china keizer-2010-10-30

Thank You!http://www.ciard.nethttp://ring.ciard.nethttp://aims.fao.orghttp://agris.fao.org