AGRIS and AGROVOC: a bibliographic catalogue and its thesaurus ...

47
AGRIS and AGROVOC: a bibliographic catalogue and its thesaurus into the world of linked data The experience of the Food and Agriculture Organization of the UN (FAO) [email protected] IRCDL 5 th February 2016, Firenze

Transcript of AGRIS and AGROVOC: a bibliographic catalogue and its thesaurus ...

Page 1: AGRIS and AGROVOC: a bibliographic catalogue and its thesaurus ...

AGRISandAGROVOC:abibliographiccatalogueandits

thesaurusintotheworldoflinkeddata

TheexperienceoftheFoodandAgricultureOrganizationoftheUN(FAO)

[email protected]

IRCDL5th February2016,Firenze

Page 2: AGRIS and AGROVOC: a bibliographic catalogue and its thesaurus ...

Today

• AfewwordsonFAO• AGRIS,aLODbasedapplication• AGROVOC,aconceptscheme

Page 3: AGRIS and AGROVOC: a bibliographic catalogue and its thesaurus ...

FAOFoodandAgricultureOrganizationoftheUN

Page 4: AGRIS and AGROVOC: a bibliographic catalogue and its thesaurus ...

BasicsonFAO• Foundedin1945• Goalsoftheorganization:Helpeliminatehunger,foodinsecurity andmalnutrition– makeagriculture,forestryandfisheriesmoreproductiveandsustainable – reduceruralpoverty - enableinclusiveandefficient foodsystems – increasetheresilience oflivelihoods

• Currently,194members• HQinRome,5regionaloffices,variouscountryoffices

Page 5: AGRIS and AGROVOC: a bibliographic catalogue and its thesaurus ...

FAO&information• Corporatedocuments– “Stateof…”,guidelinesforgovernments,researchandreportsonspecificthemes/areas– http://www.fao.org/publications/

• Collectionofstatistics– http://faoostat.org.fao.org…

• Distancelearning- http://www.fao.org/elearning/• Capacitydevelopment• Promotionof(open)accesstoinformationamongmembercountries

Page 6: AGRIS and AGROVOC: a bibliographic catalogue and its thesaurus ...

AGRIS

Page 7: AGRIS and AGROVOC: a bibliographic catalogue and its thesaurus ...

AGRISpartnership

• Startedin1975,tohelppartnerspromotetheirscientificproduction– Typically,ministriesandresearchcentresinagriculture

• Inpractice,abibliographicrepositorycontributedbypartnersandcompiled&disseminatedbyFAO(onpaper,CD,..)

Page 8: AGRIS and AGROVOC: a bibliographic catalogue and its thesaurus ...

Agris today

1. Anetwork:collaborativenetworkofmorethan150institutionsfrom65countries

2. AWebportal:agris.fao.org/ isaWebapplicationthatenrichestheAGRISrepositorywithrelatedWebresources.UsesLinkedOpenDatamethodologies

3. AnRDFdatabase

Page 9: AGRIS and AGROVOC: a bibliographic catalogue and its thesaurus ...

TheAGRISnetwork

Page 10: AGRIS and AGROVOC: a bibliographic catalogue and its thesaurus ...

TheAGRISnetworkataglance

Page 11: AGRIS and AGROVOC: a bibliographic catalogue and its thesaurus ...

TheAGRISportal

Page 12: AGRIS and AGROVOC: a bibliographic catalogue and its thesaurus ...

agris.fao.org

Page 13: AGRIS and AGROVOC: a bibliographic catalogue and its thesaurus ...

AnAGRISrecord

13

Page 14: AGRIS and AGROVOC: a bibliographic catalogue and its thesaurus ...

Linkedresources• DBPedia• NatureOpenSeach• GBIF• WorldBank• FAOgeopoliticalontology– Countryprofiles• IFPRI• FAOfisheriesandaquaculturefactsheets• Bioversity international• CGRISgermplasm database

• Full-text:anincreasingnumberoffullpapersisavailable,usingsimplesearchthroughGoogle

Page 15: AGRIS and AGROVOC: a bibliographic catalogue and its thesaurus ...

Agris content

~8millionmultilingual bibliographicrecords– 400,000fromLatinAmerica– 150,000fromAfrica– 760,000fromAsia+400,000linkstoCASDD(China)

• ~250milliontriples

Page 16: AGRIS and AGROVOC: a bibliographic catalogue and its thesaurus ...

Access

• From200+countriesandterritories

16

GoogleAnalyticsOctober 2015

Page 17: AGRIS and AGROVOC: a bibliographic catalogue and its thesaurus ...

Multilinguality

Page 18: AGRIS and AGROVOC: a bibliographic catalogue and its thesaurus ...

AGRISisnativelymultilingual

Page 19: AGRIS and AGROVOC: a bibliographic catalogue and its thesaurus ...

AGRIS:LinkedOpenDatainaction 19

Page 20: AGRIS and AGROVOC: a bibliographic catalogue and its thesaurus ...

AGRIS:LinkedOpenDatainaction 20

Page 21: AGRIS and AGROVOC: a bibliographic catalogue and its thesaurus ...

TheAGRISLODdataset

Page 22: AGRIS and AGROVOC: a bibliographic catalogue and its thesaurus ...

ALODdataset

AGRISURI AGROVOCURI

dcterms:subject

DBPediaURI

skos:closeMatchskos:exactMatch

DBPediaAbstract

WikipediaURL

DBPediaPicture

foaf:isPrimaryTopicOfdbpedia-owl:abstractfoaf:depiction

Entrypoint!

AGROVOCisthe

backbone

Page 23: AGRIS and AGROVOC: a bibliographic catalogue and its thesaurus ...

AGROVOCenablesAGRISLOD

1. alldocumentsinAGRISareindexedwithAGROVOC–Manually,bythepartner–Automatically,byAGRIS

2. AGROVCisaLODresource– AGROVOC linkstoVoc

– Voc indexesData

– AGRISlinkstoData

3. AGROVOCkeywordsarealsousedtoqueryexternalWebServices

Page 24: AGRIS and AGROVOC: a bibliographic catalogue and its thesaurus ...

AGROVOCenablesmultilingualsearch

• AGRISrecordsareindexedwithAGROVOCkeywordsinaspecificlanguage

• AGROVOCconceptshavemultilinguallabels–allwiththesameURI

• Queriesareexpandedtomatchresultsindexedinanylanguage

Page 25: AGRIS and AGROVOC: a bibliographic catalogue and its thesaurus ...

Accessibility

• Sparql endpoints– Records– Serials– centers

• DataservedasLOD• ComeswithaVoID file

AGRISWeb

ApacheSolrIndex

Triplestore

Page 26: AGRIS and AGROVOC: a bibliographic catalogue and its thesaurus ...

AgriMetaMaker WebAGRIS OAI-PMHharvesterLocalDBsdumps

AGRISinputmodule

RDFmanager

Datacollection&processing

URIscreation,RDFgeneration

Entitiesdisambiguation,provenance,

dataenhancement,…

Page 27: AGRIS and AGROVOC: a bibliographic catalogue and its thesaurus ...

AGROVOC

Page 28: AGRIS and AGROVOC: a bibliographic catalogue and its thesaurus ...

aims.fao.org/agrovoc

Page 29: AGRIS and AGROVOC: a bibliographic catalogue and its thesaurus ...

AGROVOCinshort

• Startedasathesaurusin1980• CoversallareasofinteresttoFAO,e.g.agriculture,forestry,fisheries,nutrition,environment,…

• 32,000+conceptsinupto23languages• ALinkedOpenDataset,available invariousformats

Page 30: AGRIS and AGROVOC: a bibliographic catalogue and its thesaurus ...

AnAGROVOCconcept

Page 31: AGRIS and AGROVOC: a bibliographic catalogue and its thesaurus ...

AnRDFdataset

• ThesaurusconvertedtoanRDFSKOSconceptscheme

• Goaltohave“standard”RDF– SkOS-XL,DC,DCterms,FOAF– andaspecificvocabulary,Agrontology ->

Page 32: AGRIS and AGROVOC: a bibliographic catalogue and its thesaurus ...

wheats@en

http://zbw.eu/stw/descriptor/14098-1

skosxl:prefLabel

skos:broader

skosxl:prefLabel2015-02-03T22:59:45Z

c_8373

c_11456

skos:exactMatch

skos:related

skos:definition

dcterms:created

“Adefinition”

rdf:value

“AnURLforitssourcevb:hasLink

skosxl:literlForm

agrontology:hasProduct

c_3032

wheatstraw@enc_3032

foodproducts@en

xl_en_c3955

xl_jp_c3485

xl_en_c134

小麦@zh

Hardwheat@en

Page 33: AGRIS and AGROVOC: a bibliographic catalogue and its thesaurus ...

Multilinguality

• 32,000+conceptsinupto23languages• =conceptsmayhavelabelsinoneormorelanguages– Onehierarchy,manylanguages– Nolanguageis“compulsory”– AlthoughthereisanhistoricalpreferenceforEnglishasalinguafranca

Page 34: AGRIS and AGROVOC: a bibliographic catalogue and its thesaurus ...

VocBench – SKOSeditingplatform

Page 35: AGRIS and AGROVOC: a bibliographic catalogue and its thesaurus ...

Acommunityofeditors

Page 36: AGRIS and AGROVOC: a bibliographic catalogue and its thesaurus ...

Akinkeddataset

• Linksto16vocabularies• Skos:closeMatch,• skos:exactMatch• LinksidentifiedwithSemi-automaticprocess

• ComeswithaVoID file

VoID file

Page 37: AGRIS and AGROVOC: a bibliographic catalogue and its thesaurus ...
Page 38: AGRIS and AGROVOC: a bibliographic catalogue and its thesaurus ...
Page 39: AGRIS and AGROVOC: a bibliographic catalogue and its thesaurus ...

AnAGROVOCconceptintheLODview

Page 40: AGRIS and AGROVOC: a bibliographic catalogue and its thesaurus ...

AdoptersofAGROVOC

Page 41: AGRIS and AGROVOC: a bibliographic catalogue and its thesaurus ...

HowtoaccessAGROVOC

• Online,search• Download(RDF)• WebservicesbuiltontopoftheRDF• SPARQLendpoint

Page 42: AGRIS and AGROVOC: a bibliographic catalogue and its thesaurus ...

TheAGROVOCtechnologystack

Page 43: AGRIS and AGROVOC: a bibliographic catalogue and its thesaurus ...

Ongoing&future

Page 44: AGRIS and AGROVOC: a bibliographic catalogue and its thesaurus ...

GlobalAgricultureConceptSchemeGACS- beta

Page 45: AGRIS and AGROVOC: a bibliographic catalogue and its thesaurus ...

GACSataglance

• Workinggroup:AGROVOC,NALT,CABI• Steeringcommittee:..+INRA,CGIAR• Betacore1.6=15,000caconcepts• Amergeofallinfoavailable• Ongoing:preparationforpublicrelease• Future:expandGACSframeworktoincluderelevantsemanticresourcesinagriculture– fordocumentindexing,fordataannotation.PossiblecollaborationwithAgroPortal

Page 46: AGRIS and AGROVOC: a bibliographic catalogue and its thesaurus ...

Credits• AGROVOC:Caterina Caracciolo,SarahDister,JohannesKeizer,Marie-AngeliqueLaporte,Karna Wegner,LucianaZedda

• AGRIS:Fabrizio Celli,YvesJaques,MauroRanchicchio• VocBench:ArmandoStellato,AndreaTurbati (UTorVergata,Rome)

• JohannesKeizer,headoftheAIMSteam@FAO

• Technicalsupport:MIMOSBerhad (Malaysia)hostssomeofthetechnicalinfrastructureofAGROVOCandAGRIS.AgroKnow (Greece)supportsthedataAGRISingestionphase.

Page 47: AGRIS and AGROVOC: a bibliographic catalogue and its thesaurus ...

PointersandcontactsAGROVOC:aims.fao.org/agrovocAGRIS: agris.fao.orgVocBench:http://vocbench.uniroma2.it/

VocBench sandbox:http://202.73.13.50:55481/vocbench/ (withAGROVOC)

AIMScommunity:http://aims.fao.org/Subscribe,you get thenews

VBm-list:http://groups.google.com/group/vocbench-user

[email protected]