Describing Scientific Datasets: The HCLS Community Profile
-
Upload
alasdair-gray -
Category
Technology
-
view
1.140 -
download
0
description
Transcript of Describing Scientific Datasets: The HCLS Community Profile
![Page 1: Describing Scientific Datasets: The HCLS Community Profile](https://reader036.fdocuments.us/reader036/viewer/2022081401/559ec9b31a28abb6338b45da/html5/thumbnails/1.jpg)
Describing Scientific Datasets: The HCLS Community Profile
Alasdair J G [email protected]
alasdairjggray.co.uk
@gray_alasdair
Michel DumontierStanford University
M. Scott MarshallMAASTRO Clinic
![Page 2: Describing Scientific Datasets: The HCLS Community Profile](https://reader036.fdocuments.us/reader036/viewer/2022081401/559ec9b31a28abb6338b45da/html5/thumbnails/2.jpg)
![Page 3: Describing Scientific Datasets: The HCLS Community Profile](https://reader036.fdocuments.us/reader036/viewer/2022081401/559ec9b31a28abb6338b45da/html5/thumbnails/3.jpg)
![Page 4: Describing Scientific Datasets: The HCLS Community Profile](https://reader036.fdocuments.us/reader036/viewer/2022081401/559ec9b31a28abb6338b45da/html5/thumbnails/4.jpg)
Data Cache (Triple Store)
Semantic Workflow Engine
Linked Data API (RDF/XML, TTL, JSON) Domain
Specific
Services
Identity
Resolution
Service
Identifier
Management
Service
“Adenosine
receptor 2a”
EC2.43.4
CS4532
P12374
Co
re P
latf
orm
ChEMBL-
RDF
ChEMBL
v13
Chem2
Bio2RDF
SD
v13v12
v2 or v8
![Page 5: Describing Scientific Datasets: The HCLS Community Profile](https://reader036.fdocuments.us/reader036/viewer/2022081401/559ec9b31a28abb6338b45da/html5/thumbnails/5.jpg)
Data Cache (Triple Store)
Semantic Workflow Engine
Linked Data API (RDF/XML, TTL, JSON) Domain
Specific
Services
Identity
Resolution
Service
Identifier
Management
Service
“Adenosine
receptor 2a”
EC2.43.4
CS4532
P12374
Co
re P
latf
orm
ChEMBL-
RDF
ChEMBL
v13
Chem2
Bio2RDF
SD
v13v12
v2 or v8
Open PHACTS
Discovery PlatformHistoric Use Case~January 2012
Open PHACTS v1.3ChEMBL 16
http://tiny.cc/ops-datasets
![Page 6: Describing Scientific Datasets: The HCLS Community Profile](https://reader036.fdocuments.us/reader036/viewer/2022081401/559ec9b31a28abb6338b45da/html5/thumbnails/6.jpg)
Challenges
Datasets available
In many versions over time
In different formats
From many mirrors/registries
Datasets build on each other
Files do not carry metadata
Registries
Can be out-of-date
Can contain conflicting information
25 September 2014 EUON - HCLS Dataset Description 5
Scientists require data provenance!
![Page 7: Describing Scientific Datasets: The HCLS Community Profile](https://reader036.fdocuments.us/reader036/viewer/2022081401/559ec9b31a28abb6338b45da/html5/thumbnails/7.jpg)
Dublin Core Metadata Initiative
Widely used
Broadly applicable
Documents
Datasets
✗Generic terms
✗Not comprehensive
✗No required properties
25 September 2014 EUON - HCLS Dataset Description 6
“Date: A point or period of
time associated with an
event in the lifecycle of
the resource.”
![Page 8: Describing Scientific Datasets: The HCLS Community Profile](https://reader036.fdocuments.us/reader036/viewer/2022081401/559ec9b31a28abb6338b45da/html5/thumbnails/8.jpg)
7EUON - HCLS Dataset Description
Metadata carried with data
Directly embedded: void:inDataset
✗No versioning
✗No checklist of requisite fields
✗Only for RDF data
VoID: Vocabulary of Interlinked Datasets
25 September 2014
![Page 9: Describing Scientific Datasets: The HCLS Community Profile](https://reader036.fdocuments.us/reader036/viewer/2022081401/559ec9b31a28abb6338b45da/html5/thumbnails/9.jpg)
DCAT: Data Catalog
Separates Dataset and Distribution
✗No versioning
✗No prescribed properties
25 September 2014 EUON - HCLS Dataset Description 8
![Page 10: Describing Scientific Datasets: The HCLS Community Profile](https://reader036.fdocuments.us/reader036/viewer/2022081401/559ec9b31a28abb6338b45da/html5/thumbnails/10.jpg)
W3C HCLS Group
25 September 2014 EUON - HCLS Dataset Description 9
![Page 11: Describing Scientific Datasets: The HCLS Community Profile](https://reader036.fdocuments.us/reader036/viewer/2022081401/559ec9b31a28abb6338b45da/html5/thumbnails/11.jpg)
HCLS Dataset Descriptions
25 September 2014 EUON - HCLS Dataset Description 10
![Page 12: Describing Scientific Datasets: The HCLS Community Profile](https://reader036.fdocuments.us/reader036/viewer/2022081401/559ec9b31a28abb6338b45da/html5/thumbnails/12.jpg)
VoID Editor
25 September 2014 EUON - HCLS Dataset Description 12
![Page 13: Describing Scientific Datasets: The HCLS Community Profile](https://reader036.fdocuments.us/reader036/viewer/2022081401/559ec9b31a28abb6338b45da/html5/thumbnails/13.jpg)
Validator
25 September 2014 EUON - HCLS Dataset Description 13
New version using ShEx in development
![Page 14: Describing Scientific Datasets: The HCLS Community Profile](https://reader036.fdocuments.us/reader036/viewer/2022081401/559ec9b31a28abb6338b45da/html5/thumbnails/14.jpg)
Future Vision
Provide rich and accurate provenance
trail of data
Write once, use many times
Automatic pipeline from description file to registries
FAIR Data
25 September 2014 EUON - HCLS Dataset Description 14
![Page 15: Describing Scientific Datasets: The HCLS Community Profile](https://reader036.fdocuments.us/reader036/viewer/2022081401/559ec9b31a28abb6338b45da/html5/thumbnails/15.jpg)
Thank you
Editors’ Draft:
http://tiny.cc/hcls-datadesc-ed
W3C Interest Group Note:
http://tiny.cc/hcls-datadesc
Acknowledgements to W3C HCLS Group
www.alasdairjggray.co.uk
@gray_alasdair
25 September 2014 EUON - HCLS Dataset Description 15