Validation of services, data and metadata
-
Upload
luis-bermudez -
Category
Technology
-
view
237 -
download
0
Transcript of Validation of services, data and metadata
![Page 1: Validation of services, data and metadata](https://reader035.fdocuments.us/reader035/viewer/2022062905/58720e0b1a28ab176b8b7f05/html5/thumbnails/1.jpg)
®
Validation of services, data and metadataLuis Bermudez (OGC)
ESIP Summer Meeting 2016Durham, NCJuly 21, 2016
![Page 2: Validation of services, data and metadata](https://reader035.fdocuments.us/reader035/viewer/2022062905/58720e0b1a28ab176b8b7f05/html5/thumbnails/2.jpg)
Composition of this talk
• Why validation• ESIP needs• OGC Compliance Program• The tool
2
![Page 3: Validation of services, data and metadata](https://reader035.fdocuments.us/reader035/viewer/2022062905/58720e0b1a28ab176b8b7f05/html5/thumbnails/3.jpg)
WHY validation?
3
![Page 4: Validation of services, data and metadata](https://reader035.fdocuments.us/reader035/viewer/2022062905/58720e0b1a28ab176b8b7f05/html5/thumbnails/4.jpg)
Maps
CoveragesVector
Time Series
Eureka! My model is perfect
![Page 5: Validation of services, data and metadata](https://reader035.fdocuments.us/reader035/viewer/2022062905/58720e0b1a28ab176b8b7f05/html5/thumbnails/5.jpg)
Server
Client
![Page 6: Validation of services, data and metadata](https://reader035.fdocuments.us/reader035/viewer/2022062905/58720e0b1a28ab176b8b7f05/html5/thumbnails/6.jpg)
Maps
CoveragesVector
Time Series
? ?
??
![Page 7: Validation of services, data and metadata](https://reader035.fdocuments.us/reader035/viewer/2022062905/58720e0b1a28ab176b8b7f05/html5/thumbnails/7.jpg)
Service Service
CatalogAre the
services correctly registered so that they can be found and use?
![Page 8: Validation of services, data and metadata](https://reader035.fdocuments.us/reader035/viewer/2022062905/58720e0b1a28ab176b8b7f05/html5/thumbnails/8.jpg)
OGC®
© 2016 Open Geospatial Consortium, Inc.
ESIP community has documented the need
8
![Page 9: Validation of services, data and metadata](https://reader035.fdocuments.us/reader035/viewer/2022062905/58720e0b1a28ab176b8b7f05/html5/thumbnails/9.jpg)
Discovery Grand Challenge
http://wiki.esipfed.org/index.php/Discovery_White_Paper#The_Grand_Challenge
![Page 10: Validation of services, data and metadata](https://reader035.fdocuments.us/reader035/viewer/2022062905/58720e0b1a28ab176b8b7f05/html5/thumbnails/10.jpg)
Need for validation
![Page 11: Validation of services, data and metadata](https://reader035.fdocuments.us/reader035/viewer/2022062905/58720e0b1a28ab176b8b7f05/html5/thumbnails/11.jpg)
OGC®
© 2016 Open Geospatial Consortium, Inc.
OGC compliance program
11
![Page 12: Validation of services, data and metadata](https://reader035.fdocuments.us/reader035/viewer/2022062905/58720e0b1a28ab176b8b7f05/html5/thumbnails/12.jpg)
Open Geospatial Consortium
534 volunteer organizations
6905 portal users
More than 60 standards
![Page 13: Validation of services, data and metadata](https://reader035.fdocuments.us/reader035/viewer/2022062905/58720e0b1a28ab176b8b7f05/html5/thumbnails/13.jpg)
![Page 14: Validation of services, data and metadata](https://reader035.fdocuments.us/reader035/viewer/2022062905/58720e0b1a28ab176b8b7f05/html5/thumbnails/14.jpg)
Conformance = fulfillment of specified requirements
http://www.sxc.hu/photo/149744
![Page 15: Validation of services, data and metadata](https://reader035.fdocuments.us/reader035/viewer/2022062905/58720e0b1a28ab176b8b7f05/html5/thumbnails/15.jpg)
Implementations can get OGC Certified
Currently851 implementations203 compliant products
![Page 16: Validation of services, data and metadata](https://reader035.fdocuments.us/reader035/viewer/2022062905/58720e0b1a28ab176b8b7f05/html5/thumbnails/16.jpg)
For Users: Proof that a solution works
(www.opengeospatial.org/ resource/products/compliant)
http://www.opengeospatial.org/resource/products/compliant
![Page 17: Validation of services, data and metadata](https://reader035.fdocuments.us/reader035/viewer/2022062905/58720e0b1a28ab176b8b7f05/html5/thumbnails/17.jpg)
For implementers: Get more business
![Page 18: Validation of services, data and metadata](https://reader035.fdocuments.us/reader035/viewer/2022062905/58720e0b1a28ab176b8b7f05/html5/thumbnails/18.jpg)
How does it work?
![Page 19: Validation of services, data and metadata](https://reader035.fdocuments.us/reader035/viewer/2022062905/58720e0b1a28ab176b8b7f05/html5/thumbnails/19.jpg)
OGC®
© 2016 Open Geospatial Consortium, Inc.19
Conformant = Compliant =
Super passing the test+
license
If not we can say Implement
![Page 20: Validation of services, data and metadata](https://reader035.fdocuments.us/reader035/viewer/2022062905/58720e0b1a28ab176b8b7f05/html5/thumbnails/20.jpg)
Available and Expected Tests 2016
Available Tests Version Projected in 2016 Version
Catalogue Service - Web (CSW) 2.0.2 Catalogue Service - Web (CSW) 3.0Geography Markup Language (GML) 3.2.1 GeoPackage 1.0OGC KML 2.2 KML 2.3Sensor Observation Service (SOS) 1.0.0 O&M 2.0Sensor Observation Service (SOS) 2.0 SensorML 1.0Sensor Planning Service (SPS) 1.0 SensorML 2.0Sensor Planning Service (SPS) 2.0 SensorThings API 1.0Simple Feature Access - SQL (SFS) 1.1 WFS (Basic) 1.1Simple Feature Access - SQL (SFS) 1.2.1 WMTS 1.0Web Coverage Service (WCS) 1.0.0 WPS 1.0Web Coverage Service (WCS) 1.1.1 DGIWG ProfilesWeb Coverage Service (WCS) 2.0.1Web Feature Service (WFS) 1.0.0Web Feature Service (WFS) 1.1.0Web Feature Service (WFS) 2.0Web Map Service (WMS) 1.1.1Web Map Service (WMS) 1.3.0WMS Client 1.3
![Page 21: Validation of services, data and metadata](https://reader035.fdocuments.us/reader035/viewer/2022062905/58720e0b1a28ab176b8b7f05/html5/thumbnails/21.jpg)
How to ask for compliance?
“ … Purchaser seeks geospatial products that provide maximum interoperability with purchaser’s and data sharing partner’s systems. To accomplish this, purchaser seeks to make maximum use of open standards provided by the Open Geospatial Consortium (OGC), ISO …”
OGC Compliance Overview - Guide for Software Acquisition White paper (15-002r5)
http://docs.opengeospatial.org/wp/15-002r5/15-002r5.html
![Page 22: Validation of services, data and metadata](https://reader035.fdocuments.us/reader035/viewer/2022062905/58720e0b1a28ab176b8b7f05/html5/thumbnails/22.jpg)
The Open Source Tool
![Page 23: Validation of services, data and metadata](https://reader035.fdocuments.us/reader035/viewer/2022062905/58720e0b1a28ab176b8b7f05/html5/thumbnails/23.jpg)
Tools, community and support
Code Contributors
Public Forum Support
Open SourceXSLT
Tools
Communities Collaboration
Giacomo MartiranoStefania Morrone
Enable testing of INPSIRE metadata profiles
Processing non-ASCII chars
GML CRS, and polygons definitions
![Page 24: Validation of services, data and metadata](https://reader035.fdocuments.us/reader035/viewer/2022062905/58720e0b1a28ab176b8b7f05/html5/thumbnails/24.jpg)
Anybody can run the test
![Page 25: Validation of services, data and metadata](https://reader035.fdocuments.us/reader035/viewer/2022062905/58720e0b1a28ab176b8b7f05/html5/thumbnails/25.jpg)
Tester selects test suite
Tester names session
Selection of Test
![Page 26: Validation of services, data and metadata](https://reader035.fdocuments.us/reader035/viewer/2022062905/58720e0b1a28ab176b8b7f05/html5/thumbnails/26.jpg)
Testing in ProgressTester provides end point of the service
Console provides feedback on test assertions
Tester Selects Options
![Page 27: Validation of services, data and metadata](https://reader035.fdocuments.us/reader035/viewer/2022062905/58720e0b1a28ab176b8b7f05/html5/thumbnails/27.jpg)
Summary of Results
![Page 28: Validation of services, data and metadata](https://reader035.fdocuments.us/reader035/viewer/2022062905/58720e0b1a28ab176b8b7f05/html5/thumbnails/28.jpg)
Types of Tests
• Encodings– SensorML, KML, GML, Metadata in XML, …
• Servers– CAT, WFS, WMS, WCS, SOS, …
• Clients– WMS 1.3
![Page 29: Validation of services, data and metadata](https://reader035.fdocuments.us/reader035/viewer/2022062905/58720e0b1a28ab176b8b7f05/html5/thumbnails/29.jpg)
Example in EuropeExample in Europe
Data validation for INSPIRE Themes
In collaboration with Epsilon ItaliaTEAM Engine and GML 3.2.1 test suit
Metadata and Services Validation for
Germany and INSPIRETEAM Engine and
CSW and WMS test suiteshttp://cloud.epsilon-italia.it/ http://testsuite.gdi-de.org/gdi/
![Page 30: Validation of services, data and metadata](https://reader035.fdocuments.us/reader035/viewer/2022062905/58720e0b1a28ab176b8b7f05/html5/thumbnails/30.jpg)
Community Support
![Page 31: Validation of services, data and metadata](https://reader035.fdocuments.us/reader035/viewer/2022062905/58720e0b1a28ab176b8b7f05/html5/thumbnails/31.jpg)
Metadata Validation
used in
CINERGI
(Community Inventory of EarthCube Resources for
Geosciences Interoperability)
![Page 32: Validation of services, data and metadata](https://reader035.fdocuments.us/reader035/viewer/2022062905/58720e0b1a28ab176b8b7f05/html5/thumbnails/32.jpg)
32
![Page 33: Validation of services, data and metadata](https://reader035.fdocuments.us/reader035/viewer/2022062905/58720e0b1a28ab176b8b7f05/html5/thumbnails/33.jpg)
Goals
• Large inventory of high quality information resources across disciplines, with traceable provenance, usable across EarthCube research scenarios
• Engaging geoscience community in creating and curating the inventory
• Enabling search and integration across domains, and facilitating navigation across information objects of different types (resources, people, software, etc..)
![Page 34: Validation of services, data and metadata](https://reader035.fdocuments.us/reader035/viewer/2022062905/58720e0b1a28ab176b8b7f05/html5/thumbnails/34.jpg)
34
![Page 35: Validation of services, data and metadata](https://reader035.fdocuments.us/reader035/viewer/2022062905/58720e0b1a28ab176b8b7f05/html5/thumbnails/35.jpg)
3 Levels Community Inventories Validation
1 – Schema2 – Rules not enforced by schema3 – Community rules
http://cite-dev-03.opengeospatial.org/teamengine/
![Page 36: Validation of services, data and metadata](https://reader035.fdocuments.us/reader035/viewer/2022062905/58720e0b1a28ab176b8b7f05/html5/thumbnails/36.jpg)
Level 1 - Schema
![Page 37: Validation of services, data and metadata](https://reader035.fdocuments.us/reader035/viewer/2022062905/58720e0b1a28ab176b8b7f05/html5/thumbnails/37.jpg)
Level 2 – Rules not enforceable via Schema
![Page 38: Validation of services, data and metadata](https://reader035.fdocuments.us/reader035/viewer/2022062905/58720e0b1a28ab176b8b7f05/html5/thumbnails/38.jpg)
Level 3 – Community Rules
![Page 39: Validation of services, data and metadata](https://reader035.fdocuments.us/reader035/viewer/2022062905/58720e0b1a28ab176b8b7f05/html5/thumbnails/39.jpg)
Results
![Page 40: Validation of services, data and metadata](https://reader035.fdocuments.us/reader035/viewer/2022062905/58720e0b1a28ab176b8b7f05/html5/thumbnails/40.jpg)
![Page 41: Validation of services, data and metadata](https://reader035.fdocuments.us/reader035/viewer/2022062905/58720e0b1a28ab176b8b7f05/html5/thumbnails/41.jpg)
Example files for metadata validation
Go to the validation web site:http://cite-dev-03.opengeospatial.org/teamengine/
Provide an XML instancehttp://cinergi.sdsc.edu/getmetadata/F3ACDE93-F0E3-4F7E-AD26-F2B87DD4DB4B.xml
And if needed provide a schematronhttp://cite-dev-03.opengeospatial.org/teamengine/geo-extend-iso.sch
41
![Page 42: Validation of services, data and metadata](https://reader035.fdocuments.us/reader035/viewer/2022062905/58720e0b1a28ab176b8b7f05/html5/thumbnails/42.jpg)
GML ValidationCommon Database on Designated Areas
1.4 GB100,181 FeaturesCDDA application schemaINSPIRE Protected Sites schema
XML Schema ValidationAbout 1 min to test against Schema with 1 GB Java heap size
Test data provided by
Epsilon Italia
![Page 43: Validation of services, data and metadata](https://reader035.fdocuments.us/reader035/viewer/2022062905/58720e0b1a28ab176b8b7f05/html5/thumbnails/43.jpg)
OGC®
© 2016 Open Geospatial Consortium, Inc.
Catalog (CAT 3.0) Validation
43
• https://www.youtube.com/watch?v=dWf0X6naiRU
![Page 44: Validation of services, data and metadata](https://reader035.fdocuments.us/reader035/viewer/2022062905/58720e0b1a28ab176b8b7f05/html5/thumbnails/44.jpg)
CAT 3.0 Blog
http://www.opengeospatial.org/blog/2448
link
http://demo.pycsw.org/cite/csw?mode=opensearch&service=CSW&version=3.0.0&request=GetRecords&elementsetname=full&typenames=csw:Record&resulttype=results&
q=Greece
![Page 45: Validation of services, data and metadata](https://reader035.fdocuments.us/reader035/viewer/2022062905/58720e0b1a28ab176b8b7f05/html5/thumbnails/45.jpg)
Help and questions when testingHelp and questions when testing
Community support with about
About 300 members
![Page 46: Validation of services, data and metadata](https://reader035.fdocuments.us/reader035/viewer/2022062905/58720e0b1a28ab176b8b7f05/html5/thumbnails/46.jpg)
Thank you
Luis [email protected]
@berdezhttps://www.linkedin.com/in/bermudez
Presentation at: http://bit.ly/2a1Ttm5