SeaDataNet - EMODnet - building a pan-European infrastructure for marine and

ocean data and data products

+

Importance of standards

By

Dick M.A. Schaap – MARIS

Technical Coordinator SeaDataNet & ODIP

Coordinator EMODnet Bathymetry

Bergen – Norway, 5th October 2016,

INMARTECH 2016 Symposium

EU cost – benefit analysis: cost of marine observation in Europe is circa 400 Million Euro per year for space data and another 1 Billion Euro per year for in-situ data

Marine data acquisition

EU – MASTEU – MASTII

EU-FP5

EU-FP6

EU-FP7

EU-HORIZON 2020

A pan-European infrastructure has been set up and is operated for managing marine and ocean data in a cooperation of National Oceanographic Data Centres (NODCs) and oceanographic data focal points from 35 countries bordering European seas

90sEDMED,MedAtlas,Euronodim,EDIOS2002-2005Sea-Search2006-2011SeaDataNet2011-2015SeaDataNet II2016-2020SeaDataCloud

Portal with standards, tools, and services, both for users and data centres

http://www.seadatanet.org

Standards are instrumental

Set of common standards for the marine domain, adapting ISO and OGC standards and achieving INSPIRE compliance

Adoption of ISO 19115 – 19139 standard for describing metadata on data sets, research cruises, monitoring networks, and research projects => marine metadata profiles, schema’s, schematron rules

Controlled vocabularies for the marine domain (> 65.000 terms and > 80 lists), with international governance and web services

Standard data exchange formats: ODV ASCII and NetCDF (CF) fully supported by controlled vocabularies

Maintenance and dissemination of standard QA-QC procedures, together with IODE and ICES

Services and tools

Set of tools to be used by each data centre and freely available from the SeaDataNet portal: metadata editor, data conversion software, download manager, data analysis software, data interpolation software

Capacity building by training workshops for uptake of standards and tools by the data centres in order to achieve standardisation

Pan-European services for harmonised discovery, access, visualisation of data and data products

Common SeaDataNet Data Policy and SeaDataNet License

Pan-European Directory services

CDI service for discovery and unified access of data

Strategic cooperation for adoption and positioning of the infrastructure

EuroGOOS: quality control and archiving long-term data series; EDIOS directory

Copernicus Marine Environmental Monitoring Service (CMEMS): provision of long-term archives for optimising marine forecast services; MoU’s with MyOcean 1 * 2 and CMEMS

IOC-IODE (UNESCO): supporting development of the Ocean Data Portal (ODP) facilitating exchange of marine data and services on a global scale and through a federated and interoperable network of national and regional data systems such as SeaDataNet for Europe.

GEOSS: contributing to the Global Earth Observation System of Systems (GEOSS) for sharing data in multiple environmental domains

Research Data Alliance (RDA): contributing to several interest and working groups

Ocean Data Interoperability Platform (ODIP - ODIP II)

European-USA-Australia collaborative project

Funded in parallel by:

European Commission

National Science Foundation (NSF)

Australian Government

Promoting the development of a common global framework for marine data management by developing interoperability between existing regional e-infrastructures of Europe, USA and Australia and towards global infrastructures such as GEOSS, IOC-IODE and POGO.

In practice by organising international workshops with leading experts to present, compare and discuss approaches and standards applied.

And by developing prototypes for interoperability solutions or common standards to overcome identified differences. Prototypes projects are worked out in order to evaluate and test solutions.

Ocean Data Interoperability Platform (ODIP - ODIP II ) – Prototype projects

Cooperation for populating and wider deployment of the infrastructure

Adoption of SeaDataNet standards and services, including adaption in a range of EU projects for DG Research and DG Entreprise and Industry:

Adoption of SeaDataNet standards and services, including adaption for the EU DG MARE initiative for an overarching European Marine Observation and Data network (EMODnet):

European Marine Observation and Data Network

EU communication “MARINE KNOWLEDGE 2020 - marine data and observation for smart and sustainable growth” promotes ‘capture once – use many times’

The EU Blue Growth communication considers ocean and marine data as important input for driving scientific and economic developments

Initiative by EU DG MARE

for EMODnet:

Focus on generic European marine data products for different domains: bathymetry, geology, biology, chemistry, physics, seabed habitats, coastal mapping, and human activities

Use of standards is of vital importance

SeaDataNet as partner in developing and building: European Marine Observation and Data Network

Resulting in uptake of SeaDataNet standards and expansion of the infrastructure of data centres giving data overview and access

(6 MEuro)

(16 MEuro)

(100 – 200 MEuro)

Sea

> 500 European data

originators

NODCs; HOs; GEOs; BIOs; ICES; PANGAEA

> 100 data centres

Data discovery

And access

GEOSS portal IODE ODP portal

CDI Data Discovery

and Access service

Total collection

Black Sea portal Caspian portal Geo-Seas portal

Bathymetry

Physics

Chemistry

Geology

Biology

Aggregated collection

Regional subsets

Thematic subsets

Thematic subsets

Thematic subsets

Thematic subsets

Thematic subsets

Thematic subsets

SeaDataNet as driver

and contributing to many

portals

Increase in time sept 2012 – August 2016

SeaDataNet Pan-European directory services

CDI service for discovery and unified access of data

CDI Data Discovery & Access service

Coverage Sept 2016: > 1,86 million CDI entries from 102data centres in 34 countries and 593 originators for physics, chemistry, geology, geophysics, bathymetry and biology; years 1805 – 2016; 85,7% unrestricted or under SeaDataNet licence

CDI Data Discovery & Access service

September 2016: 102 data centres connected

Example: EMODnet Bathymetry

Ongoing in 3 consecutive projects since 2009 with expanding consortium (at present >30 partners)

Consortium consisting of bathymetric and IT experts and data providers from National Hydrography Services, marine research institutes and SME’s, and GEBCO

Overall objective: to bring together bathymetric surveys of European seas and to produce, publish and serve a harmonised and medium resolution Digital Terrain Model of all European seas

Process flow and services

Adoption ofSeaDataNet standards and services

Common method and software (Globe) used by all data providers and regional sea coordinators

Use of GLOBE software

Norwegian and Icelandic seas – Arctic – example

Data gathering results

Up till today, 14791 survey CDI metadata records from 27 data centres and 166 data originators from 1816 to 2016 have been collated and imported into the dedicated EMODnet Bathymetry CDI data discovery and access service.

The SeaDataNet Data Products Catalogue service (Sextant) gives 78metadata records about composite DTMs that have been used next to survey data sets

DTM generation results

The gathered survey data and composite DTMs have been collated into regional EMODnet DTM’s by regional working groups in a number of releases

The regional DTMs have been integrated into the EMODnet DTM.

The harmonized EMODnet DTM is made available for interactions and viewing as well as for downloading in 16 tiles in several formats via the Bathymetry Products portal service.

The dedicated EMODnet Bathymetry Products portal has been launched in May 2010. It sits atop of the central DTM database and interacts with the CDI service and Sextant service and provides OGC WMS services. Over time more functionality has been added.

Central portal for discovery and access to data and data products

http://www.emodnet-bathymetry.eu

Bathymetry Viewing and Download service with EMODnet DTM

http://www.emodnet-bathymetry.eu

DTM for European sea basins

CDI layer of survey data

CDI layer of survey data with metadata retrieval

Source references layer to survey data (CDI), composite DTM (Sextant) or GEBCO

Download DTM tiles in various formats

Bathymetric DTM – 3D-Viewer

DTM loaded into 3D-Viewer

Comparison with GEBCO

GEBCO – General Bathymetric Chart of the Oceans (IHO – IOC) and EMODnet Bathymetry DTM – example in Tyrrhenian Sea near Sicily – Italy and South Italy – resolution EMODnet is 16 times higher

SeaDataCloud – new opportunity

Standards are always evolving and the SeaDataNet network must stay up-to-date to maintain and further expand its services to its lead customers and major stakeholders:

the European and international ocean and marine research community

Copernicus Marine Environmental Monitoring Service (CMEMS)

the European Marine Observation and Data network (EMODnet) portals by which SeaDataNet services and output are used for serving stakeholders in the Marine Strategy Framework Directive (MSFD) and actors in the marine and maritime economy

large marine observing networks (EuroGOOS, AtlantOS, Euro-ARGO, EMSO, JERICO-Next, and others).

The EU has just accepted the new SeaDataCloud proposal (10 Meuro) in the framework of the EU HORIZON 2020 programme for further developing the SeaDataNet infrastructure and associated standards in the coming 4 years.

SeaDataCloud – selection of planned activities

Improve services to users and data providers :

Utilise the benefits of a cloud environment with high performance computing to improve the performance of the CDI data access services;

Develop online services to visualise and process data, in order to preview, subset, format, or analyse data of interest;

Develop a Virtual Research Environment (VRE) to facilitate collaborative and individual research by users

Optimise connecting data centres and data streams to the infrastructure:

Ease connecting data centres to the SeaDataNet infrastructure by revising and upgrading the existing components;

Facilitate connecting and ingesting data streams from operational observation networks by making use of OGC Sensor Web Enablement (SWE) standards, tuning and in collaboration with already ongoing projects such as ODIP Prototype 3

Improve interoperability with other European and International networks

www.emodnet.eu

www.seadatanet.org

www.odip.org