THE EUROPEAN ENVIRONMENT STATE AND OUTLOOK 2010 Thomas Henrichs European Environment Agency.
Data management and production at the European Environment … · 2020-06-10 · Data management...
Transcript of Data management and production at the European Environment … · 2020-06-10 · Data management...
![Page 1: Data management and production at the European Environment … · 2020-06-10 · Data management and production at the European Environment Agency An overview. The European Environment](https://reader034.fdocuments.us/reader034/viewer/2022050108/5f4626a3cac397613473ad46/html5/thumbnails/1.jpg)
Jose Miguel RUBIO IGLESIAS| 09/06/2020 | INSPIRE Webinar: Pan-European datasets management, visualisation and dissemination
Data management and production at the European Environment Agency
An overview
![Page 2: Data management and production at the European Environment … · 2020-06-10 · Data management and production at the European Environment Agency An overview. The European Environment](https://reader034.fdocuments.us/reader034/viewer/2022050108/5f4626a3cac397613473ad46/html5/thumbnails/2.jpg)
The European Environment Agency and Eionet at glance
What?
• The provision of reliable, relevant, targeted and timely information to policy-making agents and the public.
Why?
• To help achieve significant and measurable improvements in Europe’s environment and to support sustainable development.
How?
• EEA/Eionet partnership (25 years!)
• 38 (32 + 6) countries, 400 institutions, 1000 experts
![Page 3: Data management and production at the European Environment … · 2020-06-10 · Data management and production at the European Environment Agency An overview. The European Environment](https://reader034.fdocuments.us/reader034/viewer/2022050108/5f4626a3cac397613473ad46/html5/thumbnails/3.jpg)
Geospatial information and EO at the backbone of our work
EEA MDIAK added-value chain
![Page 4: Data management and production at the European Environment … · 2020-06-10 · Data management and production at the European Environment Agency An overview. The European Environment](https://reader034.fdocuments.us/reader034/viewer/2022050108/5f4626a3cac397613473ad46/html5/thumbnails/4.jpg)
The role of EEA-Eionet in the reporting process
EEA data flows in 2019Total data flows EEA officially manages : 112
DG ENV 10-steps guidance (2018)
![Page 5: Data management and production at the European Environment … · 2020-06-10 · Data management and production at the European Environment Agency An overview. The European Environment](https://reader034.fdocuments.us/reader034/viewer/2022050108/5f4626a3cac397613473ad46/html5/thumbnails/5.jpg)
Main steps in the creation of pan-European datasets
Countries deliveries European datasets
Regular production ofMore than 120 pan-European datasets
32 countries deliveries in many formats
XML, SHP, GML, KML, CSV, Access, SHP, etc...
Data download, web sites,
applications, dashboards
European products
![Page 6: Data management and production at the European Environment … · 2020-06-10 · Data management and production at the European Environment Agency An overview. The European Environment](https://reader034.fdocuments.us/reader034/viewer/2022050108/5f4626a3cac397613473ad46/html5/thumbnails/6.jpg)
Main steps in the creation of pan-European datasets
Countries deliveries European datasets
Regular production ofMore than 120 pan-European datasets
32 countries deliveries in many formats
XML, SHP, GML, KML, CSV, Access, SHP, etc...
Data download, web sites,
applications, dashboards
European products
• Different demands, formats, deadlines
• Many actors involved• Organically growing• Different technical
solutions applied• ...
![Page 7: Data management and production at the European Environment … · 2020-06-10 · Data management and production at the European Environment Agency An overview. The European Environment](https://reader034.fdocuments.us/reader034/viewer/2022050108/5f4626a3cac397613473ad46/html5/thumbnails/7.jpg)
Data acquisition and processing
Reportnet
• Reporting obligations (ROD)
• Data dictionary (DD) = Data definitions• XML Schema definitions• Quality control (XQUERY)
• Envelope per Country (CDR)• Excel, XML File = Tabular
data• Shape, GML = Spatial data
A reporting system with 20 years of experience
![Page 8: Data management and production at the European Environment … · 2020-06-10 · Data management and production at the European Environment Agency An overview. The European Environment](https://reader034.fdocuments.us/reader034/viewer/2022050108/5f4626a3cac397613473ad46/html5/thumbnails/8.jpg)
Data acquisition and processing
Reportnet
• Reporting obligations (ROD)
• Data dictionary (DD) = Data definitions• XML Schema definitions• Quality control (XQUERY)
• Envelope per Country (CDR)• Excel, XML File = Tabular
data• Shape, GML = Spatial data
A reporting system with 20 years of experience
Highly automatised using ETL tools!
![Page 9: Data management and production at the European Environment … · 2020-06-10 · Data management and production at the European Environment Agency An overview. The European Environment](https://reader034.fdocuments.us/reader034/viewer/2022050108/5f4626a3cac397613473ad46/html5/thumbnails/9.jpg)
Data processing and analysis – Dashboards and other tools for collaboration
Online dashboards for statistics on
submissions and processing Online solutions to create web services
and map viewers
Joint Environmental Data Infrastructure
![Page 10: Data management and production at the European Environment … · 2020-06-10 · Data management and production at the European Environment Agency An overview. The European Environment](https://reader034.fdocuments.us/reader034/viewer/2022050108/5f4626a3cac397613473ad46/html5/thumbnails/10.jpg)
Data processing and analysis – Dashboards and other tools for collaboration
Online solutions to create web services
and map viewers
Joint Environmental Data Infrastructure
![Page 11: Data management and production at the European Environment … · 2020-06-10 · Data management and production at the European Environment Agency An overview. The European Environment](https://reader034.fdocuments.us/reader034/viewer/2022050108/5f4626a3cac397613473ad46/html5/thumbnails/11.jpg)
Next generation of Reportnet: Reportnet 3.0
![Page 12: Data management and production at the European Environment … · 2020-06-10 · Data management and production at the European Environment Agency An overview. The European Environment](https://reader034.fdocuments.us/reader034/viewer/2022050108/5f4626a3cac397613473ad46/html5/thumbnails/12.jpg)
Next generation of Reportnet: Reportnet 3.0
![Page 13: Data management and production at the European Environment … · 2020-06-10 · Data management and production at the European Environment Agency An overview. The European Environment](https://reader034.fdocuments.us/reader034/viewer/2022050108/5f4626a3cac397613473ad46/html5/thumbnails/13.jpg)
Data dissemination - Different channels, one open data policy
EEA website Data visualisation,
interactive products and bulk download
https://eea.europa.eu/data-and-maps Discomap services
Web Map Serviceshttps://discomap.eea.europa.eu
DiscodataData service (SQL REST
endpoint)https://discodata.eea.europa.eu
Semantic Data Service(Sparql endpoint)
https://semantic.eea.europa.eu
![Page 14: Data management and production at the European Environment … · 2020-06-10 · Data management and production at the European Environment Agency An overview. The European Environment](https://reader034.fdocuments.us/reader034/viewer/2022050108/5f4626a3cac397613473ad46/html5/thumbnails/14.jpg)
Data dissemination – Discovery service (”SDI”)
• Inspire-compliant discovery service (metadata catalogue – TG 2.0!)
• Stores reference versions of pan-European spatial datasets used in EEA products
• Based on GeoNetwork (3.10.x)
• More than 1400 pan-European datasets!
• Pan European datasets created from data flows
• Historical and latest versions, public and restricted
• Copernicus Land Service metadata
• Link to discomap services + EEA website
• Endpoint exposed to GEOSS, Copernicus, etc. https://sdi.eea.europa.eu
![Page 15: Data management and production at the European Environment … · 2020-06-10 · Data management and production at the European Environment Agency An overview. The European Environment](https://reader034.fdocuments.us/reader034/viewer/2022050108/5f4626a3cac397613473ad46/html5/thumbnails/15.jpg)
Data dissemination – (Some) Thematic information platforms
Noise
Climate Adaptation
Marine environment
Urban Waste-Water
Biodiversity
Air Quality
![Page 16: Data management and production at the European Environment … · 2020-06-10 · Data management and production at the European Environment Agency An overview. The European Environment](https://reader034.fdocuments.us/reader034/viewer/2022050108/5f4626a3cac397613473ad46/html5/thumbnails/16.jpg)
Data dissemination – (Some) Thematic information platforms
Noise
Climate Adaptation
Marine environment
Urban Waste-Water
Biodiversity
Air Quality
![Page 17: Data management and production at the European Environment … · 2020-06-10 · Data management and production at the European Environment Agency An overview. The European Environment](https://reader034.fdocuments.us/reader034/viewer/2022050108/5f4626a3cac397613473ad46/html5/thumbnails/17.jpg)
Data dissemination – (Some) Thematic information platforms
Noise
Climate Adaptation
Marine environment
Air quality and COVID-19 viewer Climate Change impacts story map