SDN Annual Meeting 20090326 Distributed data management in The Netherlands Taco de Bruin NIOZ Royal...

17
SDN Annual Meeting 20090326 Distributed data management in The Netherlands Taco de Bruin NIOZ Royal Netherlands Institute for Sea Research Chair - National Oceanographic Data Committee (NODC)

Transcript of SDN Annual Meeting 20090326 Distributed data management in The Netherlands Taco de Bruin NIOZ Royal...

Page 1: SDN Annual Meeting 20090326 Distributed data management in The Netherlands Taco de Bruin NIOZ Royal Netherlands Institute for Sea Research Chair - National.

SDN Annual Meeting 20090326

Distributed data management in The Netherlands

Taco de Bruin

NIOZ Royal Netherlands Institute for Sea Research

Chair - National Oceanographic Data Committee (NODC)

Page 2: SDN Annual Meeting 20090326 Distributed data management in The Netherlands Taco de Bruin NIOZ Royal Netherlands Institute for Sea Research Chair - National.

National Oceanographic Data Committee (NODC)

• Committee – no centre

• Based on Memorandum of Understanding (MoU) (1997-)

• Fully distributed structure

Currently 8 Partners:

- Rijkswaterstaat Water Dienst (RWS-WD)

- Royal Netherlands Institute for Sea Research (NIOZ) (Academic community)

- TNO – Bouw en Ondergrond (TNO – B & O)

- Hydrographic Service (KM-HYD)

- Rijkswaterstaat Data en Informatie Dienst (RWS-DID)

- Centre for Estuarine and Marine Ecology (NIOO-CEME)

- Imares

- Deltares

1997-2008: Royal Netherlands Meteorological Institute (KNMI)

- Advisor: Marine Information Services (MARIS)SDN Annual Meeting 20090326

Page 3: SDN Annual Meeting 20090326 Distributed data management in The Netherlands Taco de Bruin NIOZ Royal Netherlands Institute for Sea Research Chair - National.

National Oceanographic Data Committee (NODC)

• Very interesting mix of government agencies (3), research institutes (2)

and privatized, former government agencies (3)

• Government agencies have specific tasks, limited to territory and EEZ of the Kingdom of The Netherlands, Netherlands Antilles and Aruba.

• Other NODC Partners may operate all over the world

• Data from all disciplines: Coastal research, bathymetry, geology, biology, ecology, physical oceanography, marine meteorology, etc, etc.

• Many different data types

SDN Annual Meeting 20090326

Page 4: SDN Annual Meeting 20090326 Distributed data management in The Netherlands Taco de Bruin NIOZ Royal Netherlands Institute for Sea Research Chair - National.

The NL-NODC is the national platform for oceano-graphic data management

• Objectives:

1) to further data management and the delivery of quality data to a broad user group

2) to lower thresholds and barriers (organisational, technical, financial)

for data exchange

• National Data Policy

• Participation in international initiatives (IODE, ICES, EU-projects like Sea-Search, SeaDataNet, EMODNET projects, etc.)

Page 5: SDN Annual Meeting 20090326 Distributed data management in The Netherlands Taco de Bruin NIOZ Royal Netherlands Institute for Sea Research Chair - National.

Situation of data exchange within NL-NODC a couple of years ago:

Online accessibility and availability of data

• Waterbase (RIKZ)• CODIS (NIOZ)• KODAC (KNMI)• Watermarkt (RIKZ + many other partner institutes)• HYDRA (KNMI)• COREBASE (NIOZ)• DINO (TNO- B&O)• Getij.nl (RIKZ)• Waterstat.nl (RIKZ)• many more …..

- user had no overview of data availability

- user had to do all format conversions and syntheses

SDN Annual Meeting 20090326

Page 6: SDN Annual Meeting 20090326 Distributed data management in The Netherlands Taco de Bruin NIOZ Royal Netherlands Institute for Sea Research Chair - National.

NODC: Organisational structure for data exchange:

• MoU

• Data Policy

No technical infrastructure for data exchange:

• Different RDBMS

• Different formats

• Some databases online, others are not

SDN Annual Meeting 20090326

Page 7: SDN Annual Meeting 20090326 Distributed data management in The Netherlands Taco de Bruin NIOZ Royal Netherlands Institute for Sea Research Chair - National.

National infrastructure for access to oceanographic and marine data and information:

NODC-i

Objectives of the project:

• central index of all data in the partner databases

• transparent access via Internet to the partner databases (fully distributed system)

Project:

• February 2005 – December 2008 ( 2 phases)

• 1 M Euro (500k from Bsik – Ruimte voor Geo-Informatie (RGI))

        

SDN Annual Meeting 20090326

Page 8: SDN Annual Meeting 20090326 Distributed data management in The Netherlands Taco de Bruin NIOZ Royal Netherlands Institute for Sea Research Chair - National.

SeaDataNet to the rescue:

SeaDataNet is developing techniques, standards and formats,

which can be applied within NODC-i and vice versa

SeaDataNet ensures a high level of standardization

SeaDataNet is implementing on an European level, what NODC-i has implemented on a national level

NL-NODC is an ideal test bed for SeaDataNet

SDN Annual Meeting 20090326

Page 9: SDN Annual Meeting 20090326 Distributed data management in The Netherlands Taco de Bruin NIOZ Royal Netherlands Institute for Sea Research Chair - National.

SDN Annual Meeting 20090326

Go to http://www.nodc.nl Link: Data access

Page 10: SDN Annual Meeting 20090326 Distributed data management in The Netherlands Taco de Bruin NIOZ Royal Netherlands Institute for Sea Research Chair - National.

SDN Annual Meeting 20090326

Go to http://www.nodc.nl Link: Data access

Page 11: SDN Annual Meeting 20090326 Distributed data management in The Netherlands Taco de Bruin NIOZ Royal Netherlands Institute for Sea Research Chair - National.

SDN Annual Meeting 20090326

Go to http://www.nodc.nl Link: Data access

Page 12: SDN Annual Meeting 20090326 Distributed data management in The Netherlands Taco de Bruin NIOZ Royal Netherlands Institute for Sea Research Chair - National.

SDN Annual Meeting 20090326

Go to http://www.nodc.nl Link: Data access

Page 13: SDN Annual Meeting 20090326 Distributed data management in The Netherlands Taco de Bruin NIOZ Royal Netherlands Institute for Sea Research Chair - National.

SDN Annual Meeting 20090326

Go to http://www.nodc.nl Link: Data access

Page 14: SDN Annual Meeting 20090326 Distributed data management in The Netherlands Taco de Bruin NIOZ Royal Netherlands Institute for Sea Research Chair - National.

SDN Annual Meeting 20090326

Go to http://www.nodc.nl Link: Data access

Page 15: SDN Annual Meeting 20090326 Distributed data management in The Netherlands Taco de Bruin NIOZ Royal Netherlands Institute for Sea Research Chair - National.

SDN Annual Meeting 20090326

Go to http://www.nodc.nl Link: Data access

Page 16: SDN Annual Meeting 20090326 Distributed data management in The Netherlands Taco de Bruin NIOZ Royal Netherlands Institute for Sea Research Chair - National.

SDN Annual Meeting 20090326

NL-NODC

The NODC web site is the Dutch node in the SeaDataNet network, linking the Dutch partner databases directly to the SeaDataNet infrastructure

Page 17: SDN Annual Meeting 20090326 Distributed data management in The Netherlands Taco de Bruin NIOZ Royal Netherlands Institute for Sea Research Chair - National.

SDN Annual Meeting 20090326

Renewed Memorandum of Understanding will be signed by the directors of the 8 partner institutes on April 9, 2009.

- New definitions of objectives and tasks, reflecting current situation and lessons learnt

- Updated data policy

- Sustained maintenance of the SeaDataNet infrastructure in The Netherlands