Www.orfeus-eu.org Reinoud Sleeman ORFEUS Data Center Royal Netherlands Meteorological Insitute...

22
www.orfeus-eu.org www.neries-eu.org Reinoud Sleeman ORFEUS Data Center Royal Netherlands Meteorological Insitute (KNMI) sleeman @ knmi.nl IRIS - ORFEUS Workshop “Managing Waveform Data and Related Metadata for Seismic Networks”, Helwan, Cairo, Egypt 8 – 17 November 2009 Seismological Data Exchange in Europe

Transcript of Www.orfeus-eu.org Reinoud Sleeman ORFEUS Data Center Royal Netherlands Meteorological Insitute...

Page 1: Www.orfeus-eu.org  Reinoud Sleeman ORFEUS Data Center Royal Netherlands Meteorological Insitute (KNMI) sleeman @ knmi.nl IRIS - ORFEUS.

www.orfeus-eu.org www.neries-eu.org

Reinoud SleemanORFEUS Data CenterRoyal Netherlands Meteorological Insitute (KNMI)sleeman @ knmi.nl

IRIS - ORFEUS Workshop “Managing Waveform Data and Related Metadata for Seismic Networks”,

Helwan, Cairo, Egypt 8 – 17 November 2009

Seismological Data Exchange in Europe

Page 2: Www.orfeus-eu.org  Reinoud Sleeman ORFEUS Data Center Royal Netherlands Meteorological Insitute (KNMI) sleeman @ knmi.nl IRIS - ORFEUS.

Observatory and Research Facilities for European Seismology

seismological

observatory

International coordination

User

Central expertise (ODC):• efficient way for archiving and user access• different communication protocols• uniform QC / metadata• uniform data format• observatories coordination• international coordination • uniform data services• long-term archiving

seismological

observatory

seismological

observatory

Local expertise:• operations• site/equipment• acquisition• communication• QC• metadata• analysis

regional service organization

local experts organizations

Page 3: Www.orfeus-eu.org  Reinoud Sleeman ORFEUS Data Center Royal Netherlands Meteorological Insitute (KNMI) sleeman @ knmi.nl IRIS - ORFEUS.

Observatory and Research Facilities for European Seismology

seismological

observatory

International coordination

User

Central expertise (ODC):• efficient way for archiving and user access• different communication protocols• uniform QC / metadata• uniform data format• observatories coordination• international coordination • uniform data services• long-term archiving

seismological

observatory

seismological

observatory

IRIS DMC GEOFON INGV

Coordination, standardization and development on European and global scale (FDSN):

• formats (SEED, QuakeML)• interconnected data archive exchange protocols (ArcLink; EIDA; QuakeML)• services for distributed, interconnected data archives (Portal; websevices)

GEOSCOPE

Local expertise:• operations• site/equipment• acquisition• communication• QC• metadata• analysis

. . .

Page 4: Www.orfeus-eu.org  Reinoud Sleeman ORFEUS Data Center Royal Netherlands Meteorological Insitute (KNMI) sleeman @ knmi.nl IRIS - ORFEUS.

Observatory and Research Facilities for European Seismology

Antelope 4.11

Antelope 4.x

Antelope 4.x

SeedLink

SeedLink

SeedLink

SCREAM

CD1.0CD1.1

InterNAQS

EarthWorm

Data Storage(MySQL, GDI)

mini-SEED day-files1 – 100 sps; BB

Quality Control(Events, PQLX, PSD,manual processing, user feedback)

SeedLink

Antelope 4.x

Data access

services

ODC structure

Page 5: Www.orfeus-eu.org  Reinoud Sleeman ORFEUS Data Center Royal Netherlands Meteorological Insitute (KNMI) sleeman @ knmi.nl IRIS - ORFEUS.

Observatory and Research Facilities for European Seismology

RT acquisition

• Antelope 4.11

• SeedLink

• SCREAM

• CD1.x

• InterNAQS

• metadata (dataless SEED)

BB data; 1 – 100 sps

• Linux RHE 5.1

• Solaris 10

• Windows NT

Processing and QC

• Antelope 4.11

• PSD vs. Time

• PQLX

• histograms

• manual QC

• polarization analysis

• SC3 (test)

• data completeness

Storage

• Antelope 4.11

• SCREAM

• mini-SEED day-files

• MySQL

• GDI

Services

• direct access (ftp)

• Wilber II

• OWI

• NetDC

• Breq_fast

• AutoDRM

• QuakeExplorer

• ArcLink

• Webservices

• Portal

• Linux RHE 5.1

• Solaris 10

• SAN 8 TB (“dynamic”)

• RAID

• tape robot

• Linux RHE 5.1

ODC structure

Page 6: Www.orfeus-eu.org  Reinoud Sleeman ORFEUS Data Center Royal Netherlands Meteorological Insitute (KNMI) sleeman @ knmi.nl IRIS - ORFEUS.

Observatories and Research Facilities for European Seismology

NERIES

www.neries-eu.org

Network of Research Infrastructures for European Seismology

Addressing a European infrastructure challenge: archival and availibility of seismological data gathered by observatories and research facilities in Europe and its surroundings.

NERIES is an Integrated Infrastructure Initiative (I3) project in the Sixth Framework Program (FP6) of the European Commission (EC), aiming at networking the European seismic networks, improving access to data, allowing access to specific seismic infrastructures and pursuing targeted research developing the next generation of tools for improved service and data analysis.

The NERIES consortium consists of 25 participants (European universities and research centres) executing 18 different activities: 9 Networking Activities (NA), 5 Joint Research Activities (JRA), and 5 activities concerning Transnational Access (TA).

The core of the NERIES project organization lies with the Observatories and Research Facilities for European Seismology (ORFEUS) and the European Mediterranean Seismological Centre (EMSC). Both organizations are working under the auspices of the European Seismological Commission (ESC). The NERIES Project Office is situated at the Royal Netherlands Meteorological Institute (KNMI).

Duration: 1 June 2006 – 31 May 2010

Page 7: Www.orfeus-eu.org  Reinoud Sleeman ORFEUS Data Center Royal Netherlands Meteorological Insitute (KNMI) sleeman @ knmi.nl IRIS - ORFEUS.

Observatories and Research Facilities for European Seismology

Infrastructure Networking• Real-time data exchange (ORFEUS/Dost)• Distributed European waveform data archive (GFZ/Hanka)• Distributed European historical data archive (INGV/Stucchi)• Access to European accelerometer data (ICC/Roca)• Broadband OBS networking (IPGP/Singh)• Portal and data services (EMSC/Bossu)• Technology Transfer (workshops, grants) (KNMI/van Eck)

Infrastructure Research• European seismological reference model (INGV/Morelli)• Real-time hazard tools (ETHZ/Wiemer)• Shake-maps and rapid loss estimation (Kandilli/Erdik)• Geotechnical site characterization (LGIT/Bard)• New approaches to data mining (UnLiverpool/Rietbrock)

Infrastructure Access (grants)• Dense broadband network seismology SDSN/ETHZ (Christofferson)• Verification seismology CEA/DASE (Guilbert)• Historical seismograms SISMOS (INGV/Ferrari)• Array seismology NORSAR (Schweitzer)• Instrumentation test facility CONRAD (ZAMG/Lenhardt)

NERIES Activities

Page 8: Www.orfeus-eu.org  Reinoud Sleeman ORFEUS Data Center Royal Netherlands Meteorological Insitute (KNMI) sleeman @ knmi.nl IRIS - ORFEUS.

Observatories and Research Facilities for European Seismology

2002

One of the primary data sources of the ODC is the Virtual European Broadband Seismograph Network (VEBSN). The VEBSN is a joint effort of European-Mediterranean seismological observatories in creating and maintaining a sustainable pool of broadband seismograph stations, the data of which is shared in (near) real-time to the ODC. This joint effort is coordinated within ORFEUS.

VEBSN – Virtual European Broadband Seismograph Network

Page 9: Www.orfeus-eu.org  Reinoud Sleeman ORFEUS Data Center Royal Netherlands Meteorological Insitute (KNMI) sleeman @ knmi.nl IRIS - ORFEUS.

Observatories and Research Facilities for European Seismology

2003

Page 10: Www.orfeus-eu.org  Reinoud Sleeman ORFEUS Data Center Royal Netherlands Meteorological Insitute (KNMI) sleeman @ knmi.nl IRIS - ORFEUS.

Observatories and Research Facilities for European Seismology

2004

Page 11: Www.orfeus-eu.org  Reinoud Sleeman ORFEUS Data Center Royal Netherlands Meteorological Insitute (KNMI) sleeman @ knmi.nl IRIS - ORFEUS.

Observatories and Research Facilities for European Seismology

2005

Page 12: Www.orfeus-eu.org  Reinoud Sleeman ORFEUS Data Center Royal Netherlands Meteorological Insitute (KNMI) sleeman @ knmi.nl IRIS - ORFEUS.

Observatories and Research Facilities for European Seismology

2006

Page 13: Www.orfeus-eu.org  Reinoud Sleeman ORFEUS Data Center Royal Netherlands Meteorological Insitute (KNMI) sleeman @ knmi.nl IRIS - ORFEUS.

Observatories and Research Facilities for European Seismology

2007

Page 14: Www.orfeus-eu.org  Reinoud Sleeman ORFEUS Data Center Royal Netherlands Meteorological Insitute (KNMI) sleeman @ knmi.nl IRIS - ORFEUS.

Observatories and Research Facilities for European Seismology

2008

Page 15: Www.orfeus-eu.org  Reinoud Sleeman ORFEUS Data Center Royal Netherlands Meteorological Insitute (KNMI) sleeman @ knmi.nl IRIS - ORFEUS.

Observatories and Research Facilities for European Seismology

2009

Page 16: Www.orfeus-eu.org  Reinoud Sleeman ORFEUS Data Center Royal Netherlands Meteorological Insitute (KNMI) sleeman @ knmi.nl IRIS - ORFEUS.

Observatories and Research Facilities for European Seismology

VEBSN contributoring networks (53; Nov 2009)AI - Antarctic Seismographic Argentinean Italian NetBE - Belgian Seismic NetworkBN - UK-NetBS - National Network of BulgariaBW - BayernNetzCA - Catalan Seismic NetworkCH - Switzerland Seismological NetworkCR - Croatian Seismograph NetworkCZ - Czech Seismic NetworkDK - Danish Seismological NetworkDZ - CRAAG, Algeria EI - Irish Regional Digital Seismic NetworkES - SPANISH DIGITAL SEISMIC NETWORKFN - Northen Finland Seismological NetworkFR - French Broadband Seismological NetworkG - GEOSCOPEGB - Great Britain Seismograph NetworkGE - GEOFONGR - German Regional Seismic NetworkHE - Finnish National Seismic Network (HEL)HF - Swedish Seismic Array NetworkHL - National Observatory of Athens Digital BroadbandHP - University of PatrasHT - Aristotle University of Thessaloniki SeismologyHU – Hungarian Seismological NetworkIG - Instituto Andaluz de Geofisica

II - IRIS/IDA NetworkIP - Instituto Superior Tecnico Broadband Seismic NetIS - Israel National Seismic NetworkIU - IRIS/USGS NetworkIV - Italian National Seismic NetworkKO - Kandilli ObservatoryMN - MEDNETNA - Netherlands Antilles Seismic NetworkNI – North-East Italy BB network (OGS, Uni. Trieste)NL - Netherlands Seismic NetworkNO - Norwegian Seismic Array NetworkNR - NARS ArrayNS - Norwegian National Seismic NetworkOE - Austrian Seismic NetworkPL - Polish Seismological NetworkPM - Portuguese National Seismograph NetworkRO - Romanian Seismic NetworkSJ - Serbian National NetworkSK - Slovak National Seismic NetworkSL - Slovenia Seismic NetworkSS - SINGLE STATION (Ebro Observatory)SX – Saxon network / LeipzigTU - National Earthquake Observ. Netw., Ankara, TurkeyUP - University of Uppsala NetworkVI - Icelandic National Digital Seismographic Network

pending:Irpinia Seismic Network, Napels, ItalyUniversity of Genua, Italy

All permanent VEBSN stations are ISC registered and have a FDSN network code !

Page 17: Www.orfeus-eu.org  Reinoud Sleeman ORFEUS Data Center Royal Netherlands Meteorological Insitute (KNMI) sleeman @ knmi.nl IRIS - ORFEUS.

Observatories and Research Facilities for European Seismology

number of connections

number of stations providing data

% stations without data

NERIES

20 %

Meredian

Page 18: Www.orfeus-eu.org  Reinoud Sleeman ORFEUS Data Center Royal Netherlands Meteorological Insitute (KNMI) sleeman @ knmi.nl IRIS - ORFEUS.

Observatory and Research Facilities for European Seismology

EIDA – European Integrated Data Archive

ArcLink (QuakeML DB; metadata + routing synchronization)

Distributed data access

• synchronization• routing on network level

Page 19: Www.orfeus-eu.org  Reinoud Sleeman ORFEUS Data Center Royal Netherlands Meteorological Insitute (KNMI) sleeman @ knmi.nl IRIS - ORFEUS.

Observatories and Research Facilities for European Seismology

NERIES Portal and Web application development

Shopping for earthquake data and services in Europe and surroundings

Develop a low maintenance sustainable portal using open source front-end technologies and latest standards for future evolutions

Interactive request tool for easy and unified access to earthquake data and products for diverse audiences

Involve the (European) seismological community in e-science developments, i.e. create an interested user community.

New innovative and interoperable approaches to managing and exploringseismological data

Page 20: Www.orfeus-eu.org  Reinoud Sleeman ORFEUS Data Center Royal Netherlands Meteorological Insitute (KNMI) sleeman @ knmi.nl IRIS - ORFEUS.

Observatories and Research Facilities for European Seismology

Internet

Seismolink QuakeML Taup SMI

HTTP

Clients/applications

WSDL:Describe the services and their bindings (access points).Published and available on the Neries Portal

Data Portal Agents (e.g. perl, java, pyton)

NERIES data portal

Neries Web Services

Example: CMT catalogue

Webservices

BB waveforms Event info Travel times Meta data (provenance)

SOAP / REST comunication protocolsWSDL (XML syntax)

Page 21: Www.orfeus-eu.org  Reinoud Sleeman ORFEUS Data Center Royal Netherlands Meteorological Insitute (KNMI) sleeman @ knmi.nl IRIS - ORFEUS.

Observatories and Research Facilities for European Seismology

Wraps the whole ArcLink network. Provides a single access to distributed archives of continuous waveform data

SeismoLink webservice: stations inventory, waveform data retrieval

arcLink TCP client

ODC arcLink node

GFZ arcLink node

IPGP arcLink node

getInventory dataRequest dataRetrieve purgeData checkStatus

Seismolink WebService

Neries Portal

Seismic Data Portal

~ 640 BB stations already available

INGVarcLink node

Page 22: Www.orfeus-eu.org  Reinoud Sleeman ORFEUS Data Center Royal Netherlands Meteorological Insitute (KNMI) sleeman @ knmi.nl IRIS - ORFEUS.

Observatories and Research Facilities for European Seismology

Composition of datasets by the aggregation of distributed data sources within interactive mashups

“Event Explorer” Jetspeed Portlet

Seismic Events Selection

User Events Cart

Users` Waveform

“Waveform Explorer”Remote Portlet

Multi Modal waveform requests,Event or Time Modes

Seismic Data Portal

RapidSeis Portlet (Liverpool)