VGISC Project: Status and Plans
description
Transcript of VGISC Project: Status and Plans
Abteilung Systeme und Betrieb
WMO CBS TECO WIS, Seoul 06-08.November 2006Page 1
VGISC Project: Status and Plans
Heinrich Knottenberg ([email protected])
Deutscher Wetterdienst
(http://www.dwd.de)
Abteilung Systeme und Betrieb
WMO CBS TECO WIS, Seoul 06-08.November 2006Page 2
Overview
Motivation WIS Project Overview VGISC/SIMDAT VGISC Prototypes Preparation of Operations
Abteilung Systeme und Betrieb
WMO CBS TECO WIS, Seoul 06-08.November 2006Page 3
Overview
Motivation WIS Project Overview VGISC/SIMDAT VGISC Prototypes Preparation of Operations
Abteilung Systeme und Betrieb
WMO CBS TECO WIS, Seoul 06-08.November 2006Page 4
Information collection
Global InformationSystem CentreGISC
GISC
GISC
GISC
GISC
NCNC
NC
NC
NC
NC
NC NC
NC
NC
Data Collection or Product Centre
National CentreNC
DCPC
DCPC
DCPC
DCPC
NC NC
Various communication networks
Global InformationSystem CentreGISCGISC
GISC
GISC
GISC
GISC
NCNC
NC
NC
NC
NC
NC NC
NC
NC
Data Collection or Product Centre
National CentreNC
DCPC Data Collection or Product Centre
National CentreNC
DCPC
DCPC
DCPC
DCPC
NC NC
Various communication networks
Abteilung Systeme und Betrieb
WMO CBS TECO WIS, Seoul 06-08.November 2006Page 5
Information distribution
NationaldisseminationRequest/reply(Internet)
Nationalusers
Nationalusers
Routinedissemination(Internet, privatenetwork,satellite,etc.)
GISC
GISC
GISC
GISC
NC
NC
NC
NCNC
NC
NC NC
DCPC
DCPC
DCPC
DCPC
Various communicationnetworks
NationaldisseminationRequest/reply(Internet)
NationaldisseminationRequest/reply(Internet)
Nationalusers
Nationalusers
Routinedissemination(Internet, privatenetwork,satellite,etc.)
Routinedissemination(Internet, privatenetwork,satellite,etc.)
GISC
GISC
GISC
GISC
NC
NC
NC
NCNC
NC
NC NC
DCPC
DCPC
DCPC
DCPC
Various communicationnetworks
Abteilung Systeme und Betrieb
WMO CBS TECO WIS, Seoul 06-08.November 2006Page 6
Overview
Motivation WIS Project Overview VGISC/SIMDAT VGISC Prototypes Preparation of Operations
Abteilung Systeme und Betrieb
WMO CBS TECO WIS, Seoul 06-08.November 2006Page 7
VGISC Partners
• In 2001, RA-VI decided to create a project for the development of a prototype GISC.
• The NMSs of France, Germany and the UK have volunteered to jointly design and implement a virtual GISC (VGISC) shared by their Services and to include the ECMWF and EUMETSAT as DCPCs into the concept, funded partially as EU project SIMDAT.
• A first proof-of-concept system was demonstrated during CBS XIII.
VGISC
Abteilung Systeme und Betrieb
WMO CBS TECO WIS, Seoul 06-08.November 2006Page 8
VGISC Project Overview
Year
2005 -
2006 -
2007 -
2008 -
2009 -
Preparations
Operations
Steering
Group
Project
Office
SIMDAT Project
Distribution Systems of the Partners e.g. WebWerdis, DIFMET, ECPDS, JEDDS, EUMETCast, RETIM2000
Subscription Service
Abteilung Systeme und Betrieb
WMO CBS TECO WIS, Seoul 06-08.November 2006Page 9
VGISC Working Groups
• Data Policy (Francois Duvernet, Meteo France)
• Data Management (Steve Foreman, UK Met)
• Data Acquisition and Dissemination (H. Knottenberg, DWD)
• Communication (Hans Janßen, DWD)
Abteilung Systeme und Betrieb
WMO CBS TECO WIS, Seoul 06-08.November 2006Page 10
“Pull” request handling
data flow
control flow
local data sourcelocal production
tools
production controltranslator
data controltranslator
localinstruction(for ownproductiontools)
Production(NC/DCPC)
atomiccatalogue
productcatalogue
product instancecatalogue
distribution catalog.
customer orders
Metadata-pool
GISC-node
distribution tool (push)
monitoring tool
synchronisation tool
definition demon or-webservice
Web-Browser
Client
distribution demon or-webservice (pull)
GISCproduct instance
pool localinstruction(searching foratoms inown database )
global instructions(for data searching and production)
Tools and frontend-Server(adminstration- andcoordination centre)
Internet Portal(web frontend)
Local data pool(s)
Abteilung Systeme und Betrieb
WMO CBS TECO WIS, Seoul 06-08.November 2006Page 11
“Push” distribution
atomiccatalogue
productcatalogue
product instancecatalogue
distribution catalog.
customer orders
Metadata-pool
GISC-node
monitoring tool
synchronisation tool
definition demon or-webservice
Client
distribution demon or-webservice (pull)
GISCproduct instance
pool
data flow
control flow
distribution tool (push)
Internet Portal(web frontend)
Tools and frontend-Server(adminstration- andcoordination centre)
Local data pool(s)
Abteilung Systeme und Betrieb
WMO CBS TECO WIS, Seoul 06-08.November 2006Page 12
Overview
Motivation WIS Project Overview VGISC/SIMDAT VGISC Prototypes Preparation of Operations
Abteilung Systeme und Betrieb
WMO CBS TECO WIS, Seoul 06-08.November 2006Page 13
SIMDAT
Data Grids for Process and Product Development using Numerical Simulation and Knowledge Discovery
www.simdat.org
funded by the European Commission
SIMDAT General Information
Abteilung Systeme und Betrieb
WMO CBS TECO WIS, Seoul 06-08.November 2006Page 14
Application Activities
Four sectors of international economic importance:
Automotive
Pharmaceutical
Aerospace
Meteorology
Technology Activities
Seven Grid-technology development areas:
Grid infrastructure
Distributed Data Access
VO Administration
Workflows
Ontologies
Analysis Services
Knowledge Services
SIMDAT Application and Technology
Abteilung Systeme und Betrieb
WMO CBS TECO WIS, Seoul 06-08.November 2006Page 15
SIMDAT Conceptual View
• Through the Distributed Portal users searches for and retrieves data, subscribe to services subject to authentication and authorization
• The Virtual Database Service provides a single view of partners databases
Abteilung Systeme und Betrieb
WMO CBS TECO WIS, Seoul 06-08.November 2006Page 16
VGISC-SIMDAT Working Groups
• Virtual Organisations (Lothar Wolf, EUMETSAT)
• Ontology (Jeremy Tandy, UK Met)
• Distributed Data (Jacques Roumilhac, Meteo France)
• Grid Infrastructure (Hans Janßen, DWD)
Abteilung Systeme und Betrieb
WMO CBS TECO WIS, Seoul 06-08.November 2006Page 17
VGISC SIMDAT structure
Abteilung Systeme und Betrieb
WMO CBS TECO WIS, Seoul 06-08.November 2006Page 18
Interface to offer a single view of the data- Discovery facilities- Request/Subscription
MonitoringLoggingControl
Error tracking
SecurityAuthenticationAuthorization
Audit
ManagementUser registration
DB adminCatalogue admin
Grid infrastructure for sharing data
Interoperability interfaces for data/metadata exchange
mechanisms to synchronise metadata
DisseminationAcquisition
mechanisms
Abteilung Systeme und Betrieb
WMO CBS TECO WIS, Seoul 06-08.November 2006Page 19
• Presented to EU-Commission in November 2005:
• VGISC-Nodes at the contributing sites
• Data contributions
• DWD: Access to climate time-series data
• UK Met Office: XML Metadata / - Data Prototype
• Meteo France: NWP Products
• ECMWF: Model Analyses, Observational Data (One Sample Day)
SIMDAT EU Demonstrator 2005
Abteilung Systeme und Betrieb
WMO CBS TECO WIS, Seoul 06-08.November 2006Page 20
• To be presented to EU-Commission at end of November 2006:
• VGISC-Nodes (Enhanced Version) at the contributing sites
• Data Contributions
• DWD: Access to climate time-series data, NWP Products
• UK Met Office: XML Metadata / - Data Prototype, Lighting Detection data
• Meteo France: NWP Products, Selection of GTS Data
• ECMWF: Model Analyses, NWP Products
• EUMETSAT: Satellite Images
SIMDAT EU Demonstrator 2006
Abteilung Systeme und Betrieb
WMO CBS TECO WIS, Seoul 06-08.November 2006Page 21
Overview
Motivation WIS Project Overview VGISC/SIMDAT VGISC Prototypes Preparation of Operations
Abteilung Systeme und Betrieb
WMO CBS TECO WIS, Seoul 06-08.November 2006Page 22
• DWD: Portal
• DWD: Push/Pull System
• DWD: Access to climate time-series data (UNIDART-Project)
• UK Met Office: XML Metadata / - Data Prototype (Description only)
• ECMWF: Model Analyses
• EUMETSAT: Access to EUMETCast Dissemination
• NCAR: Model Analyses
CBS 2005 GISC Prototype
Abteilung Systeme und Betrieb
WMO CBS TECO WIS, Seoul 06-08.November 2006Page 23
Abteilung Systeme und Betrieb
WMO CBS TECO WIS, Seoul 06-08.November 2006Page 24
• Push/Pull System: DWD
• DWD: Access to climate time-series data (UNIDART-Project)
UK Met Office: XML Metadata / - Data Prototype
• ECMWF: Model Analyses
• EUMETSAT: Access to EUMETCast Dissemination
• NCAR: Model Analyses
RA VI Conference Demonstration(Continuation of CBS 2005-Prototype)
Abteilung Systeme und Betrieb
WMO CBS TECO WIS, Seoul 06-08.November 2006Page 25
Abteilung Systeme und Betrieb
WMO CBS TECO WIS, Seoul 06-08.November 2006Page 26
• Portal: At Sites of contributors
• Available data types:
• DWD: NWP Products, Climate Time Series
• ECMWF: NWP Products, TIGGE, Reanalysis
• EUMETSAT: Satellite Images
• METEO-France:NWP Products, Selection of GTS Data
• UK MET-Office: Selection of OPMET-Data (METARs, TAFs)
• NCAR: Reanalysis data, environmental data
• RNODC: GTS Data
CBS TECO WIS Presentations
Abteilung Systeme und Betrieb
WMO CBS TECO WIS, Seoul 06-08.November 2006Page 27
• Available data types (continued):
• BoM: NWP Products, Observational Data
• CMA: NWP Products, Satellite Images
• JMA: NWP Products, Satellite Images
• KMA: NWP Products, Climate Time Series
CBS TECO WIS Presentations
Abteilung Systeme und Betrieb
WMO CBS TECO WIS, Seoul 06-08.November 2006Page 28
Abteilung Systeme und Betrieb
WMO CBS TECO WIS, Seoul 06-08.November 2006Page 29
Abteilung Systeme und Betrieb
WMO CBS TECO WIS, Seoul 06-08.November 2006Page 30
Overview
Motivation WIS Project Overview VGISC/SIMDAT VGISC Prototypes Preparation of Operations
Abteilung Systeme und Betrieb
WMO CBS TECO WIS, Seoul 06-08.November 2006Page 31
VGISC Project Office
• Investigate and prepare options for the Policy Board on organisational, financial and technical matters such as– precise scope of the VGISC including data policies and
GTS support– operating the VGISC– methods of funding, acquisition and staffing– management structures– implementation and migration
Abteilung Systeme und Betrieb
WMO CBS TECO WIS, Seoul 06-08.November 2006Page 32
Open Issues (technical)
• WMO Standards not yet specified/finalised
… Metadata Standard
… Interfaces between Centres
… Operational procedures
• …..
•
Abteilung Systeme und Betrieb
WMO CBS TECO WIS, Seoul 06-08.November 2006Page 33
Questions ?