WMO Information System (WIS)

33
1 World Meteorological Organization WMO Information System (WIS) Managing & Moving Weather, Water and Climate Information in the 21 st Century WORLD METEOROLOGICAL ORGANIZATION Weather Climate - Water ROC and RMDC Steering Group meetings, Vienna, Austria, 3-6 June 2008 José Arimatéa de Sousa Brito Information and Telecommunication Services Division Observing and Information Systems Department

Transcript of WMO Information System (WIS)

Page 1: WMO Information System (WIS)

1World Meteorological Organization

WMO Information System (WIS)

Managing & MovingWeather, Water and Climate Information

in the 21st Century

WORLD METEOROLOGICAL ORGANIZATION

Weather –Climate - Water

ROC and RMDC Steering Group meetings, Vienna, Austria, 3-6 June 2008

José Arimatéa de Sousa BritoInformation and Telecommunication Services Division

Observing and Information Systems Department

Page 2: WMO Information System (WIS)

2World Meteorological Organization

WorldMeteorological

Centres

WWW GTS

Regional/SpecializedMeteorological Centres

NationalMeteorological

Centres

Meteorological and R&DSatellite Operator Centres

Current situation: GTS

interconnects

Page 3: WMO Information System (WIS)

3World Meteorological Organization

GTS provides:•Information collection and distribution

o Real-time push for WWW data & products(and some other programmes data)

•Information management

o Standard data formats

o Implicit metadata & catalogs

Current situation: GTSCurrent situation: GTS

For WWWFor WWW

Page 4: WMO Information System (WIS)

4World Meteorological Organization

•Information exchange

o Multiplicity of procedures

o Real-time and non-real-time

o Very limited pull

•Information management

o Multiplicity of data formats

o Uncoordinated/lack of metadata & catalogs

o No discovery

Current situation:Current situation:GTSGTS and Other WMO Programmes systemsand Other WMO Programmes systems

Page 5: WMO Information System (WIS)

5World Meteorological Organization

GAW World Data Centres

GCOS Data Centres

Global Run-off Data Centre

Global Precip. ClimatologyCentreIRI, Hadley Centre, and

other climate researchcentres; Universities;Regional Climate Centres(CIIFEN, etc.)

International Organizations(IAEA, CTBTO, UNEP, FAO.. )

CommercialService Providers

World Radiation Centre

Regional InstrumentCentres

WMO WorldData Centres

InternationalProjects(e.g. GMESHALO)

Real-time “push”On-demand “pull”

internet

DCPC

NC/DCPC

NCNC

NC/DCPC

NC

NC

NC

NC

NC

NC

GISC

GISCGISC

SatelliteTwo-Way Systems

SatelliteDissemination(IGDDS, RETIM,

etc)

NC

NC

DCPC

GISC GISC

DCPC

WISWIS

Page 6: WMO Information System (WIS)

6World Meteorological Organization

IMPORTANT QUESTIONS

• What is the WMO Information System (WIS)?

–Why is it being developed?

–What services will it provide?

• What will the NMHS gain from WIS?

• What is the overall WIS plan?

• How far has its implementation progressed?

• What are the major challenges still to be met?

Page 7: WMO Information System (WIS)

7World Meteorological Organization

WMO Information System (WIS)DESIGNING AND IMPLEMENTING WIS

• Overview– Background information

• Project plan– Objectives and vision– Scope of the project– Organizational structure

• Project implementation– User requirements– Technical specifications– WIS guidelines

• WIS critical issues– Engagement of Working Groups, Expert Teams, …

Page 8: WMO Information System (WIS)

8World Meteorological Organization

WMO INFORMATION SYSTEM

Direction from WMO Congress (2003)•Develop:– Over-arching approach for solving data management

problems for all WMO and related internationalprogrammes

– A single, coordinated global infrastructure, theWMO Information System (WIS) for thecollection and sharing of information

Page 9: WMO Information System (WIS)

9World Meteorological Organization

REASONS FOR WISREASONS FOR WIS

• Various WMO Programmes developinginformation systems independently

–Incompatibilities, inefficiencies, duplication ofeffort and higher overall costs

• Continued systems development in anuncoordinated manner would:

–Exacerbate these problems–Increase difficulty in sharing information

between programmes–Further isolate WMO Programmes from each

other and from wider environmental community

Page 10: WMO Information System (WIS)

10World Meteorological Organization

Integrated approach for all WMO Programmes

•Routine collection and dissemination of time-criticaland operation-critical data and products:

o Real-time “push”through dedicated telecommunication•Data Discovery, Access and Retrieval service:

o “Pull”through the Internet (HTTP, FTP,…)•Timely delivery of data and products:

o Delayed mode “push”through dedicated telecommunicationmeans and public data networks, especially the Internet

•Unified procedureso More efficient data exchange

•Coordinated and standardized metadatao Interoperability between programmeso Improved data managemento ISO 191xxx series for geographic information

WIS Vision

Page 11: WMO Information System (WIS)

11World Meteorological Organization

WIS brings new features and opportunities

•Common information exchange standards,functions and services for all WMOprogrammes

•Inter-disciplinary discovery, retrieval andexchange of information in real-time andnon-real time

•Inter-operability through on-line cataloguesusing metadata based on ISO 19100(geographic information standard)

•Industry standards and off-the-shelfhardware and software systems to ensurecost-effectiveness and compatibility

Page 12: WMO Information System (WIS)

12World Meteorological Organization

WIS provide three types of services to meet thedifferent requirements:(1) Routine collection and dissemination service

for time-critical and operation-critical data andproducts:

Based on real-time “push” mechanism (incl. Multicast);implemented essentially through dedicated telecommunication meanswith guaranteed quality of service, e.g. leased circuits, dedicateddata communication network services and satellite-based data-distribution systems;(2) Data Discovery, Access and Retrieval service:

Based on request/reply “pull”mechanism with relevant datamanagement functions; implemented essentially through the Internet(HTTP, FTP,…);(3)Timely delivery service for data and products:

Based on delayed mode “push”mechanism; implemented through acombination of dedicated telecommunication means and of public datanetworks, especially the Internet.

WIS SERVICES

Page 13: WMO Information System (WIS)

13World Meteorological Organization

Major Components and Services of WIS:Interoperability and WIS Networking

Dat

aan

dP

rodu

ctU

sers

Global InformationSystem Centres

(GISCs)

Data Collection orProduction Centres

(DCPCs)

NationalCentres(NCs)

SOA - Focus is on the interfaces

Page 14: WMO Information System (WIS)

14World Meteorological Organization

Structure of WISFunctional centres interconnected by datacommunication networks:

•National Centres (NC)– Links national data providers and users to regional and global data

exchange nodes, and administrates access to WIS

•Data Collection and Production Centres (DCPC)– Provides for regional and international exchange of WMO programmes’

data and products– Supports data and information push and pull

•Global Information System Centres (GISC)– Provides for global exchange of data and products– Collects and provides metadata for all data and products– Supports data and information discovery and pull

WIS concerns only information exchange and data management functions

Page 15: WMO Information System (WIS)

15World Meteorological Organization

WMO Information System (WIS)BASIC DOCUMENTS

•WIS PROJECT AND IMPLEMENTATION PLAN

•WIS COMPLIANCE SPECIFICATIONS OFGISC, DCPC AND NC

•WIS USER REQUIREMENTS

•WIS GUIDELINES

Page 16: WMO Information System (WIS)

16World Meteorological Organization

WIS PROJECT ORGANISATIONAL CHART

CONGRESS

Page 17: WMO Information System (WIS)

17World Meteorological Organization

WIS Project Gantt Chart

Page 18: WMO Information System (WIS)

18World Meteorological Organization

IGDDS

WIS/GTS: for time and operation-critical data & productsWIS/IGDDS: for space-based data & productsWIS/DAR: data discovery, access and retrievalData push: routine distribution of data & productsData pull: access to and retrieval of data & products

Data pull

Data push

WIS DATA-COMMUNICATIONS IMPLEMENTATION(for weather, water, climate and related data and products)

Essentially throughtelecom. withguaranteed quality ofservice, e.g. leasedcircuits, dedicated datacom network services,sat.-based systems, ..

Essentially throughsatellite based datadistributionsystems, e.g. DVB-S

GTS

Essentially throughthe Internet(HTTP, FTP, VPN…)

DAR

WIS

Page 19: WMO Information System (WIS)

19World Meteorological Organization

Exeter

SofiaMelbourne

Buenos Aires

TokyoBeijing

Nairobi

Washington

Network I

Jeddah

Prague

Toulouse

Dakar Algiers

Offenbach

Brasilia

CairoManaged

data communication network

New DelhiMoscow

Network II

IMPROVED MAIN TELECOMMUNICATION NETWORK(IMTN)

Page 20: WMO Information System (WIS)

20World Meteorological Organization

Site D acts as a gatewayfor Site F

Site A acts as a gatewayfor Site G

DATA COMMUNICATION NETWORK

(Target: as big as possile)

Page 21: WMO Information System (WIS)

21World Meteorological Organization

Interoperability enables the discovery,the retrieval and the usage of the dataIt needs the development and theimplementation of relevant Metadatastandards

Development of a WMO Metadata Profile ofthe ISO 191xx series for geographicinformation

•Step 1: development of the WMO MetadataCore Profile of ISO 19115 for data discovery

•Step 2: Use of the ISO 191xx series for theaccess and use of the data

WIS, a key issue: interoperabilityWIS, a key issue: interoperability

Page 22: WMO Information System (WIS)

22World Meteorological Organization

WIScore

network

InternetDiscovery, Accessand Retrieval(DAR)

Connectivity of DAR services

DISCOVERY, ACCESS AND RETRIEVAL

Page 23: WMO Information System (WIS)

23World Meteorological Organization

Table 1 Scope

1 Routine collection and automated dissemination of time-critical and operation-critical information(‘push’).

2 Timely delivery service for information (appropriate to requirements) including delayed mode data.3 Information subscription services (subscribe to ‘push’) by authorised users.4 Ad-hoc requests for information (‘pull’) by authorised users.5 Integration and management of duplicated files or messages (information entity) including version

control (i.e. corrections and duplicates) The blending of real time and delayed mode information ishandled in other processes of information custodians.

6 Integration of data collection and distribution systems either in place or under development within theWMO programmes including the satellite programme’s Integrated Global Satellite Data Distribution System (IGDDS) and the use of the internet via all programmes.

7 Access to WMO registries and catalogues, including a portal for metadata discovery (InformationDiscovery)

8 Discovery, Access and Retrieval Service (DAR) to information serving directly from GISCs of currentcontent (as distinct from only providing metadata)

9 Interoperability with other user communities including earth sciences and the various GEO societalbenefit areas (GEOSS).

10 Assurance processes for ensuring adherence to data and information usage policy.11 Identification and authorisation processes12 Network security13 Information security including exchange over open and closed networks. i.e. Ensure the quality of the

information is maintained while in the transit and communications components. e.g. quality of serviceaccording to GTS manual

14 Merit assessment of new and existing communication technologies (i.e. solution should be flexibleand scalable to allow for taking advantage of new technologies).

15 Information collection and distribution systems within Member states. Although internal collection anddistribution practices within countries are totally under the control of the Member state, these are apart of WIS. Also, WIS should be able to register national systems should members desireinternational access to them.

16 Quality and performance monitoring of collection and distribution services and systems17 Metadata profiles for describing information and information services.18 Management of metadata & effectiveness of metadata, system handling of metadata

Not in scope at this time.1 Who decides what information passes on WIS. This comes back to the information provider.2 User registration and shared user registers, virtual organisation issues.3 Information visualisation and integration. This is a value added service available through NC and

DCPC. Available and future API may enable users to achieve this function.4 Information subsection and creation of new products. Too hard at present and will come in later

development stages5 Quality control and assurance processes for data and products. These are being managed within

other stages in the information creation and collection at present, especially within the NC.Table 1 Scope

SCOPE OF WIS

Page 24: WMO Information System (WIS)

24World Meteorological Organization

Assessment of Requirements(WIS Project Office –interim measure)

Review of Requirements(New ET on User Requirements - to be formed)

User Reqmts Doc, WIGOS Obs db + TBD db

Determine Optimal Way to Meet User RequirementsWG-PIW | ET-OI | ET-CTS

Consolidation of Views(New ET on User Requirements)

Consolidated and Endorsed User Requirements

Implementation of ServicesAddressing User Requirements

Member States (CIO)

Decisions on Implementation offormal and Ad Hoc Requests

Questionnaire Responses, Meeting Reports, interviews, etc

Decisions on WIS Components

Designation of GISCs and DCPCs

EC, TCs, RAs, Member States

RequirementsAssessment Phase

RRR Phase

Processfor

Establishing,M

aintainingand

Implem

entingUser

Requirem

ents

WIS DCPC and GISC NominationsAd Hoc Requests for WIS Services

Page 25: WMO Information System (WIS)

25World Meteorological Organization

Integration Definition for Function Modelling (IDEF0)

FunctionInput Output

Controlsource datawhich is

transformed bythe Function

the result of thetransformation

carried out by theFunction

identifies theresources/facilities that areused by the Function (e.g.

humans, computers...)

defines how theFunction carries outthe transformation

Mechanism

Functions transformthe Inputs into

Outputs in accordancewith the Controls and

making use of theMechanisms

Functions transformthe Inputs into

Outputs in accordancewith the Controls and

making use of theMechanisms

Page 26: WMO Information System (WIS)

26World Meteorological Organization

WIS CONTEXT DIAGRAM AND SOME WIS FUNCTIONS

Page 27: WMO Information System (WIS)

27World Meteorological Organization

InterfaceT

echS

pecs

Reporting of Quality of ServiceWIS-TechSpec-15

Consolidated View of Distributed Dissemination Metadata CataloguesWIS-TechSpec-14

Maintenance of Dissemination MetadataWIS-TechSpec-13

Downloading Files via Other MethodsWIS-TechSpec-12

Downloading Files via Non-dedicated NetworksWIS-TechSpec-11

Downloading Files via Dedicated NetworksWIS-TechSpec-10

Consolidated View of Distributed DAR Metadata CataloguesWIS-TechSpec-9

DAR Catalogue Search and RetrievalWIS-TechSpec-8

Authorization of a User RoleWIS-TechSpec-7

Authentication of a UserWIS-TechSpec-6

Consolidated View of Distributed Identification and Role InformationWIS-TechSpec-5

Maintenance of User Identification and Role InformationWIS-TechSpec-4

Centralization of Globally Distributed DataWIS-TechSpec-3

Uploading of Data and ProductsWIS-TechSpec-2

Uploading of Metadata for Data and ProductsWIS-TechSpec-1

GISCDCPCNC

Required for:Interface Technical Specification NameInterface Technical SpecificationIdentifier

Page 28: WMO Information System (WIS)

28World Meteorological Organization

For updating the identification and role information concerning candidate or current users of WIS, WISCentres should support two kinds of maintenance facilities: a file upload facility for "batch" updating(add, replace, or delete identification and role records treated as separate files); and an online form forchanging individual identification and role entries (add, change, or delete of elements in a record as wellas whole records).

Notes

use ISO standards for references to specific places on the Earth; harmonize data formats, transmission,archiving and distribution across disciplines; [each NC] authorizes its national users to access WIS;[each DCPC] supports access to data and products via Internet request/reply; [each DCPC] implementsbackup and recovery of essential services; use dedicated telecommunications and public Internet fortimely delivery; identify and use a variety of data types across WMO programmesWIS Technical Specification Appendix C Requirements:C.5.20, C.1.11, C.5.05, C.5.17, C.4.05, C.3.05, C.3.07, C.1.14, C.1.19, C.1.20, C.1.21, C.1.10, C.1.18a

WIS Requirements(in addition to requirementsapplicable toall interfaces)

WIS Technical Specification Appendix B Use Cases:B.5, Maintain Identification and Role Information for WIS Users

Use Cases

WIS Technical Specification Appendix A, Diagram 2, Process A2:Assign User RoleInputs: User RequestsOutputs: User Requests with Assigned RoleWIS Technical Specification Appendix A, Diagram 2, Process A4:Authorise Access to Information by UsersInputs: Requests for InformationOutputs: Information Access Authorizations

WIS Data Flow Diagrams

the timeliness of changes to user identification and role information is application-specific and subject toNC or DCPC procedures

Performance Metricsidentification and

role information

public or private Internet using TCP/IP with encryption;typically HTTP with GET or POST methods, and may include SOAP

Network Transports andSupporting Services

non-dedicated shared network may be used, provided there is privacy protection for identified individualsas required by national laws

Service Level Required

terminal-host; store-and-forward or file transfer (e.g., FTP, HTTP)client-server; request-response (e.g., HTTP with CGI Web form)

Communication Types

standards for content and communications are TBD by host of identification and role informationdatabase

Applicable Standards

WIS-TechSpec-4, Maintenance of User Identification and Role Information

Page 29: WMO Information System (WIS)

29World Meteorological Organization

Eliot ChristianLast Updated By

30 Oct 2007Last Updated

At this point in WIS system design, mechanisms have not been decided for handling identificationand role information as needed across WIS centres.

Notes and Issues

Identification and role information about candidate or current users of WIS are to be recordedthrough facilities controlled by WIS Centres. Typically, two kinds of facilities should besupported. One is a file upload facility for "batch" updating (add, replace, or delete theidentification and role records as separate files). The other is an online form for changingidentification and role records (add, change, or delete elements in a record as well as wholerecords). Administrators of authentication and authorization at WIS Centres share theupdated identification and role information as a resource available as needed across WISCentres.

Normal Flow

WIS Centres collectively have the ability to authenticate each user of WIS and authorize him toperform all of the functions appropriate to his role, and only those functions appropriate tohis role

Post-Conditions

(1) Administrators have agreed authentication policies delineating the credentials required toestablish identity of a WIS user

(2) Administrators have agreed authorization policies delineating which roles are authorized toperform each WIS action

(3) Administrators have mechanisms to create and maintain identification information needed forauthentication of users of WIS

(4) Administrators have mechanisms to create and maintain role information needed forauthorization of authenticated users of WIS

Pre-Conditions

Users of WIS (internal and external)Administrators of authentication and authorization at WIS Centres

Actors

Internal and external users of WIS are able to be identified as needed for their authentication, andtheir role information is maintained as needed for their authorizations to perform specificfunctions

Use Case Goal

Use Case B.5, Maintain Identification and Role Information for WIS Users

Page 30: WMO Information System (WIS)

30World Meteorological Organization

Key Future Milestones

•Consolidate plans on development, governanceand implementation of WIS: 2007-2008

•Develop WIS regulatory documentation andguidance material for implementation, includingspecifications for the GISC interfaces and aunified user interface: 2007-2008

•Develop scheme and practices for security,authentication and authorization procedures forWIS services : 2007-2008

•Implementation of first operational GISC: 2009•Implementation of other operational GISCs: 2009

- 2011•Implementation of DCPCs, i.e. WIS interfaces at

WMO programmes’centres: 2009-2011

Page 31: WMO Information System (WIS)

31World Meteorological Organization

European Virtual GISC Project

Page 32: WMO Information System (WIS)

32World Meteorological Organization

•Data exchange/synchronization between GISCs

•Metadata exchange/synchronization

•GISC performance standards, monitoring,storage

•Two (2) minutes for warning distribution•Ten (10) minutes for other info•Holding 24 hours of information

•Manual on WIS, equivalent of Manual on theGTS.

•Defining steps to be taken to evolve the GTStowards WIS

CRITICAL ISSUES FOR WIS

Page 33: WMO Information System (WIS)

33World Meteorological Organization

EVOLUTION OF THE GTS TOWARDS WIS

CHALLENGES

•WIS has to perform better than the current GTS in any stage

•Use of technology available now

•Take into account current evolution of Regional Networks

•WIS to be cost-effective in the long run