Post on 03-Jan-2016
CBS Ext(2014) / RA III-16TECO / RECO
WIGOS MetadataSteve Foreman, WIGOS Secretariat
For TT-WMD
WMO; CBS Ext(2014) / RA III-16
2
WIGOS metadata
Context High level contents Next step
CBS Ext(2014) / RA III-16
Context
WMO Integrated Observing System - Metadata
Aims to support Use of observations Planning observation networks
Constraints Applicable to all types of observations Acceptable to governments of all countries
WIGOS metadata
Principles for WIGOS Metadata
Include the information that enables users to make adequate use of observational data [also for climate applications]
Every piece of metadata shall have date/time information associated with it
All metadata associated with internationally exchanged data shall be made available
Metadata shall be updated in a timely manner to support adequate interpretation of data
Standard should be applicable to all disciplines Standard should be forward-looking but also respect legacy
(e.g., Vol. A) Standard should be acceptable to all Members Standard should be applicable for all Members
WIGOS metadata
Principles for WIGOS Metadata
Include the information that enables users to make adequate use of observational data [also for climate applications]
Every piece of metadata shall have date/time information associated with it
All metadata associated with internationally exchanged data shall be made available
Metadata shall be updated in a timely manner to support adequate interpretation of data
Standard should be applicable to all disciplines Standard should be forward-looking but also respect legacy
(e.g., Vol. A) Standard should be acceptable to all Members Standard should be applicable for all Members
WIGOS metadata
Explain observations
Over time
For all exchanged observations
In time to be useful
For all types of observation
Expand what we record
Achievable
Relevant
1. Observed Quantity
2. Purpose of Observation
3. Data Quality
4. Environment
5. Data Processing and Reporting
6. Sampling and Analysis
7. Station/Platform
8. Method of Observation
9. Ownership and Data Policy
10. Contact
High level content
1. Observed Quantity
2. Purpose of Observation
3. Data Quality
4. Environment
5. Data Processing and Reporting
6. Sampling and Analysis
7. Station/Platform
8. Method of Observation
9. Ownership and Data Policy
10. Contact
Observed quantity
Atmospheric:
Temperature (F)
Humidity (%)
Wind (mph)
Rainfall (inches)
Visibility (miles)
High level content
1. Observed Quantity
2. Purpose of Observation
3. Data Quality
4. Environment
5. Data Processing and Reporting
6. Sampling and Analysis
7. Station/Platform
8. Method of Observation
9. Ownership and Data Policy
10. Contact
High level content
Purpose
Urban meteorology
US domestic stations
1. Observed Quantity
2. Purpose of Observation
3. Data Quality
4. Environment
5. Data Processing and Reporting
6. Sampling and Analysis
7. Station/Platform
8. Method of Observation
9. Ownership and Data Policy
10. Contact
High level content
Data quality
Quality flags
1. Observed Quantity
2. Purpose of Observation
3. Data Quality
4. Environment
5. Data Processing and Reporting
6. Sampling and Analysis
7. Station/Platform
8. Method of Observation
9. Ownership and Data Policy
10. Contact
High level content
Environment
In a screen
On a rooftop platform
1. Observed Quantity
2. Purpose of Observation
3. Data Quality
4. Environment
5. Data Processing and Reporting
6. Sampling and Analysis
7. Station/Platform
8. Method of Observation
9. Ownership and Data Policy
10. Contact
High level content
Data processing
Hourly reporting
Pressure tendency derived from manual interpretation of
barograph trace.
Hand written logs
1. Observed Quantity
2. Purpose of Observation
3. Data Quality
4. Environment
5. Data Processing and Reporting
6. Sampling and Analysis
7. Station/Platform
8. Method of Observation
9. Ownership and Data Policy
10. Contact
High level content
Sampling and analysis
Winds averaged over ten minutes
1. Observed Quantity
2. Purpose of Observation
3. Data Quality
4. Environment
5. Data Processing and Reporting
6. Sampling and Analysis
7. Station/Platform
8. Method of Observation
9. Ownership and Data Policy
10. Contact
High level content
Station platform
Region: IV
Country: USA
Name: New York Roof 10
Type: Land station
Id: int.wmo.wigos-0-153-3-157
Location: 40°44′54.36″N 73°59′08.36″W
Data comms: Telephone
1. Observed Quantity
2. Purpose of Observation
3. Data Quality
4. Environment
5. Data Processing and Reporting
6. Sampling and Analysis
7. Station/Platform
8. Method of Observation
9. Ownership and Data Policy
10. Contact
High level content
Purpose
Urban meteorology
US domestic stationsEnvironment
In a screen
On a rooftop platform
Data quality
Quality flags
Method (visibility)
Visual
Standard reference landmarks
Obs Range: not available
1. Observed Quantity
2. Purpose of Observation
3. Data Quality
4. Environment
5. Data Processing and Reporting
6. Sampling and Analysis
7. Station/Platform
8. Method of Observation
9. Ownership and Data Policy
10. Contact
High level content
Ownership
Responsible: NWS
Data policy: WMO Essential
1. Observed Quantity
2. Purpose of Observation
3. Data Quality
4. Environment
5. Data Processing and Reporting
6. Sampling and Analysis
7. Station/Platform
8. Method of Observation
9. Ownership and Data Policy
10. Contact
High level content
Contact
USA Focal Point for Observations
18
Tailoring the standard
Each element marked as: Mandatory
Required for all WIGOS metadata records Conditional
Required only in specified circumstances instrument calibration makes little sense for a human
observer
Optional Extremely useful, but too challenging to make
compulsory
CBS Ext(2014) / RA III-16
Next step
Considerations for WIGOS Metadata
Creating metadata Levels of detail
Transmission Various intervals for
(incremental) update
Access and use By humans (researchers,
managers, the public) By machines (services)
Rather invariant
Very dynamic
intermediate
WIGOS metadata
21
Next steps
Task Team on WIGOS Metadata Development Develop data representations
Members Review systems
To capture metadata To retain existing metadata
WMO Co-ordinate sharing mechanisms
CBS Ext(2014) / RA III-16
22
Phased implementation
2016 2017-18 2019-2020
Mandatory and straightforward
Conditional and straightforward
Optional and straightforward
Likely to need more data gathering or to need changes to procedures
All remaining elements
CBS Ext(2014) / RA III-16
See Doc 3.3(1) – Recommendation 3, Appendix 24
(in the file -Annex-2-…)
All WMO-No 9 Vol A elements are required in 2016
Summary
24
WIGOS Metadata - summary
CBS Ext(2014) / RA III-16
Explain observations
Over time
For all exchanged observations
In time to be useful
For all types of observation
Expand what we record
Achievable
Relevant
www.wmo.int 25
Thank you for your attentioncbs-session@wmo.int
CBS Ext(2014) / RA III-16