End-to-end Data Management for Operational Observation Systems Presented to the Summit on Long-Term...
-
Upload
giancarlo-lathem -
Category
Documents
-
view
219 -
download
0
Transcript of End-to-end Data Management for Operational Observation Systems Presented to the Summit on Long-Term...
End-to-end Data Management for Operational Observation Systems
Presented to the
Summit on Long-Term Monitoring of the Gulf of Mexico Hypoxic
Zone
Sharon Mesick, NCDDCEcosystem Program Manager
January 2007
Overview
• End-to-end data management projects
– SEAMAP / Gulf of Mexico Hypoxia Watch (pg 3)
– WCO – NODC Conduit (Appendix B)
• Adopting best practices for an Operational
Observation System
Five Data Management Functions
• Discover– Look, find and get data, data products and information
• Access– To data and information
• Archival– Storage and maintenance
• Products– Quality Assurance, development and maintenance
• Outreach– Facilitate stakeholder awareness
SEAMAP / Gulf of Mexico Hypoxia Watch
• Partnership project
– NMFS, CoastWatch, NCDDC
• Manual data development process
– Interoperable standards addressed
• Metadata, geospatial
– Discovery, access, archive requirements
met
• Multiple public access points
Hypoxia Watch Data Management Flow
ProductsGIS & JPEG
NODCArchival
NCDDCMetadataCatalog
NCDDCClearinghouse
NodeMERMAid
NCDDC Data Development-------------------------
• Receive / QC data• Geospatially enable• Generate contours• Generate metadata• GIS Integration• Product generation
Multiple Public Access Points
• Direct Data Access
– Ocean Archive System
• Data Access
Applications
– Internet GIS
• Metadata Search
– NCDDC Portal
– FGDC Clearinghouse
– Geospatial One Stop
• General Access
– Hypoxia Web site
Gulf of Mexico Hypoxia Watch Program
http://www.ncddc.noaa.gov/ecosystems/hypoxia
West Coast Observing System
• Partnership project– NMSP, CeNCOOS, PISCO, NODC, NCDDC, others
• Operational, end-to-end system– Automated, extensible system
– Interoperable standards addressed• OPeNDAP, metadata, geospatial
– Discovery, access, archive requirements met• Multiple public access points
End-to-End Data Management
Multiple Public Access Points
• Direct Data Access
– NODC OPeNDAP Server
– OPeNDAP.org
– Ocean Archive System
• Data Access
Applications
– Internet GIS
– WCOS Portal
• Metadata Search
– NCDDC Portal
– FGDC Clearinghouse
– Geospatial One Stop
• General Access
– SIMoN (Sanctuary
Integrated Monitoring
Network)
– CeNCOOS OceanObs
Access Catalog Holdings
Publish
HypoxiaCatalogWebsite
NCDDCFTP
Server
NODCRetrievalProcessHypoxia
Catalog
NCDDC WCO-NODC Conduit
-------------------------
HypoxiaWatch
LUMCON
NGoM/CI
Other
NODCOPeNDAP
Server
NODCArchival
NCDDCMetadataCatalog
NCDDCClearinghouse
NodeMERMAid
•Determine new data•Retrieve new data and metadata•Convert data•Call XML-RPC server to generate and publish metadata•Package results and send to FTP site
XML-RPC Server----------------
•Convert metadata to FGDC XML•Publish to various systems
Send Retrieve
Publish
Publish Publish Ingest
Send Metadata forConversion and Publishing
Retrieve newData and Metadata
End-to-End Hypoxia Data Management
Summary
• WCOS – demonstrates an operational, automated system– Readily extensible
• Coral Reef Early Warning System• Flower Garden Banks, other NMS
• Proposed hypoxia data management system ensures a strong integrated approach– Consistent data standards and procedures– Engages regional partners in data assembly– Supports discovery, access, delivery, and archive– Real-time, NRT and collections
Contacts:
Russ Beard, NCDDCActing Director
Sharon Mesick, NCDDCEcosystem Program Manager