VMLO: The Strategic, Operational and Tactical imperative for a Light Observation Squadron with
End-to-end Data Management for Operational Observation Systems
description
Transcript of End-to-end Data Management for Operational Observation Systems
![Page 1: End-to-end Data Management for Operational Observation Systems](https://reader035.fdocuments.us/reader035/viewer/2022070411/56814881550346895db58e5b/html5/thumbnails/1.jpg)
End-to-end Data Management for Operational Observation Systems
Presented to the Workshop on the
Ecological Impact of Hypoxia on Living Resources
Sharon MesickEcosystem Program Manager
NOAA Coastal Data Development CenterMarch 2007
![Page 2: End-to-end Data Management for Operational Observation Systems](https://reader035.fdocuments.us/reader035/viewer/2022070411/56814881550346895db58e5b/html5/thumbnails/2.jpg)
Overview
• End-to-end data management projects
– SEAMAP / Gulf of Mexico Hypoxia Watch
– WCO – NODC Conduit
• Adopting best practices for an Operational
Observation System
![Page 3: End-to-end Data Management for Operational Observation Systems](https://reader035.fdocuments.us/reader035/viewer/2022070411/56814881550346895db58e5b/html5/thumbnails/3.jpg)
Five Data Management Functions
• Discover– Look, find and get data, data products and information
• Access– To data and information
• Archival– Storage and maintenance
• Products– Quality Assurance, development and maintenance
• Outreach– Facilitate stakeholder awareness
![Page 4: End-to-end Data Management for Operational Observation Systems](https://reader035.fdocuments.us/reader035/viewer/2022070411/56814881550346895db58e5b/html5/thumbnails/4.jpg)
SEAMAP / Gulf of Mexico Hypoxia Watch
• Partnership project
– NMFS, CoastWatch, NCDDC
• Manual data development process
– Interoperable standards addressed
• Metadata, geospatial
– Discovery, access, archive requirements
met
• Multiple public access points
![Page 5: End-to-end Data Management for Operational Observation Systems](https://reader035.fdocuments.us/reader035/viewer/2022070411/56814881550346895db58e5b/html5/thumbnails/5.jpg)
Hypoxia Watch Data Management Flow
ProductsGIS & JPEG
NODCArchival
NCDDCMetadataCatalog
NCDDCClearinghouse
NodeMERMAid
NCDDC Data Development-------------------------
• Receive / QC data• Geospatially enable• Generate contours• Generate metadata• GIS Integration• Product generation
![Page 6: End-to-end Data Management for Operational Observation Systems](https://reader035.fdocuments.us/reader035/viewer/2022070411/56814881550346895db58e5b/html5/thumbnails/6.jpg)
Multiple Public Access Points
• Direct Data Access
– Ocean Archive System
• Data Access
Applications
– Internet GIS
• Metadata Search
– NCDDC Portal
– FGDC Clearinghouse
– Geospatial One Stop
• General Access
– Hypoxia Web site
![Page 7: End-to-end Data Management for Operational Observation Systems](https://reader035.fdocuments.us/reader035/viewer/2022070411/56814881550346895db58e5b/html5/thumbnails/7.jpg)
Gulf of Mexico Hypoxia Watch Program
http://www.ncddc.noaa.gov/ecosystems/hypoxia
![Page 8: End-to-end Data Management for Operational Observation Systems](https://reader035.fdocuments.us/reader035/viewer/2022070411/56814881550346895db58e5b/html5/thumbnails/8.jpg)
West Coast Observing System
• Partnership project– NMSP, CeNCOOS, PISCO, NODC, NCDDC, others
• Operational, end-to-end system– Automated, extensible system
– Interoperable standards addressed• OPeNDAP, metadata, geospatial
– Discovery, access, archive requirements met• Multiple public access points
![Page 9: End-to-end Data Management for Operational Observation Systems](https://reader035.fdocuments.us/reader035/viewer/2022070411/56814881550346895db58e5b/html5/thumbnails/9.jpg)
End-to-End Data Management
![Page 10: End-to-end Data Management for Operational Observation Systems](https://reader035.fdocuments.us/reader035/viewer/2022070411/56814881550346895db58e5b/html5/thumbnails/10.jpg)
Multiple Public Access Points
• Direct Data Access
– NODC OPeNDAP Server
– OPeNDAP.org
– Ocean Archive System
• Data Access
Applications
– Internet GIS
– WCOS Portal
• Metadata Search
– NCDDC Portal
– FGDC Clearinghouse
– Geospatial One Stop
• General Access
– SIMoN (Sanctuary
Integrated Monitoring
Network)
– CeNCOOS OceanObs
![Page 11: End-to-end Data Management for Operational Observation Systems](https://reader035.fdocuments.us/reader035/viewer/2022070411/56814881550346895db58e5b/html5/thumbnails/11.jpg)
![Page 12: End-to-end Data Management for Operational Observation Systems](https://reader035.fdocuments.us/reader035/viewer/2022070411/56814881550346895db58e5b/html5/thumbnails/12.jpg)
Access Catalog Holdings
Publish
HypoxiaCatalogWebsite
NCDDCFTP
Server
NODCRetrievalProcessHypoxia
Catalog
NCDDC WCO-NODC Conduit
-------------------------
HypoxiaWatch
LUMCON
NGoM/CI
Other
NODCOPeNDAP
Server
NODCArchival
NCDDCMetadataCatalog
NCDDCClearinghouse
NodeMERMAid
•Determine new data•Retrieve new data and metadata•Convert data•Call XML-RPC server to generate and publish metadata•Package results and send to FTP site
XML-RPC Server----------------
•Convert metadata to FGDC XML•Publish to various systems
Send Retrieve
Publish
Publish Publish Ingest
Send Metadata forConversion and Publishing
Retrieve newData and Metadata
End-to-End Hypoxia Data Management
![Page 13: End-to-end Data Management for Operational Observation Systems](https://reader035.fdocuments.us/reader035/viewer/2022070411/56814881550346895db58e5b/html5/thumbnails/13.jpg)
Summary
• WCOS – demonstrates an operational, automated system– Readily extensible
• Coral Reef Early Warning System• Flower Garden Banks, other NMS
• Proposed hypoxia data management system ensures a strong integrated approach– Consistent data standards and procedures– Engages regional partners in data assembly– Supports discovery, access, delivery, and archive– Real-time, NRT and collections
![Page 14: End-to-end Data Management for Operational Observation Systems](https://reader035.fdocuments.us/reader035/viewer/2022070411/56814881550346895db58e5b/html5/thumbnails/14.jpg)
References:http://www.ngi.msstate.edu/hypoxia
Contacts:
Russ Beard, NCDDCActing Director
Sharon Mesick, NCDDCEcosystem Program Manager