NASA Earth Science Data Systems Program...Interoperates with data archives of other agencies and...
Transcript of NASA Earth Science Data Systems Program...Interoperates with data archives of other agencies and...
NASA Earth Science Data Systems Program
Martha Maiden Program Executive, Earth Science Data Systems Earth Science Subcommittee November 28, 2012
NASA’s Earth Observing System Data and
Information System
Manages data from several types of sources – satellite missions, aircraft investigations, PI-led dataset generation efforts Initiated in 1990 • In operation since 1994 with mature metadata for “heritage” datasets • In operation since 1997 supporting EOS instrument datasets starting
with the Tropical Rainfall Measuring Mission A petabyte-scale archive of environmental data that supports global climate change research Designed to receive, process, distribute and archive several terabytes of science data per day Provides a distributed information framework supporting a broad user community Open Data Policy – Data are openly available to all and free of charge except where governed by international agreements
• Consistent with Circular A-130 By having open application layers to the EOSDIS framework, we allow many other value-added services to access NASA’s vast Earth Science Collection Interoperates with data archives of other agencies and countries
2
Earth Science Measurements
Acrimsat • 12/99
Solar Output ACRIM
Terra • 12/99
Energy Budget CERES
Albedo, Aerosols, Vegetation
MISR
Lower Atmospheric
Chemistry MOPITT
Surface Imaging MODIS, ASTER
TRMM • 11/97 Rainfall
CERES, TMI VIRS, PR, LIS
Temperature Moisture
Sea Surface Winds
Ecosystem Dynamics
SORCE • 1/03 Solar
Irradiance TIM, SIM, XPS
Solstice
Aura • 7/04 Atmospheric Composition
HIRDLS, MLS, OMI
Trace\ Gases TES
Rain
Sea Ice
TROPOSPHERE O3, Precursor
Gases, Aerosols
Ocean Biology
Ocean Surface Topography
STRATOSPHERE O3, CIO, BrO, OH,
Trace Gases, Aerosols
MESOSPHERE Aqua • 5/02
Surface Imaging MODIS
Energy Budget CERES
Atmospheric Sounders AMSR-E
AIRS/AMSU/ HSB
Land Ice and Snow Cover
Ocean Circulation
Evaporation H2O
Fire Occurrence
Land Biology
Rain
CloudSat • 4/06 Cloud
Properties CPR
CALIPSO • 4/06 Cloud, Aerosol
Properties CALIOP
Jason • 12/01 Ocean
Altimetry Poseidon 2/ JMR/DORIS
OSTM • 6/08 Ocean Altimetry
Poseidon 3/ AMR/DORIS
Ice Bridge • 10/09 Ice
Topography and Altimetry
ATM
Volcanology
GRACE • 3/02
Gravity Field GPS, KBR
National Aeronautics and Space Administration
www.nasa.gov
Discipline-oriented Data Centers ASF SDC
SAR Products, Sea Ice,
Polar Processes, Geophysics
PO.DAAC Gravity, Sea Surface Temperature, Ocean Winds, Topography,
Circulation & Currents
NSIDC DAAC Snow and Ice, Cryosphere, Climate Inter-
actions, Sea Ice
LP DAAC Surface
Reflectance, Land Cover,
Vegetation Indices
SEDAC Human Interactions,
Land Use, Environmental Sustainability,
Geospatial Data
GES DISC Global Precipitation,
Solar Irradiance, Atmospheric Composition
and Dynamics, Global Modeling
CDDIS Space Geodesy,
Solid Earth
OBPG Ocean Biology,
Sea Surface Temperature
MODAPS/ LAADS
MODIS Level-1 and Atmosphere Data Products
LaRC ASDC Radiation Budget, Clouds, Aerosols,
Tropospheric Chemistry
GHRC DAAC Hydrologic Cycle,
Severe Weather Inter- actions, Lightning,
Atmospheric Convection ORNL DAAC
Biogeochemical Dynamics,
Ecological Data, Environmental
Processes
ECHO Architecture
ECHO is NASA’s middleware layer between Earth science data and users via a service-oriented architecture. Designed to improve the discovery and access of NASA data.
Acts as an order broker between end users and EOSDIS Data Centers who provide metadata for their data holdings and other Earth science-related data holdings. User-defined specialized “clients” can be easily developed to give science data users of their community access to data and services using ECHO’s open APIs.
Developed as a part of NASA’s
core data systems but
fully adaptable to the
needs/requirements of science
communities.
6
0
50
100
150
200
250
300
350
400
450
500
550
600
650
700
FY00 FY01 FY02 FY03 FY04 FY05 FY06 FY07 FY08 FY09 FY10 FY11 FY12 to date Sep
Millions
EOSDIS Key Metrics
7
ESDIS Project Supports Science System Elements
Data Centers 12
SIPS 14
Interfaces Interface Control Documents 22
Partnerships US 10 International 6
Missions
Science Data Processing 10
Archiving and Distribution 37
Instruments Supported 87
More information: EOSDIS: http://earthdata.nasa.gov
EOSDIS Products Delivered (Millions) ~635,000,000 products in 2012
>120X increase over 2000
Preliminary EOSDIS FY2012 Metrics
Unique Data Products 6,986
Distinct Users of EOSDIS Data and Services 1.49 M
Web Site Visits of 1 Minute or more 1.97 M
Average Daily Archive Growth 5.3 TB/day
Total Archive Volume 6.4 PB
End User Distribution Products 635 M
End User Average Daily Distribution Volume 14.8 TB/day
Evolution of EOSDIS Elements and Continuous Evolution
EOSDIS underwent a concerted process for “Evolution” in the 2005-2008 timeframe. •Led by EOSDIS Project Manager Esfandiari, OES Program Executive Martha Maiden •Recommendations by External Advisory Panel, led by Moshe Pniel •Effort under Terms of Reference signed by Ghassem Asrar, with Implementation Plan concurred by Mary Cleave
Resultant system reduced costs 30%, Information Technology currency, closer to science needs, with capability to continuously evolve. Continuous evolution investments about 10% of Multi-Mission Ops budget, and include system and data product/quality investments. ESS reviewed the EOSDIS System at their January 2008 meeting, reserving one hour on the agenda. ESS letter February 6, 2008 was complimentary (from NASA website). • “We were impressed by the success and clear sense of direction of that
program.” • “We are a long way from the EOSDIS problems of less than a decade ago!”
8
2015 Vision Goals Addressed
Vision Tenet Vision 2015 Goals
Archive Management NASA will ensure safe stewardship of the data through its lifetime. The EOS archive holdings are regularly peer reviewed for scientific merit.
EOS Data Interoperability
Multiple data and metadata streams can be seamlessly combined. Research and value added communities use EOS data interoperably with other
relevant data and systems. Processing and data are mobile.
Future Data Access and Processing
Data access latency is no longer an impediment. Physical location of data storage is transparent. Finding data is based on common search engines. Services invoked by machine-machine interfaces. Custom processing provides only the data needed, the way needed. Open interfaces and best practice standard protocols universally employed.
Data Pedigree Mechanisms to collect and preserve the pedigree of derived data products are readily available.
Cost Control Data systems evolve into components that allow a fine-grained control over cost drivers.
User Community Support
Expert knowledge is readily accessible to enable researchers to understand and use the data.
Community feedback directly to those responsible for a given system element.
IT Currency Access to all EOS data through services at least as rich as any contemporary science information system.
Feb 3, 2005 EEE
2015 Vision Goals Addressed
Vision Tenet Vision 2015 Goals
Archive Management NASA will ensure safe stewardship of the data through its lifetime. The EOS archive holdings are regularly peer reviewed for scientific merit.
EOS Data Interoperability
Multiple data and metadata streams can be seamlessly combined. Research and value added communities use EOS data interoperably with other
relevant data and systems. Processing and data are mobile.
Future Data Access and Processing
Data access latency is no longer an impediment. Physical location of data storage is transparent. Finding data is based on common search engines. Services invoked by machine-machine interfaces. Custom processing provides only the data needed, the way needed. Open interfaces and best practice standard protocols universally employed.
Data Pedigree Mechanisms to collect and preserve the pedigree of derived data products are readily available.
Cost Control Data systems evolve into components that allow a fine-grained control over cost drivers.
User Community Support
Expert knowledge is readily accessible to enable researchers to understand and use the data.
Community feedback directly to those responsible for a given system element.
IT Currency Access to all EOS data through services at least as rich as any contemporary science information system.
+
+
+ In Progress EEE As of 2012
+