NASA’s EOSDIS and VOiG Objectives: A Comparison
description
Transcript of NASA’s EOSDIS and VOiG Objectives: A Comparison
VOiG Conference June 12, 2007 1
NASA’s EOSDIS and VOiG Objectives:A Comparison
Presentation to the Virtual Observatories in Geosciences (VOiG) Conference
Denver, COJune 12-15, 2007
VOiG Conference June 12, 2007 2
Theme/Outline
• EOSDIS Evolution Plans Parallel eGY Objectives of the VOiG– EOSDIS Background– EOSDIS Vision for Evolution (Tenets)– eGY objectives– Mapping between EEE and eGY– EOSDIS and VOs
VOiG Conference June 12, 2007 3
EOSDIS Background
• NASA’s EOSDIS is a petabyte-scale archive of environmental data that supports global climate change research
• EOSDIS provides for – Data ingest– Data processing– Data distribution– Archive management– User Services
• Holdings as of FY2006– Volume: 4.9 PB– Collections: >2K datasets– Granules: 56 million files– Browse: 14 million files
ACRIMSAT(12/99)
Solar Output
ACRIM
SORCE (1/03)Solar Irradiance
TIM, SIM, XPSSOLSTICE
Terra (12/99)EnergyBudget
CERES
Albedo,Aerosols,Vegetation
MISR
SurfaceImaging
MODISASTER
LowerAtmospheric
Chemistry
MOPITT
Aqua (5/02)EnergyBudget
CERES
SurfaceImaging
MODIS
AtmosphericSounders
AMSR-EAIRS/AMSU/HSB
Aura (7/04)TraceGases
TES
AtmosphericDynamics and
Chemistry
HIRDLS,MLS, OMI
Mesosphere
Stratosphere
Troposphere
TRMM(11/97)
Energy Budget
CERES, LIS
EvaporationH2O
Sea Surface Winds
OceanBiology
LandBiology
Volcanology
Ecosystem Dynamics
O3
precursor gases,
aerosols
Mission & Science 04102007.ppt
O3ClOBrOOH
trace gasesaerosols
Land Ice and Snow Cover
Rain
QuikScat(6/99)
Sea Surface Winds
SeaWinds
Temperature Moisture
Sea Ice
Fire Occurrence
METEOR 3M(12/01)
Aerosol Trace Gases
SAGE III
CloudSat(4/06)
Cloud Properties
CPR CALIPSO(4/06)
Cloud, AerosolProperties
CALIOP
Jason (12/01)Ocean Altimetry
Poseidon/JMR/DORIS
Rain
ICESat(1/03)
Ice Topographyand Altimetry
GLAS
ACRIMSAT(12/99)
Solar Output
ACRIM
ACRIMSAT(12/99)
Solar Output
ACRIM
SORCE (1/03)Solar Irradiance
TIM, SIM, XPSSOLSTICE
SORCE (1/03)Solar Irradiance
TIM, SIM, XPSSOLSTICE
Terra (12/99)EnergyBudget
CERES
Albedo,Aerosols,Vegetation
MISR
SurfaceImaging
MODISASTER
SurfaceImaging
MODISASTER
LowerAtmospheric
Chemistry
MOPITT
Aqua (5/02)EnergyBudget
CERES
SurfaceImaging
MODIS
SurfaceImaging
MODIS
AtmosphericSounders
AMSR-EAIRS/AMSU/HSB
AtmosphericSounders
AMSR-EAIRS/AMSU/HSB
Aura (7/04)TraceGases
TES
AtmosphericDynamics and
Chemistry
HIRDLS,MLS, OMI
Mesosphere
Stratosphere
Troposphere
TRMM(11/97)
Energy Budget
CERES, LIS
TRMM(11/97)
Energy Budget
CERES, LIS
EvaporationH2O
Sea Surface Winds
OceanBiology
LandBiology
Volcanology
Ecosystem Dynamics
O3
precursor gases,
aerosols
Mission & Science 04102007.ppt
O3ClOBrOOH
trace gasesaerosols
Land Ice and Snow Cover
Rain
QuikScat(6/99)
Sea Surface Winds
SeaWinds
QuikScat(6/99)
Sea Surface Winds
SeaWinds
Temperature Moisture
Sea Ice
Fire Occurrence
METEOR 3M(12/01)
Aerosol Trace Gases
SAGE III
METEOR 3M(12/01)
Aerosol Trace Gases
SAGE III
CloudSat(4/06)
Cloud Properties
CPR
CloudSat(4/06)
Cloud Properties
CPR CALIPSO(4/06)
Cloud, AerosolProperties
CALIOP
CALIPSO(4/06)
Cloud, AerosolProperties
CALIOP
Jason (12/01)Ocean Altimetry
Poseidon/JMR/DORIS
Jason (12/01)Ocean Altimetry
Poseidon/JMR/DORIS
RainRain
ICESat(1/03)
Ice Topographyand Altimetry
GLAS
ICESat(1/03)
Ice Topographyand Altimetry
GLAS
EOS 24 Measurements
VOiG Conference June 12, 2007 4
EOSDIS ContextFlight Operations,Data Capture,Initial Processing,Backup Archive
Data Transportto
DAACS/SIPS
Science Data Processing,Info Mgmt,Data Archive,& Distribution
Distribution,Access,Interoperability,Reuse
EOSSpacecraft
Internet
Value-AddedProviders
InteragencyData
Centers
Int’l Partners& Data Centers
Data Acquisition
White SandsComplex(WSC)
Tracking& Data
Relay Satellite(TDRS)
ResearchUsers
EducationUsers
DistributedActive
ArchiveCenters
InstrumentTeams and
SIPSs
Data Processing
&MissionControl
EOS Polar Ground Stations
MediaPublic
ESIP2/3’s
RESACs
RACs
(Search,order,distribution)
(Distribution)
VOiG Conference June 12, 2007 5
EOSDIS - Distributed Data Centers
JPLMLS, TES
San DiegoACRIM
NCAR, U of Col.HIRDLS, MOPITT, SORCE
GSFCGLAS, MODIS, OMI, OCDPS
LaRCCERES, SAGE III
GHRCAMSR-E, LIS
SIPS DAAC
GHRC
VOiG Conference June 12, 2007 6
EOS Clearinghouse (ECHO)
Data Registry
CollectionsGranules Browse Images
• ECHO is the middleware between EOS data and science data users via a service-oriented architecture– Data Partners provide metadata for their EOS data holdings and
other Earth science-related data holdings– Client Partners develop software (“clients”) to give science data
users access to ECHO’s registries using ECHO’s open APIs– Science data users search ECHO's registries and access data and
services using an ECHO client
ECHO
ExtendedServicesRegistry
DataPartner
APIs
ClientPartner
APIs
DAACs
Other DataPartners
Modeling,Applications,
Decision SupportSystems
General-Purpose
GUIs
TailoredGraphical User
Interfaces
Client Partners Data Partners
End User
VOiG Conference June 12, 2007 7
EOSDIS Evolution
• In 2005, NASA began a formal effort to reinvigorate EOSDIS– Known as EOSDIS Evolution
• The major objectives of Evolution are:– Improve response to science needs– Facilitate a more distributed environment– Manage archive volume growth– Upgrade aging systems and components– Reduce recurring costs of operations and sustaining
engineering
VOiG Conference June 12, 2007 8
EOSDIS Evolution Benefits
• EOSDIS developed a vision for the 2015 timeframe – Vision description on next slide
• Key features of the EOSDIS Evolution approach– Incorporated ideas from data center experiences– Encouraged data centers to assume leadership of development
and sustaining engineering responsibilities – Reduced dependence on COTS products– Transitioned responsibilities among elements transparently to
users– Introduced efficiencies in services and cost management
• processing on demand• on-line archive storage• commodity platforms
• Implementation began in 2006
VOiG Conference June 12, 2007 9
EOSDIS – Vision Tenets
Vision Tenet Vision 2015 Goals
Archive Management
NASA will ensure safe stewardship of the data through its lifetime. The EOS archive holdings are regularly peer reviewed for scientific merit.
EOS Data Interoperability
Multiple data and metadata streams can be seamlessly combined. Research and value added communities use EOS data interoperably with other
relevant data and systems. Processing and data are mobile.
FutureData Access and
Processing
Data access latency is no longer an impediment. Physical location of data storage is irrelevant. Finding data is based on common search engines. Services invoked by machine-machine interfaces. Custom processing provides only the data needed, the way needed. Open interfaces and best practice standard protocols universally employed.
Data Pedigree Mechanisms to collect and preserve the pedigree of derived data products are
readily available.
Cost Control Data systems evolve into components that allow a fine-grained control over
cost drivers.
User Community Support
Expert knowledge is readily accessible to enable researchers to understand and use the data.
Community feedback directly to those responsible for a given system element.
IT Currency Access to all EOS data through services at least as rich as any contemporary
science information system.
VOiG Conference June 12, 2007 10
eGY Objectives/Declarations
Reference: http://www.egy.org/declaration.html
Article 1 Data accessEarth system data and information should be made available electronically with interoperable approaches that facilitate open access
Article 2 Data release
Owners, custodians, and creators of Earth system data should work together to share their digital information with the world community, though in a manner that respects intellectual property rights and security constraints.
Article 3 Data description
Providers and users of Earth system data and information should share descriptions of structure, content, and contexts to facilitate interoperability and the discovery of relationships within and between information resources
Article 4 Data persistenceData and information about the Earth system should be preserved and sustained in forms that are both software and hardware independent so as to be openly accessible today and in the future
Article 5 Data rescueEffort should be made to identify and rescue critical Earth system data and ensure persistent access to them.
Article 6Common standards and cooperation
Standards for interoperability should be identified, created, and implemented through international collaboration.
Article 7 Capability buildingCommunities with advanced information technology and communications capabilities should contribute to developing such capabilities elsewhere to reduce the digital divide.
Article 8Education and public outreach
Students, scientists, decision-makers, and the public should be informed about and be enabled to contribute to our understanding and management of Earth system phenomena that impact human survival
VOiG Conference June 12, 2007 11
Mapping of EEE vision to eGY objectives
EOSDIS Vision ArticleeGY Vision and
Objectives
Archive Management 4 Data persistence
EOS Data Interoperability1 Data access
3 Data description
Future Data Access and Processing
2 Data release
6Common standards and cooperation
Data Pedigree 5 Data rescue
User Community Support 8Education and public outreach
IT Currency 7 Capability building
Cost Control
VOiG Conference June 12, 2007 12
Comparison Points
• Note the similarities in objectives; almost a one-to-one relationship
• Consistent with EOSDIS evolving into more of a distributed data system– EOSDIS supports a pre-planned community of
providers, but makes data available to all interested users in the world community
– Recognizes that access to outside data is necessary to develop the data products and models for meeting the science objectives
• Given the common goals, EOSDIS and VOs should understand how to work together
VOiG Conference June 12, 2007 13
EOSDIS and VxOs – Discussion Questions
• How can EOSDIS and VOs benefit from working together?– Could sharing data lead to more meaningful
scientific products?• Earth science data (from EOSDIS) and
heliospheric sciencedata (from space science VOs)
– Growing importance of space weather impacts on human activities
– Upper atmospheric interactions
– Are there other Earth science disciplines that would benefit from sharing data and ideas?
VOiG Conference June 12, 2007 14
EOSDIS and VxOs – Discussion Questions
• How would the systems interact?– How would a users interact with two (or more)
systems?• common query approaches• registries of capabilities• product catalogs
– What level of services provided to the data provider, data user?
• EOSDIS has explored these issues in developing ECHO– How do you accomplish data fusion between the
systems?
• What is the science use case for EOSDIS interaction with a virtual observatory?
VOiG Conference June 12, 2007 15
Summary
• EOSDIS supports a variety of data providers and provides data services to many users through its network of data centers and data access mechanisms– Serves as a distributed data system for NASA Earth
science data– Continuously improving the means to access and
share data• The VO paradigm demonstrates alternative
ways to performing similar functions• Exchange of information between EOSDIS and
VO participants would be beneficial