EOSDIS Status 10/16/2008 Dan Marinelli, Science Systems Development Office.

10
EOSDIS Status 10/16/2008 Dan Marinelli, Science Systems Development Office

Transcript of EOSDIS Status 10/16/2008 Dan Marinelli, Science Systems Development Office.

Page 1: EOSDIS Status 10/16/2008 Dan Marinelli, Science Systems Development Office.

EOSDIS Status

10/16/2008

Dan Marinelli, Science Systems Development Office

Page 2: EOSDIS Status 10/16/2008 Dan Marinelli, Science Systems Development Office.

EOSDIS Context

ACCESS

Distributed Active Archive Centers

(DAACs)

Instrument Science Team Facilities

(SCFs and SIPSs)

Data Assimilation

Model

Adapted from

REASoN

Page 3: EOSDIS Status 10/16/2008 Dan Marinelli, Science Systems Development Office.

EOSDIS Mission Profile

file name: EOS missions vs time7.xls

1991 1992 1993 1994 1995 1996 1997 1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 2013 2014

1991 1992 1993 1994 1995 1996 1997 1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 2013 2014

10/1984 - 2 years planned mission life

10/1978 - 10 yrs m life

ERBS (SAGE II)

ERS-1

NIMBUS-7 (TOMS I)

Meteor 3 TOMS (TOMS II)

UARS

TOPEX/Poseidon

JERS-1

OrbView-2 (SeaStar)

ERS-2

Earth Probe TOMS (TOMS III)

RadarSat 1

ADEOS I (Midori)

Jason-1

ACRIMSAT

Meteor 3M

EOS Aqua

ICESat

EOS Aura

SORCE

3 yrs

Landsat 7

QuikSCAT

EOS Terra

TRMM CERES data only Heritage Missions

EOS Missions

Extended Mission Life

Planned Mission Life

4 yr Data Access Period(includes 3 yr reprocessing)

No Planned EOL

KEY

3 yr Reprocessing Pd

ADEOS II (Midori II) 3 yrs

Page 4: EOSDIS Status 10/16/2008 Dan Marinelli, Science Systems Development Office.

Earth Science Data and Information System (ESDIS) Project - GSFC Code 423• Objective - Develop and Operate Earth Observing System Data and Information System (EOSDIS)

– A production capability for standard science data products from EOS instruments– An “active archive” of Earth science data from EOS and other past and present Earth science missions – A distributed information framework (data centers, system elements, interfaces and data model) supporting

EOS investigators and other users in science, government, industry, education, and policy• Organizations: ESDIS Project meets its requirements by funding and managing several

organizations including– “Large” industrial: Raytheon (EMD)– Distributed Data Centers - NASA Centers (GSFC, JPL, LaRC), other government agencies (EDC, ORNL),

Universities (ASF, NSIDC, SEDAC)– Science Investigator-led Processing Systems (SIPSs) - NASA Centers (GSFC, JPL, LaRC, MSFC), NCAR

• Project Components:– SDPS - System for ingesting, processing, archiving and distributing data– Data Centers - Science System Operations– EOSDIS Networks - Transportation of mission & science data– SIPS - Systems developed and operated by PIs or Team Leaders for generation of standard data products

for delivery to Data Centers • Status

– EOSDIS has been successfully supporting EOS missions since 1999– Volume of data available from EOS missions continues to grow. Current volume at 4.9 petabytes. – EOSDIS archive contains current as well as legacy Earth science data - more than 2700 datasets – In FY 2007, over 100 million products were distributed to just over 165,000 unique users; approximately 3.0

million distinct users accessed the EOSDIS data centers. – ESDIS Project is working closely with the user community to enhance systems that support and provide

access to data• Web Site: http://eos.nasa.gov/eosdis

Page 5: EOSDIS Status 10/16/2008 Dan Marinelli, Science Systems Development Office.

Monthly Distribution by Products (Sep 2007 - Aug 2008)

0

2,000

4,000

6,000

8,000

10,000

12,000

14,000

16,000

18,000

20,000

Sep-07 Oct-07 Nov-07 Dec-07 Jan-08 Feb-08 Mar-08 Apr-08 May-08 Jun-08 Jul-08 Aug-08

Month

Pro

du

ct

Cou

nts

(in

1000's

)ASF EDC GSFC JPL LaRC Latis NSIDC ORNL MODAPS GHRC SEDAC

Page 6: EOSDIS Status 10/16/2008 Dan Marinelli, Science Systems Development Office.

Monthly Distribution by Products (Sep 2006 - Aug 2008)

0

2,000

4,000

6,000

8,000

10,000

12,000

14,000

16,000

18,000

20,000S

ep

-06

Oct-

06

Nov-0

6

Dec-0

6

Jan

-07

Feb

-07

Mar-

07

Ap

r-07

May-0

7

Jun

-07

Jul-

07

Au

g-0

7

Sep

-07

Oct-

07

Nov-0

7

Dec-0

7

Jan

-08

Feb

-08

Mar-

08

Ap

r-08

May-0

8

Jun

-08

Jul-

08

Au

g-0

8

Month

Pro

du

ct

Cou

nts

(in

1000's

)

ASF EDC GSFC JPL LaRC Latis NSIDC ORNL MODAPS GHRC SEDAC

Page 7: EOSDIS Status 10/16/2008 Dan Marinelli, Science Systems Development Office.

Monthly Distribution Volume (Sep 2006 - Aug 2008)

0

50

100

150

200

250S

ep

-06

Oct-

06

Nov-0

6

Dec-0

6

Jan

-07

Feb

-07

Mar-

07

Ap

r-0

7

May-0

7

Jun

-07

Jul-

07

Au

g-0

7

Sep

-07

Oct-

07

Nov-0

7

Dec-0

7

Jan

-08

Feb

-08

Mar-

08

Ap

r-0

8

May-0

8

Jun

-08

Jul-

08

Au

g-0

8

Month

Volu

me (

TB

)

ASF EDC GSFC JPL LaRC Latis NSIDC ORNL MODAPS GHRC SEDAC

Page 8: EOSDIS Status 10/16/2008 Dan Marinelli, Science Systems Development Office.

Recent Progress– Transition from EOS Data Gateway (EDG) to ECHO/WIST Underway.

NSIDC, Oak Ridge, and Alaska DAACs have completed transition. Over 1600 new users currently accessing EOS data via ECHO/WIST.

– Will complete once ECS 7.21 is operational at all sites• 7.21 was deployed and includes ingest of all data via Data Pool, conversion

to an XML archive for metadata, distribution enhancements

Page 9: EOSDIS Status 10/16/2008 Dan Marinelli, Science Systems Development Office.

Plans for the next year– ECS Release 7.22: work underway for final delivery planned

under EMD Contract - will include:• Custom code changes to support transition to disk-based

archive• Improvements to Bulk Metadata Generation Tool to automate

response to error conditions in interface to ECHO• Enhanced Checksumming, including validation of integrity of

files in the datapool and archive• Operating System and Compiler Upgrades (including custom

code changes)• Code simplification - complete removal of all remnants of

Science Data Server and heritage Storage Management components (replaced in Release 7.21)

Page 10: EOSDIS Status 10/16/2008 Dan Marinelli, Science Systems Development Office.

EOSDIS Futures• Future spending profile reflects reductions being achieved with

evolution– GES DISC off of ECS; MODAPS performs MODIS processing and

L1/atmospheres archive and distribution– ASDC DAAC now supports CERES with their ANGe system; ECS to

remain in place through at least 7.22 for other EOS instruments– ECS evolution development to be complete by March 2009 – has resulted

in greatly reduced physical, SLOC footprint, and thus cost to maintain• ECS contract expires May 2009; ESDIS is putting together RFP for the

follow-on ECS Evolution and Development Contract• THG grant renewed 7/2008 for 3 years• New NASA guideline implies we may not be able to host this workshop

in the future – we’ll keep you posted