Earth  Science  Data  and    Informa2on  System  (ESDIS)  Project  

John Moses NSIDC DAAC Users Working Group October 14, 2010

10/11/10 2

EOSDIS  Products  Delivered:  FY00  thru  Sep  2010  

10/11/10 3

Monthly Distribution to Users (Oct 2009 – Sep 2010)

10/11/10 4

Monthly Products/Volume Distribution (Sep 2010)

Earth  Science  Data  and    Informa2on  System  (ESDIS)  Project  

5 10/11/10

FY09 Metrics EOSDIS   NSIDC  

Unique Data Products > 4000 204

Distinct Users of EOSDIS Data and Services > 910K ~300K

Web Site Visits of 1 Minute or more > 1M ~440K

Average Daily Archive Growth 1.8 TB/day ~35 GB/day

Total Archive Volume 4.2 PB ~64 TB

End User Distribution Products > 254M 17.3M

End User Average Daily Distribution Volume 6.7 TB/day 0.33 TB/day

American Customer Satisfaction Index (ACSI) 77 77

10/11/10 Maiden 6

FY2010  Data  Center  Web  Ac2vity  –  Sep  2010  

EOSDIS  ACSI  Customer  Sa@sfac@on  Survey  2009:    Rela@ve  Rankings  

7

73

77

69

30 40 50 60 70 80

E-Business News & Information

(Public/Private Sectors)

NASA EOSDIS

Federal Government Overall

!   EOSDIS sponsors an annual independent customer survey in conjunction with the American Customer Satisfaction Index (ACSI).

!   EOSDIS consistently exceeds the Federal Government average !   Ratings in the mid to upper 70s are considered “very good” by the

rating organization, the CFI Group !   2009 Survey results based on 3842 responses (10%)

10/11/10 NSIDC score was 77 based on 312 responses (8%)

(4673 Invited; 911 Bounced Back; 3762 Received Invitation)

EOSDIS  Facili2es  

8

Data centers, collocated with centers of science discipline expertise, archive and distribute standard data products

produced by Science Investigator-led Processing Systems (SIPSs)

ASF DAAC SAR Products Sea Ice, Polar

Processes

SEDAC Human Interactions in Global Change

LP DAAC Land Processes

& Features

PO.DAAC Ocean Circulation

Air-Sea Interactions ASDC

Radiation Budget, Clouds, Aerosols, Tropo Chemistry

ORNL DAAC Biogeochemical

Dynamics, EOS Land Validation

GES DISC Atmos Composition &

Dynamics, Global Modeling, Hydrology,

Radiance

LAADS/ MODAPS

Atmosphere

OBPG Ocean Biology & Biogeochemistry

GHRC Hydrological Cycle &

Severe Weather

CDDIS Crustal Dynamics

Solid Earth NCAR, U of Col. HIRDLS, MOPITT,

SORCE GSFC

GLAS, MODIS, OMI, OBPG

LaRC CERES, SAGE III

GHRC AMSR-E, LIS

JPL MLS, TES

San Diego ACRIM

NSIDC DAAC Cryosphere, Polar

Processes

SIPSs

Key Data

Center

10/11/10

9

Data Center Operations

SMD E. Weiler

Astro- physics

Helio- physics

Planetary

Research J. Kaye

Applied Science

L. Friedl (act)

Flight Programs

S. Volz Program Executive for

Earth Science Data Systems M. Maiden

Program Executive for Operating Missions

C. Yuhas

Earth Science Data and Information

System (ESDIS) Project D. Lowe

Science Systems Development

Office D. Marinelli

Science Operations

Office J. Behnke

Flight Projects

G. Morrow

Appl. Eng. &

Technology

Sciences &

Exploration

Planetary Science

Astro- physics

GSFC R. Strain

Earth Science

E. Ketchum

400

500

600

423

.. .

.. .

Terrestrial Ecology •  D. Wickland

ORNL DAAC

Program Scientists

Physical Oceanography •  E. Lindstrom

Physical Oceanography

DAAC

Atmospheric Dynamics •  R. Kakar

GSFC Earth Sciences DISC

Ocean Biology & Biogeochemistry •  P. Bontempi

Earth Surface and Interior •  J. LaBrecque

Crustal Dynamics

DIS

Cryosphere Science •  T. Wagner

National Snow and Ice Data

Center

420

430

440

.. .

.. .

Earth Science & Data Systems

Upper Atmosphere Research •  K. Jucks

Global Hydrology

Resource Center

Ocean Biology Processing

Group

SAR Systems •  C. Dobson

ASF SAR Data Center

Socioeconomic Data & Applic- ations Center

Applications •  C. Dobson

L1 and Atmos. Data •  TBD MODAPS/

LAADS

Earth Science

M. Freilich

Application Scientists

Land Processes •  W. Turner Land

Processes DAAC

Atmospheric Radiation •  H. Maring Atmospheric

Sciences Data Center

10/11/10

DAAC  User  Working  Groups  

•  Members  represent  discipline  interests  of  the  diverse  user  community.  

•  Purpose  of  the  UWGs  are: –  provide guidance on DAAC data management priorities

and science goals –  provide oversight and guidance on DAAC activities,

including data set acquisition, development of value-added products, user support, development activities, and operational functions

–  provide recommendations for annual work plans and long-range planning  

10 10/11/10

What’s  Coming  Up  

•  Planning  and  implemen2ng  a  Near-­‐Real-­‐Time  Processing  System  to  serve  needs  of  NASA’s  Research,  Applied  Science,  and  Decision  Support  Partners  

–  LANCE  User  Working  Group  mee2ng  Nov  16-­‐17th  at  UMUC  

•  Technology  Infusion  -­‐  Kicked  off  mid  July;  NSIDC    valued  par2cipa2on:  –  Consolidated  Level  2  Swath  Search  and  Subse]ng  Web  services  (suppor2ng  PO-­‐DAAC)  

–  HDF5  compliant  SAR  data  products  (suppor2ng  ASF  with  ORNL)  

–  Simple  Subset  Wizard  (suppor2ng  GES-­‐DISC)  

•  Distribu2on  and  management  of  MEaSURES  datasets  as  they  mature  

•  Con2nuous  focus  on  improved  EOSDIS  data  access  and  interoperability  within  the  next  year  

–  Enhanced  WIST  (ECHO  client  called  Reverb)  to  go  opera2onal  in  May  2011  

–  Enhanced  ECHO  Ingest  API  to  allow  ingest  of  ISO  19115  &  other  metadata  in  Mar  2011  

–  Uniform  user  registra2on  system  being  developed  and  implemented  across  DAACs  

–  Developing  a  coherent  Web  presence  for  EOSDIS  data  services  

•  Advance  planning  science  system  support  for  Decadal  Survey  missions  

11 10/11/10

NSIDC  DAAC  contribu2ons  

•  Improved  access  to  NSIDC  DAAC  datasets  as  a  result  of  going  to  a  completely  online  archive  –  ESDIS  is  enhancing  SDPS  and  ECHO  so  that  NSIDC  and  other  DAACs  can  

easily  integrate  addi2onal  on-­‐demand  processing  services  

•  Developing  ISO  19115  metadata  standard  profiles  for  EOSDIS  –  Tiger  Team  formed,  ESDIS  lead  (Andy  Mitchell)  with  NSIDC  technical  

exper2se  (Siri  Joda),  as  well  as  experts  from  ECHO,  GCMD,  ECS,  mission  ground  systems  and  ISO  metadata  experts.  

–  Determining  the  op2mal  path  for  integra2on  of  current  stakeholders’  data  models  with  ISO  metadata  standards.  

–  Important  for  enabling  services  and  searches  across  the  board  

12

Backup  

13

ECHO/WIST/GCMD  Status  •  ECHO  employs  a  service-­‐oriented  architecture  to  provide  middleware  between  EOS  data  

providers  and  science  data  users:  –  Data  Partners  export  metadata  to  ECHO  for  their  Earth  science-­‐related  data  holdings  –  Client  Partners  use  ECHO’s  open  APIs  to  develop  user  interfaces  –  Science  data  users  search  ECHO's  holdings  and  access  data  and  services  using  a  general  

purpose  or  tailored  ECHO  client  •  Warehouse  Inventory  Search  Tool  (WIST):    ECHO’S  general  purpose,  web-­‐based  WIST  client  

allows  users  to  submit  cross-­‐discipline  queries  using  spa2al  and  temporal  criteria  •  Current  Holdings:  

–  3,092  Collec2ons,  with  87  million  Granules,  and  57  million  Browse  products  –  Data  Partners:    ASF,  GHRC,  GSFC,  LAADS,  LARC  (  ECS  &  ANGe),  LPDAAC,  NSIDC,  ORNL,  

SEDAC,USGS/  Landsat,  PO  DAAC  •  Enhancements  status:  

–  Improved  opera2onal  availability  by  deploying  a  fully  redundant  system  with  automated  failover  

–  Developing  a  new  general  purpose  web-­‐based  client  employing  new  technology  –  Simplifying  end-­‐user  Client  development  by  providing  pre-­‐built  components  to  allow  for  

rapid,  low  cost  client  deployment  •  Global  Change  Master  Directory  (GCMD)  Holdings:  

–   >30,000  descrip2ons  of  Earth  science  data  sets,  services  and  ancillary  descrip2ons  covering  all  aspects  of  Earth  and  environmental  sciences  

–  More  ac2ve  than  ever….>100  portals  already  in  use  –  URL:  hmp://gcmd.nasa.gov  

14 10/11/10

User  Registra2on  

•  EOSDIS  will  implement  a  system-­‐wide  user  registra2on  system  in  the  near-­‐term  – One  set  of  creden2als  to  access  data  – Users  will  self-­‐register  with  username  and  password  recovery  

•  Prototype  capability  exists  for  the  LANCE  systems  

•  ESDIS  completed  a  study  for  the  opera2onal  system  

15 10/11/10

The  Land,  Atmosphere  Near-­‐real-­‐2me  Capability  for  EOS  (LANCE)  

16

•  Building on existing EOSDIS elements provides data from MODIS, OMI, AIRS, MLS, and AMSR-E instruments in near real-time (< 3 hours from observation)

•  Utilizes PGE Code from Standard Science Products, but relaxes requirements for ancillary data inputs

•  High operational availability

•  Applications of LANCE data include:

–  Numerical weather & climate prediction/forecasting

–  Monitoring of Natural Hazards

–  Disaster Relief

–  Agriculture

–  Air quality

–  Homeland Security

10/11/10

EOSDIS  Data  Distribu@on  in  FY09  

European Union countries

17 10/11/10

ESDIS  Project  

18 10/11/10

Project Manager Dawn Lowe

Deputy Project Manager/Operations Jeanne Behnke

Deputy Project Manager/Systems Vacant

Deputy PM/Resources J. Steve Metcalf

Assistant Project Manager H. K. “Rama” Ramapriyan

Science Systems Development Office

Dan Marinelli

System Manager Karen Michael

Financial Manager Diane Hronek

Systems Engineering

Development & Sustaining Engineering

Science Operations Office Jeanne Behnke

Data Center Engineers

Networks Engineer

Outreach/ User Support

Resource Analysts Barbara Haskell Tami Baldon Rochelle Knick

John Moses Anne Koslosky Kevin Murphy Alfreda Hall Drew Kittel

Carol Boquist Kevin Kranacs Evolution/SW Dev Mgr Vacant ECHO Development & Ops Andrew Mitchell

System Engineer Dan Marinelli (Acting) Hardware Engineer Chris Bock

Project Support Lucia Gayhart

Advanced Planning & Interoperability

Frank Lindsay

19

Earth Science Measurements for Climate Change Studies

ACRIMSAT (12/99)

Solar Output

ACRIM

SORCE (1/03) Solar Irradiance

TIM, SIM, XPS SOLSTICE

Terra (12/99) Energy Budget

CERES

Albedo, Aerosols, Vegetation

MISR

Surface Imaging

MODIS ASTER

Lower Atmospheric

Chemistry

MOPITT

Aqua (5/02) Energy Budget

CERES

Surface Imaging

MODIS

Atmospheric Sounders

AMSR-E AIRS/AMSU/HSB

Aura (7/04) Trace Gases

TES

Atmospheric Dynamics and

Chemistry

HIRDLS, MLS, OMI

Mesosphere

Stratosphere

Troposphere

TRMM (11/97)

Energy Budget

CERES, LIS

Evaporation H2O

Sea Surface Winds

Ocean Biology

Land Biology

Volcanology

Ecosystem Dynamics

O3 precursor

gases, aerosols

Mission & Science 05142008.ppt

O3 ClO BrO OH

trace gases aerosols

Land Ice and Snow Cover

Rain

QuikScat (6/99)

Sea Surface Winds

SeaWinds

Temperature Moisture

Sea Ice

Fire Occurrence

METEOR 3M (12/01)

Aerosol Trace Gases

SAGE III

CloudSat (4/06)

Cloud Properties

CPR CALIPSO (4/06)

Cloud, Aerosol Properties

CALIOP

Jason (12/01) Ocean Altimetry

Poseidon/ JMR/DORIS

Rain

ICESat (1/03)

Ice Topography and Altimetry

GLAS

EOSDIS  Context  

20

Tracking & Data Relay Satellite

(TDRS)

Instrument Teams and Science

Investigator-led Processing System

(SIPS)

EOS Spacecraft

EOS Data and Operations System

(EDOS) Data Processing

White Sands Complex

(WSC)

EOS Polar Ground Stations

Internet

(Search, order,

distribution)

Research

Education

Value-Added Providers

Interagency Data Centers

International Partners

Earth System Models

Decision Support Systems

Distribution and Data Access

Data Acquisition Flight Operations, Data Capture,

Initial Processing, Backup Archive

Data Transport to Data Centers/

SIPSs

Science Data Processing, Data Mgmt, Interoperable

Data Archive, & Distribution

NASA Integrated Services Network (NISN)

Mission Services

Mission Operations Science Operations

EOS Operations Center (EOC)

Mission Control

ESMO ESDIS

EOSDIS Data

Centers

EOSDIS  Simplified  Architecture  

21

Science Investigator-led

Processing Systems (SIPSs)

Initial Data Processing

EOS Data and Operations System

(EDOS)

Local Science Community

Archive &

General User Distribution

Services

Distributed Data Centers

L0 Data

L0 Data

Higher Level

Products

L0 Data

Product Orders Metadata &

Browse Exports

Value-Added Community

Services

Service Registry

ECHO Client Web Service Interface

Data Registry

Community-Specific GUI Clients

Modeling, Applications, and Decision Support

Systems

WIST General Purpose

GUI Client

Online Data Web/ftp

Data Access

General User Community

Product Generation