NASA COMMON METADATA REPOSITORY (CMR) Update and Near Term Plans – CEOS WGISS 37 1 Andrew Mitchell...

22
NASA COMMON METADATA REPOSITORY (CMR) Update and Near Term Plans – CEOS WGISS 37 1 Andrew Mitchell Earth Science Data and Information Systems (ESDIS) National Aeronautics and Space Administration (NASA Cocoa Beach Florida - April 15, 2014

Transcript of NASA COMMON METADATA REPOSITORY (CMR) Update and Near Term Plans – CEOS WGISS 37 1 Andrew Mitchell...

Page 1: NASA COMMON METADATA REPOSITORY (CMR) Update and Near Term Plans – CEOS WGISS 37 1 Andrew Mitchell Earth Science Data and Information Systems (ESDIS) National.

1

NASA COMMON METADATA REPOSITORY (CMR)Update and Near Term Plans – CEOS WGISS 37

Andrew MitchellEarth Science Data and Information Systems (ESDIS)National Aeronautics and Space Administration (NASA

Cocoa Beach Florida - April 15, 2014

Page 2: NASA COMMON METADATA REPOSITORY (CMR) Update and Near Term Plans – CEOS WGISS 37 1 Andrew Mitchell Earth Science Data and Information Systems (ESDIS) National.

2

In a world where metadata matters…

Page 3: NASA COMMON METADATA REPOSITORY (CMR) Update and Near Term Plans – CEOS WGISS 37 1 Andrew Mitchell Earth Science Data and Information Systems (ESDIS) National.

3

URSGIBSEMSEOSDIS

Discovery Tools

DAACsNear Real

Time (LANCE)

???CMR

Page 4: NASA COMMON METADATA REPOSITORY (CMR) Update and Near Term Plans – CEOS WGISS 37 1 Andrew Mitchell Earth Science Data and Information Systems (ESDIS) National.

4

Seriously? Another catalog?

Page 5: NASA COMMON METADATA REPOSITORY (CMR) Update and Near Term Plans – CEOS WGISS 37 1 Andrew Mitchell Earth Science Data and Information Systems (ESDIS) National.

5

No.

Page 6: NASA COMMON METADATA REPOSITORY (CMR) Update and Near Term Plans – CEOS WGISS 37 1 Andrew Mitchell Earth Science Data and Information Systems (ESDIS) National.

6

Page 7: NASA COMMON METADATA REPOSITORY (CMR) Update and Near Term Plans – CEOS WGISS 37 1 Andrew Mitchell Earth Science Data and Information Systems (ESDIS) National.

7

So why are we doing this?

Page 8: NASA COMMON METADATA REPOSITORY (CMR) Update and Near Term Plans – CEOS WGISS 37 1 Andrew Mitchell Earth Science Data and Information Systems (ESDIS) National.

8

Emphasis on Metadata Quality

Page 9: NASA COMMON METADATA REPOSITORY (CMR) Update and Near Term Plans – CEOS WGISS 37 1 Andrew Mitchell Earth Science Data and Information Systems (ESDIS) National.

9

Page 10: NASA COMMON METADATA REPOSITORY (CMR) Update and Near Term Plans – CEOS WGISS 37 1 Andrew Mitchell Earth Science Data and Information Systems (ESDIS) National.

10

Reconciliation Progress and Plans

Science Coordinators will assess differences between associated records and work from easiest to hardest with providers

Initial pass will associate ECHO 10 Collections with GCMD DIFs

Assessment and correlation between ECHO and GCMD holdings has started

GCMD is programmatically monitoring ECHO for new Collections and Updates

DIF support added to ECHO

Page 11: NASA COMMON METADATA REPOSITORY (CMR) Update and Near Term Plans – CEOS WGISS 37 1 Andrew Mitchell Earth Science Data and Information Systems (ESDIS) National.

11

Handling Metadata Changes• Science Coordinator will work with Data Providers to

make changes at Metadata source• CMR will support pluggable Ingest Adapters to allow in-

line updates to ingested metadata if needed• Science Coordinator can make updates to metadata on

behalf of providers when approved by owner

Page 12: NASA COMMON METADATA REPOSITORY (CMR) Update and Near Term Plans – CEOS WGISS 37 1 Andrew Mitchell Earth Science Data and Information Systems (ESDIS) National.

12

Emphasis on Performance

Page 13: NASA COMMON METADATA REPOSITORY (CMR) Update and Near Term Plans – CEOS WGISS 37 1 Andrew Mitchell Earth Science Data and Information Systems (ESDIS) National.

Current Holdings• Collections: ~4k + ~24k• Granules: ~140M• Growth:

• Current• 500k+ granules/week

• Future• ~1 million granules/day during

MODIS Collection 6 Reprocessing

13

Page 14: NASA COMMON METADATA REPOSITORY (CMR) Update and Near Term Plans – CEOS WGISS 37 1 Andrew Mitchell Earth Science Data and Information Systems (ESDIS) National.

14

CMR Transition

ECHO components progressively replaced with CMR components

Early work to focus on search performance

Updated requirements effort starting soon

Initial requirements based on MASI and MASII studies

CMR will build on ECHO and GCMD capabilities

Page 15: NASA COMMON METADATA REPOSITORY (CMR) Update and Near Term Plans – CEOS WGISS 37 1 Andrew Mitchell Earth Science Data and Information Systems (ESDIS) National.

15

Metadata Concept Support

Page 16: NASA COMMON METADATA REPOSITORY (CMR) Update and Near Term Plans – CEOS WGISS 37 1 Andrew Mitchell Earth Science Data and Information Systems (ESDIS) National.

16

Extensibility

Page 17: NASA COMMON METADATA REPOSITORY (CMR) Update and Near Term Plans – CEOS WGISS 37 1 Andrew Mitchell Earth Science Data and Information Systems (ESDIS) National.

17

ECHO 10

GCMD DIF

EMS

ISO19115UMM

Ingest Adapter

Visualization

Documentation

Services

Parameters

1 2

3

Page 18: NASA COMMON METADATA REPOSITORY (CMR) Update and Near Term Plans – CEOS WGISS 37 1 Andrew Mitchell Earth Science Data and Information Systems (ESDIS) National.

18

How Will This Affect Me?

http

://st

ore.

met

mus

eum

.org

/con

tent

/ebi

z/th

emet

stor

e/in

vt/8

0010

981/

8001

0981

_01_

l.jpg

Page 19: NASA COMMON METADATA REPOSITORY (CMR) Update and Near Term Plans – CEOS WGISS 37 1 Andrew Mitchell Earth Science Data and Information Systems (ESDIS) National.

19

Metadata Providers

• You won’t have to reconcile multiple systems• Most systems will continue to work

• ECHO FTP ingest going away

• Current formats will continue to function• You will need to be engaged in the adaptation process• You will need to support controlled vocabularies• You will have a voice through the Technical Committee

Streamlined Processes, More Engagement

Page 20: NASA COMMON METADATA REPOSITORY (CMR) Update and Near Term Plans – CEOS WGISS 37 1 Andrew Mitchell Earth Science Data and Information Systems (ESDIS) National.

20

Client Developers

More Metadata, Better Quality

• Richer, higher quality metadata will be available• Existing APIs will be supported• Standards-compliant APIs will be available• Metadata will be available in an ISO19115 compliant format

Page 21: NASA COMMON METADATA REPOSITORY (CMR) Update and Near Term Plans – CEOS WGISS 37 1 Andrew Mitchell Earth Science Data and Information Systems (ESDIS) National.

21

End Users

More Metadata, Better Quality

• Richer, higher quality metadata will be available• Unified view of EOSDIS holdings • Easier access through a variety of clients, data casting, etc• Metadata will be available in an ISO19115 compliant format

Page 22: NASA COMMON METADATA REPOSITORY (CMR) Update and Near Term Plans – CEOS WGISS 37 1 Andrew Mitchell Earth Science Data and Information Systems (ESDIS) National.

22

Questions?