DRS 2 Orientation

37
DRS 2 Orientation Harvard University Library September 30, 2010 DRS = Digital Repository Service

description

DRS 2 Orientation. Harvard University Library September 30, 2010. DRS = Digital Repository Service. Agenda. DRS 2 Concepts (Andrea) New metadata (Robin) Overall schedule (Andrea) BatchBuilder 2 demo (Vitaly) Testing instructions (Vitaly) Questions & comments. DRS 2 Concepts. - PowerPoint PPT Presentation

Transcript of DRS 2 Orientation

Page 1: DRS 2 Orientation

DRS 2Orientation

Harvard University LibrarySeptember 30, 2010

DRS = Digital Repository Service

Page 2: DRS 2 Orientation

Agenda1. DRS 2

1. Concepts (Andrea)2. New metadata (Robin)3. Overall schedule (Andrea)

2. BatchBuilder 2 demo (Vitaly)3. Testing instructions (Vitaly)4. Questions & comments

Page 3: DRS 2 Orientation

DRS 2 Concepts

Page 4: DRS 2 Orientation

DRS 1: everything’s a file

METS XML fileMETS XML file

METS XML file

TIFF image file

TIFF image file

TIFF image file

JPEG image fileJP2 image file

JP2 image fileJPEG image file

JP2 image file

JP2 image file

Text file

Text fileText file

ZIP file

PDF document file

Page 5: DRS 2 Orientation

File level is not a meaningful level for curatorial uses… Which DRS files make up my digital manuscript?

HOLLIS number 009412949 http://nrs.harvard.edu/urn-3:FHCL.HOUGH:1116980 http://pds.lib.harvard.edu/pds/view/6522882

Page 6: DRS 2 Orientation

METS XML fileMETS XML file

METS XML file

TIFF image file

TIFF image file

TIFF image file

JPEG image fileJP2 image file

JP2 image fileJPEG image file

JP2 image file

JP2 image file

Text file

Text fileText file

ZIP file

PDF document file

Page 7: DRS 2 Orientation

METS XML fileMETS XML file

METS XML file

TIFF image file

TIFF image file

TIFF image file

JPEG image fileJP2 image file

JP2 image fileJPEG image file

JP2 image file

JP2 image file

Text file

Text fileText file

ZIP file

PDF document file

DRS file ID = 6522882

Page 8: DRS 2 Orientation

METS XML fileMETS XML file

METS XML file

TIFF image file

TIFF image file

TIFF image file

JPEG image fileJP2 image file

JP2 image fileJPEG image file

JP2 image file

JP2 image file

Text file

Text fileText file

ZIP file

PDF document file

Page 9: DRS 2 Orientation

METS XML fileMETS XML file

METS XML file

TIFF image file

TIFF image file

TIFF image file

JPEG image fileJP2 image file

JP2 image fileJPEG image file

JP2 image file

JP2 image file

Text file

Text fileText file

ZIP file

PDF document file

Page 10: DRS 2 Orientation

METS XML fileTIFF image file

TIFF image file

JP2 image file

JP2 image file

Page 11: DRS 2 Orientation

METS XML fileTIFF image file

TIFF image file

JP2 image file

JP2 image file

page 1

page 2

Page 12: DRS 2 Orientation

Objects Aggregations of files that together

represent a coherent unit of content All the files that make up a single digital book All the master and use copies representing a

single photograph Useful for management, reporting and

searching “How many PDS document objects do I have in

the DRS?”

Page 13: DRS 2 Orientation

Objects New hook for metadata

Administrative categories (projects, exhibits, collections, etc.)

Descriptive metadata, catalog records

Object

Hollis # 009412949

Digital Medieval Manuscripts at Houghton Library

Moralia in Job: manuscript

Page 14: DRS 2 Orientation

Content models Object types Define

valid file formats and relationships known delivery and rendering applications associated assessments and preservation plans

Enforce conformity - we know what we have in the DRS and can monitor & preserve it

Page 15: DRS 2 Orientation

DRS 2.1 content models – deposit & delivery1. Still image

Image objects, delivered by IDS

2. PDS document Page-turned documents, delivered by PDS

3. Document Initially just PDF files, delivered by FDS

4. Opaque Files in any format

5. Text Text, XML, etc. delivered by FDS

Page 16: DRS 2 Orientation

Still image CM – print

TIFF archival master

Several derivativeJPEG deliverables

Derivative JPEG thumbnailPope JoanSeries: Illustration from Philippus Bergomensis, De Claribus Mulieribus. Ferrara, Rossi Harvard Art Museum/Fogg Museum, Gift of Philip Hofer

Page 17: DRS 2 Orientation

PDS document CM - book

Zoeller, Karl William. Merchandising the plumbing business. Chicago : Domestic Engineering Co., c1921. Baker Library.

JP2 archival master / deliverable images per page

Plain text files per page

Page 18: DRS 2 Orientation

Document CM - report

Intergovernmental Panel on Climate Change (IPCC) WG1 Fourth Assessment Report,Environmental Science and Public Policy Archives Harvard College Library  

PDF deliverable

Page 19: DRS 2 Orientation

Opaque content model The contents of Judge Tragers’ hard drive,

Harvard Law School Library Wordperfect files, Text files, PDF documents,

etc. Plus documentation about the collection

Page 20: DRS 2 Orientation

Text CM – methodologyPlain text file

Processing methodology for Intergovernmental Panel on Climate Change (IPCC) documents, HCL Imaging Services.

Page 21: DRS 2 Orientation

New metadata

Page 22: DRS 2 Orientation

Object descriptors A METS metadata file per object on the file

system alongside content files Descriptive, administrative, preservation,

technical and structural metadata Describes the object, all its files and bitstreams

and related significant events Gives the metadata the same secure storage

as the content files Self-contained, portable objects

Page 23: DRS 2 Orientation

The move to standards PREMIS -- for key preservation metadata,

including Events that affect content Relationships that are not implicit

MODS -- for descriptive metadata Form-specific schemas for technical metadata,

including MIX for images textMD for text DocumentMD for PDF and other document formats More to come…

Supplemented by local administrative schemas

Page 24: DRS 2 Orientation

New local metadata adminCategory adminFlag captions, phase 2

Behavior, default, unit name, description for objects content model identification DRS URI isFirstGenerationInDrs

Closest to original capture isPreferredDeliverableSource

Page 25: DRS 2 Orientation

Changes to local metadata OwnerSuppliedName

Required for objects, optional for files Role

Repeatable for both objects and files Processing

Instead of “purpose”; repeatable Quality

Optional Methodology

Now for objects and files of all types

Page 26: DRS 2 Orientation

Tracking changes DRS 2 will keep track of

Changes that affect content Troubleshooting content errors Key administrative metadata

Three types: Events Administrative flags “Versioned” metadata elements

Not tracking every metadata change

Page 27: DRS 2 Orientation

Events Object

creation deletion /recovery from deletion ingest merge

File addition deletion / recovery from deletion integrity check confirmation replacement virus check confirmation

Page 28: DRS 2 Orientation

Other trackingMetadata where changes will be tracked:

Access Flag Administrative Flag Billing Code Owner Code

Page 29: DRS 2 Orientation
Page 30: DRS 2 Orientation

Descriptive MetadataMODS

Administrative MetadataFor the object:

PREMIS (including relationships)

DRS administrative metadataFor each file:

PREMIS (including relationships)

Format-specific metadataDRS administrative metadata

PREMIS Events

Inventory of Files

Structure Map

What’s inside a descriptor?

Page 31: DRS 2 Orientation

Overall schedule

Page 32: DRS 2 Orientation

Overall schedule Available now: first release of BatchBuilder

2 for depositor training and testing Supports 5 content models

Fall 2010 – Summer 2011 BatchBuilder 2 enhancements & bug fixes Web Admin 2 development and testing

~September 2011: BatchBuilder 2 and Web Admin 2 in production

Page 33: DRS 2 Orientation

BatchBuilder 2

Page 34: DRS 2 Orientation

BatchBuilder 2 Will build batches of objects rather than

batches of files Will automatically determine most

technical metadata (using FITS) Will automatically create all object

descriptors (using OTS)

Page 35: DRS 2 Orientation

BatchBuilder 1 BatchBuilder 2

Expects files and creates batches of files.

Expects objects and creates batches of objects.

Can use an existing PDS METS file for PDS objects.

Can import a structmap from an “old-style” PDS METS file to create a PDS Document descriptor.

Uses batch genres. Uses DRS Content Models.

Uses a supplied HOLLIS ID to import contents of a HOLLIS record to a PDS METS Label.

Uses a supplied HOLLIS ID to import contents of a HOLLIS record into the MODS section of the object descriptor.

Batch level and directory level metadata entered in Batch Template panel.

Object level and directory level metadata entered in Object Template.

Project level metadata is entered in Administrative Properties panel.

Project level metadata is entered in Deposit Settings panel.

No depositor authorization – anyone with access to the ftp dropbox can load batches.

Depositor authorization – only depositors with permission to load into a particular owner code can load batches into that owner code.

Page 36: DRS 2 Orientation

Testing instructions

Page 37: DRS 2 Orientation

Questions & Comments