Fedora Users’ Conference Rutgers University May 14, 2005 Researching Fedora's Ability to Serve as...

34
Fedora Users’ Conference Rutgers University May 14, 2005 Researching Fedora's Ability to Serve as a Preservation System for Electronic University Records Kevin L. Glick Electronic Records Archivist Manuscripts and Archives Yale University Eliot Wilczek University Records Manager Digital Collections and Archives Tufts University Robert Dockins Fedora Project Analyst Digital Collections and Archives

Transcript of Fedora Users’ Conference Rutgers University May 14, 2005 Researching Fedora's Ability to Serve as...

Page 1: Fedora Users’ Conference Rutgers University May 14, 2005 Researching Fedora's Ability to Serve as a Preservation System for Electronic University Records.

Fedora Users’ Conference Rutgers UniversityMay 14, 2005

Researching Fedora's Ability to Serve as a Preservation System

for Electronic University Records

Kevin L. Glick Electronic Records Archivist Manuscripts and ArchivesYale University

Eliot WilczekUniversity Records ManagerDigital Collections and ArchivesTufts University

Robert DockinsFedora Project AnalystDigital Collections and ArchivesTufts University

Page 2: Fedora Users’ Conference Rutgers University May 14, 2005 Researching Fedora's Ability to Serve as a Preservation System for Electronic University Records.

Preservation System forElectronic University Records

Fedora Users’ ConferenceRutgers University

May 14, 2005

Records

data or information in a fixed form created or received in the course of individual or institutional activity and set aside (preserved) as evidence of that activity for future reference

• Form

• Content

• Fixity

• Structure

• Context

Page 3: Fedora Users’ Conference Rutgers University May 14, 2005 Researching Fedora's Ability to Serve as a Preservation System for Electronic University Records.

Preservation System forElectronic University Records

Fedora Users’ ConferenceRutgers University

May 14, 2005

Electronic Recordkeeping Systems

Institution Recordkeeping Systems

composed ofPeopleRequirements

Practices

Procedures

Infrastructure

Applications

Responsibilities

Policies

Recordkeeping Controls

include

Page 4: Fedora Users’ Conference Rutgers University May 14, 2005 Researching Fedora's Ability to Serve as a Preservation System for Electronic University Records.

Preservation System forElectronic University Records

Fedora Users’ ConferenceRutgers University

May 14, 2005

Definition of Preservation

• The whole of the activities and processes involved in the technical stabilization and physical and intellectual protection of resources through time

• Not possible to preserve an original electronic record

• The initial act of storage through reproduction

• Appraisal of enduring value & technical feasibility of preservation

• Determination of preservation strategy

Page 5: Fedora Users’ Conference Rutgers University May 14, 2005 Researching Fedora's Ability to Serve as a Preservation System for Electronic University Records.

Preservation System forElectronic University Records

Fedora Users’ ConferenceRutgers University

May 14, 2005

Recordkeeping System Requirements

1. Compliance

2. Creation & Capture

3. Maintenance

4. Recordkeeping Framework

5. Retention & Disposition

6. Protection from Loss or Corruption

7. Preservation

8. Use Rights

9. Discover & Delivery

10. Design & Performance

Page 6: Fedora Users’ Conference Rutgers University May 14, 2005 Researching Fedora's Ability to Serve as a Preservation System for Electronic University Records.

Preservation System forElectronic University Records

Fedora Users’ ConferenceRutgers University

May 14, 2005

Digital Preservation System Requirements

1. Ingest

2. Archival Storage

3. Data Management

4. Administration

5. Preservation Planning

6. Access

7. Security

8. Design & Performance

Page 7: Fedora Users’ Conference Rutgers University May 14, 2005 Researching Fedora's Ability to Serve as a Preservation System for Electronic University Records.

Preservation System forElectronic University Records

Fedora Users’ ConferenceRutgers University

May 14, 2005

Reference Model for an Open Archival Information System (OAIS)

January 2002

Consultative Committee for Space Data Systems (CCSDS)

ISO 14721:2003

OAIS Overview

Page 8: Fedora Users’ Conference Rutgers University May 14, 2005 Researching Fedora's Ability to Serve as a Preservation System for Electronic University Records.

Preservation System forElectronic University Records

Fedora Users’ ConferenceRutgers University

May 14, 2005

Producer

OAIS Archive

Consumer

SIP

ManageStore

Preserve AccessIngest

OAIS Overview

Page 9: Fedora Users’ Conference Rutgers University May 14, 2005 Researching Fedora's Ability to Serve as a Preservation System for Electronic University Records.

Preservation System forElectronic University Records

Fedora Users’ ConferenceRutgers University

May 14, 2005

Producer

OAIS Archive

Consumer

SIP

ManageStore

Preserve AccessIngest

OAIS Overview

Page 10: Fedora Users’ Conference Rutgers University May 14, 2005 Researching Fedora's Ability to Serve as a Preservation System for Electronic University Records.

Preservation System forElectronic University Records

Fedora Users’ ConferenceRutgers University

May 14, 2005

Producer

OAIS Archive

Consumer

ManageStore

Preserve AccessIngest

AIP

OAIS Overview

Page 11: Fedora Users’ Conference Rutgers University May 14, 2005 Researching Fedora's Ability to Serve as a Preservation System for Electronic University Records.

Preservation System forElectronic University Records

Fedora Users’ ConferenceRutgers University

May 14, 2005

Producer

OAIS Archive

Consumer

ManageStore

Preserve AccessIngest

DIP

OAIS Overview

Page 12: Fedora Users’ Conference Rutgers University May 14, 2005 Researching Fedora's Ability to Serve as a Preservation System for Electronic University Records.

Preservation System forElectronic University Records

Fedora Users’ ConferenceRutgers University

May 14, 2005

Producer

OAIS Archive

Consumer

ManageStore

Preserve AccessIngest

DIP

OAIS Overview

Page 13: Fedora Users’ Conference Rutgers University May 14, 2005 Researching Fedora's Ability to Serve as a Preservation System for Electronic University Records.

Preservation System forElectronic University Records

Fedora Users’ ConferenceRutgers University

May 14, 2005

Producer-Archive Interface Methodology Abstract Standard

May 2004

Consultative Committee for Space Data Systems (CCSDS)

OAIS Overview

Preliminary Phase

Formal Phase

Validation

Transfer

Page 14: Fedora Users’ Conference Rutgers University May 14, 2005 Researching Fedora's Ability to Serve as a Preservation System for Electronic University Records.

Preservation System forElectronic University Records

Fedora Users’ ConferenceRutgers University

May 14, 2005

OAIS Overview

Submission Agreement

Producer-Archive Interface Methodology Abstract Standard

May 2004

Consultative Committee for Space Data Systems (CCSDS)

Preliminary Phase

Formal Phase

Validation

Transfer

Page 15: Fedora Users’ Conference Rutgers University May 14, 2005 Researching Fedora's Ability to Serve as a Preservation System for Electronic University Records.

Preservation System forElectronic University Records

Fedora Users’ ConferenceRutgers University

May 14, 2005

Negotiate Submission Agreement

Submission Agreement

Agreement between Archive & Producer

Instructions for Ingest Process

Standards for Validation

Documentation of Ingest Process

Page 16: Fedora Users’ Conference Rutgers University May 14, 2005 Researching Fedora's Ability to Serve as a Preservation System for Electronic University Records.

Preservation System forElectronic University Records

Fedora Users’ ConferenceRutgers University

May 14, 2005

Ingest Guide

A: Negotiate Submission Agreement

B: Transfer and Validation

Ingest Guide

Page 17: Fedora Users’ Conference Rutgers University May 14, 2005 Researching Fedora's Ability to Serve as a Preservation System for Electronic University Records.

Preservation System forElectronic University Records

Fedora Users’ ConferenceRutgers University

May 14, 2005

Ingest Guide

A: Negotiate Submission Agreement

B: Transfer and Validation

A: Negotiate Submission AgreementA1: Establish Relationship

A2: Collection Appraisal

A3: Feasibility Forecast

A4: Format Appraisal

A5: Record Type Appraisal

A6: Identifier Rules

A7: Use Rights and Security

A8: Finalize Submission Agreement

Ingest Guide

Page 18: Fedora Users’ Conference Rutgers University May 14, 2005 Researching Fedora's Ability to Serve as a Preservation System for Electronic University Records.

Preservation System forElectronic University Records

Fedora Users’ ConferenceRutgers University

May 14, 2005

Ingest Guide

A: Negotiate Submission Agreement

B: Transfer and Validation

B: Transfer and ValidationB1: SIP Creation and Transfer

B2: Automated Validation

B3: Normalize and Attach Metadata

B4: Human Appraisal

B5: Formal Accession

B6: SIP to AIP Transformation

Ingest Guide

Page 19: Fedora Users’ Conference Rutgers University May 14, 2005 Researching Fedora's Ability to Serve as a Preservation System for Electronic University Records.

Preservation System forElectronic University Records

Fedora Users’ ConferenceRutgers University

May 14, 2005

Ingest Guide

Trustworthy Ingest Process

Maintained Level of Authenticity

Page 20: Fedora Users’ Conference Rutgers University May 14, 2005 Researching Fedora's Ability to Serve as a Preservation System for Electronic University Records.

Preservation System forElectronic University Records

Fedora Users’ ConferenceRutgers University

May 14, 2005

Negotiate Submission Agreement

A1: Establish Relationship

A2: Collection Appraisal

A3: Feasibility Forecast

A4: Format Appraisal

A5: Record Type Appraisal

A6: Identifier Rules

A7: Use Rights and Security

A8: Finalize Submission Agreement

Page 21: Fedora Users’ Conference Rutgers University May 14, 2005 Researching Fedora's Ability to Serve as a Preservation System for Electronic University Records.

Preservation System forElectronic University Records

Fedora Users’ ConferenceRutgers University

May 14, 2005

Negotiate Submission Agreement

A1: Establish Relationship

A2: Collection Appraisal

A3: Feasibility Forecast

A4: Format Appraisal

A5: Record Type Appraisal

A6: Identifier Rules

A7: Use Rights and Security

A8: Finalize Submission Agreement

First Appraisal

Should we accession?

Page 22: Fedora Users’ Conference Rutgers University May 14, 2005 Researching Fedora's Ability to Serve as a Preservation System for Electronic University Records.

Preservation System forElectronic University Records

Fedora Users’ ConferenceRutgers University

May 14, 2005

Negotiate Submission Agreement

A1: Establish Relationship

A2: Collection Appraisal

A3: Feasibility Forecast

A4: Format Appraisal

A5: Record Type Appraisal

A6: Identifier Rules

A7: Use Rights and Security

A8: Finalize Submission Agreement

Define Records

Creator

Record Type

Format

Dates

Identification Rules

Extent

Page 23: Fedora Users’ Conference Rutgers University May 14, 2005 Researching Fedora's Ability to Serve as a Preservation System for Electronic University Records.

Preservation System forElectronic University Records

Fedora Users’ ConferenceRutgers University

May 14, 2005

Negotiate Submission Agreement

A1: Establish Relationship

A2: Collection Appraisal

A3: Feasibility Forecast

A4: Format Appraisal

A5: Record Type Appraisal

A6: Identifier Rules

A7: Use Rights and Security

A8: Finalize Submission Agreement

Second Appraisal

Can we accession?

Page 24: Fedora Users’ Conference Rutgers University May 14, 2005 Researching Fedora's Ability to Serve as a Preservation System for Electronic University Records.

Preservation System forElectronic University Records

Fedora Users’ ConferenceRutgers University

May 14, 2005

Negotiate Submission Agreement

A1: Establish Relationship

A2: Collection Appraisal

A3: Feasibility Forecast

A4: Format Appraisal

A5: Record Type Appraisal

A6: Identifier Rules

A7: Use Rights and Security

A8: Finalize Submission Agreement

Standing Resources

Preservation Formats

Record Types

Identifier Rules

Creators

Security Procedures

System Capacities

Page 25: Fedora Users’ Conference Rutgers University May 14, 2005 Researching Fedora's Ability to Serve as a Preservation System for Electronic University Records.

Preservation System forElectronic University Records

Fedora Users’ ConferenceRutgers University

May 14, 2005

Negotiate Submission Agreement

A1: Establish Relationship

A2: Collection Appraisal

A3: Feasibility Forecast

A4: Format Appraisal

A5: Record Type Appraisal

A6: Identifier Rules

A7: Use Rights and Security

A8: Finalize Submission Agreement

Resources

Creators

Record Types

Preservation Formats

Identifier Rules

Security Procedures

System Capacities

Records

Creator

Record Type

Format

Identification Rules

Dates

Extent

Page 26: Fedora Users’ Conference Rutgers University May 14, 2005 Researching Fedora's Ability to Serve as a Preservation System for Electronic University Records.

Preservation System forElectronic University Records

Fedora Users’ ConferenceRutgers University

May 14, 2005

Negotiate Submission Agreement

A1: Establish Relationship

A2: Collection Appraisal

A3: Feasibility Forecast

A4: Format Appraisal

A5: Record Type Appraisal

A6: Identifier Rules

A7: Use Rights and Security

A8: Finalize Submission Agreement

Resources

Creators

Record Types

Preservation Formats

Identifier Rules

Security Procedures

System Capacities

Records

Creator

Record Type

Format

Identification Rules

Dates

Extent

Page 27: Fedora Users’ Conference Rutgers University May 14, 2005 Researching Fedora's Ability to Serve as a Preservation System for Electronic University Records.

Preservation System forElectronic University Records

Fedora Users’ ConferenceRutgers University

May 14, 2005

Negotiate Submission Agreement

A1: Establish Relationship

A2: Collection Appraisal

A3: Feasibility Forecast

A4: Format Appraisal

A5: Record Type Appraisal

A6: Identifier Rules

A7: Use Rights and Security

A8: Finalize Submission Agreement

Finalize Submission Agreement

Sign paper version

Code electronic version

Page 28: Fedora Users’ Conference Rutgers University May 14, 2005 Researching Fedora's Ability to Serve as a Preservation System for Electronic University Records.

Preservation System forElectronic University Records

Fedora Users’ ConferenceRutgers University

May 14, 2005

Transfer and Validation

B1: SIP Creation and Transfer

B2: Automated Validation

B3: Normalize and Attach Metadata

B4: Human Appraisal

B5: Formal Accession

B6: SIP to AIP Transformation

Page 29: Fedora Users’ Conference Rutgers University May 14, 2005 Researching Fedora's Ability to Serve as a Preservation System for Electronic University Records.

Preservation System forElectronic University Records

Fedora Users’ ConferenceRutgers University

May 14, 2005

Transfer and Validation

B1: SIP Creation and Transfer

B2: Automated Validation

B3: Normalize and Attach Metadata

B4: Human Appraisal

B5: Formal Accession

B6: SIP to AIP Transformation

Submission Agreement

Guides SIP Preparation

Supplies Validation Rules

Dictates Normalization

Defines Target Repository

Page 30: Fedora Users’ Conference Rutgers University May 14, 2005 Researching Fedora's Ability to Serve as a Preservation System for Electronic University Records.

Preservation System forElectronic University Records

Fedora Users’ ConferenceRutgers University

May 14, 2005

Transfer and Validation

B1: SIP Creation and Transfer

B2: Automated Validation

B3: Normalize and Attach Metadata

B4: Human Appraisal

B5: Formal Accession

B6: SIP to AIP Transformation

Content Preparation

SIP Format Rules

Record Format Rules

Metadata Standards

Transfer Procedures

Page 31: Fedora Users’ Conference Rutgers University May 14, 2005 Researching Fedora's Ability to Serve as a Preservation System for Electronic University Records.

Preservation System forElectronic University Records

Fedora Users’ ConferenceRutgers University

May 14, 2005

Transfer and Validation

B1: SIP Creation and Transfer

B2: Automated Validation

B3: Normalize and Attach Metadata

B4: Human Appraisal

B5: Formal Accession

B6: SIP to AIP Transformation

Automated Processing

Technical Validation

Format Normalization

Stock Metadata

Page 32: Fedora Users’ Conference Rutgers University May 14, 2005 Researching Fedora's Ability to Serve as a Preservation System for Electronic University Records.

Preservation System forElectronic University Records

Fedora Users’ ConferenceRutgers University

May 14, 2005

Transfer and Validation

B1: SIP Creation and Transfer

B2: Automated Validation

B3: Normalize and Attach Metadata

B4: Human Appraisal

B5: Formal Accession

B6: SIP to AIP Transformation

Final Appraisal

Intellectual Review

Normalization Review

Metadata Review

Last Chance to Reject

Page 33: Fedora Users’ Conference Rutgers University May 14, 2005 Researching Fedora's Ability to Serve as a Preservation System for Electronic University Records.

Preservation System forElectronic University Records

Fedora Users’ ConferenceRutgers University

May 14, 2005

Transfer and Validation

B1: SIP Creation and Transfer

B2: Automated Validation

B3: Normalize and Attach Metadata

B4: Human Appraisal

B5: Formal Accession

B6: SIP to AIP Transformation

To Repository

Issue Receipt

Create AIP

Submit to Repository

Post-processing

Page 34: Fedora Users’ Conference Rutgers University May 14, 2005 Researching Fedora's Ability to Serve as a Preservation System for Electronic University Records.

Preservation System forElectronic University Records

Fedora Users’ ConferenceRutgers University

May 14, 2005

Thank You

Fedora and the Preservation of University Recordshttp://dca.tufts.edu/features/nhprc/index.html

Ingest Guidehttp://dca.tufts.edu/features/nhprc/reports/3_1_draft.html