OpenMIC - old.diglib.org · PostgreSQL database Mapping Utility ORG’s own database Mapping form...

71
Moving Image Collections Digital Library Federation Fall Forum November 14, 2008 Jane Johnson Otto [email protected] http://mic.loc.gov OpenMIC

Transcript of OpenMIC - old.diglib.org · PostgreSQL database Mapping Utility ORG’s own database Mapping form...

Page 1: OpenMIC - old.diglib.org · PostgreSQL database Mapping Utility ORG’s own database Mapping form MIC CORE Cataloging Utility MIC core registry METS MODS Mapping form METS Web search

Moving Image Collections

Digital Library Federation Fall ForumNovember 14, 2008

Jane Johnson [email protected]

http://mic.loc.gov

OpenMIC

Page 2: OpenMIC - old.diglib.org · PostgreSQL database Mapping Utility ORG’s own database Mapping form MIC CORE Cataloging Utility MIC core registry METS MODS Mapping form METS Web search

Packard CampusNational Audio Visual Conservation Center

Page 3: OpenMIC - old.diglib.org · PostgreSQL database Mapping Utility ORG’s own database Mapping form MIC CORE Cataloging Utility MIC core registry METS MODS Mapping form METS Web search

Problem: need to preserve

1988 National Film Preservation Act 1990s – mandated studies and plans 1997 – LC asks AMIA for prioritized action

plan AMIA feasibility study

Page 4: OpenMIC - old.diglib.org · PostgreSQL database Mapping Utility ORG’s own database Mapping form MIC CORE Cataloging Utility MIC core registry METS MODS Mapping form METS Web search

Solution: Identify holdings

AMIA identifies first & most crucial step:Document who has whatParticularly unique titles

Page 5: OpenMIC - old.diglib.org · PostgreSQL database Mapping Utility ORG’s own database Mapping form MIC CORE Cataloging Utility MIC core registry METS MODS Mapping form METS Web search

Solution: Identify holdings

Enables archivists to

identify past preservation work

Identify emerging critical need

Reduce duplication of effort

Prevent loss through deterioration

Ensure titles are preserved from the bestsurviving footage

Page 6: OpenMIC - old.diglib.org · PostgreSQL database Mapping Utility ORG’s own database Mapping form MIC CORE Cataloging Utility MIC core registry METS MODS Mapping form METS Web search

Problem: diversity of the field

lots of material

analog and digital important content much of it deteriorating few resources few tools expertise and infrastructure often less than ideal diverse field (organizations, collections, missions, users) standards are a good thing

Page 7: OpenMIC - old.diglib.org · PostgreSQL database Mapping Utility ORG’s own database Mapping form MIC CORE Cataloging Utility MIC core registry METS MODS Mapping form METS Web search

Solution: portal with tools

Page 8: OpenMIC - old.diglib.org · PostgreSQL database Mapping Utility ORG’s own database Mapping form MIC CORE Cataloging Utility MIC core registry METS MODS Mapping form METS Web search

Solution: portal with tools

AMIA-Library of Congress collaboration

NSF-funded (National Science Digital Library:http://nsdl.org)

Three original university development partners

Rutgers University Libraries, technology lead

Grace Agnew, architect

Page 9: OpenMIC - old.diglib.org · PostgreSQL database Mapping Utility ORG’s own database Mapping form MIC CORE Cataloging Utility MIC core registry METS MODS Mapping form METS Web search

Components

Union catalog

Archive directory

Service providersdirectory

Mapping utility

Info resources

Portal structure

Cataloging utility

Page 10: OpenMIC - old.diglib.org · PostgreSQL database Mapping Utility ORG’s own database Mapping form MIC CORE Cataloging Utility MIC core registry METS MODS Mapping form METS Web search

Components

Union catalog

Archive directory

Service providersdirectory

Mapping utility

Info resources

Portal structure

Cataloging utility

Page 11: OpenMIC - old.diglib.org · PostgreSQL database Mapping Utility ORG’s own database Mapping form MIC CORE Cataloging Utility MIC core registry METS MODS Mapping form METS Web search
Page 12: OpenMIC - old.diglib.org · PostgreSQL database Mapping Utility ORG’s own database Mapping form MIC CORE Cataloging Utility MIC core registry METS MODS Mapping form METS Web search

•Link to union catalog

•Community building

•LC & AMIA can target

• educational needs

• potential collaborations

• emerging trends

Page 13: OpenMIC - old.diglib.org · PostgreSQL database Mapping Utility ORG’s own database Mapping form MIC CORE Cataloging Utility MIC core registry METS MODS Mapping form METS Web search

Components

Union catalog

Archive directory

Service providersdirectory

Mapping utility

Info resources

Portal structure

Cataloging utility

Page 14: OpenMIC - old.diglib.org · PostgreSQL database Mapping Utility ORG’s own database Mapping form MIC CORE Cataloging Utility MIC core registry METS MODS Mapping form METS Web search

Components

Union catalog

Archive directory

Service providersdirectory

Mapping utility

Info resources

Portal structure

Cataloging utility

Page 15: OpenMIC - old.diglib.org · PostgreSQL database Mapping Utility ORG’s own database Mapping form MIC CORE Cataloging Utility MIC core registry METS MODS Mapping form METS Web search

Embracing Diversity:MIC Mapping Utility

Page 16: OpenMIC - old.diglib.org · PostgreSQL database Mapping Utility ORG’s own database Mapping form MIC CORE Cataloging Utility MIC core registry METS MODS Mapping form METS Web search

Embracing Diversity:MIC Mapping Utility

Submit field list

Send sample records

Page 17: OpenMIC - old.diglib.org · PostgreSQL database Mapping Utility ORG’s own database Mapping form MIC CORE Cataloging Utility MIC core registry METS MODS Mapping form METS Web search

MIC populates formwith archive’s field list

Page 18: OpenMIC - old.diglib.org · PostgreSQL database Mapping Utility ORG’s own database Mapping form MIC CORE Cataloging Utility MIC core registry METS MODS Mapping form METS Web search

Embracing Diversity:MIC Mapping Utility

Page 19: OpenMIC - old.diglib.org · PostgreSQL database Mapping Utility ORG’s own database Mapping form MIC CORE Cataloging Utility MIC core registry METS MODS Mapping form METS Web search

MIC Mapping Utility

Small organizations– Holdings accessible on Web– Low cost– In accordance with standards (MODS, METS)– With existing personnel and infrastructure

Larger institutions– Multiple/legacy schema brought into conformance– Export in a single schema

Page 20: OpenMIC - old.diglib.org · PostgreSQL database Mapping Utility ORG’s own database Mapping form MIC CORE Cataloging Utility MIC core registry METS MODS Mapping form METS Web search

Components

Union catalog

Archive directory

Service providersdirectory

Mapping utility

Info resources

Portal structure

Cataloging utility

Page 21: OpenMIC - old.diglib.org · PostgreSQL database Mapping Utility ORG’s own database Mapping form MIC CORE Cataloging Utility MIC core registry METS MODS Mapping form METS Web search

Components

Union catalog

Archive directory

Service providersdirectory

Mapping utility

Info resources

Portal structure

Cataloging utility

Page 22: OpenMIC - old.diglib.org · PostgreSQL database Mapping Utility ORG’s own database Mapping form MIC CORE Cataloging Utility MIC core registry METS MODS Mapping form METS Web search

Components

Union catalog

Archive directory

Service providersdirectory

Mapping utility

Info resources

Portal structure

Cataloging utility

Page 23: OpenMIC - old.diglib.org · PostgreSQL database Mapping Utility ORG’s own database Mapping form MIC CORE Cataloging Utility MIC core registry METS MODS Mapping form METS Web search

Metadata Strategy: Principles

Promote metadata standards Embrace diversity Extend standard metadata use to all Enable exploration of new technologies Provide a model extensible to other archive

and library communities

Page 24: OpenMIC - old.diglib.org · PostgreSQL database Mapping Utility ORG’s own database Mapping form MIC CORE Cataloging Utility MIC core registry METS MODS Mapping form METS Web search

Metadata Strategy: Principles

Simultaneously address multiple goals of expanding

Education Outreach Access Preservation Research

in culture and information technology

Page 25: OpenMIC - old.diglib.org · PostgreSQL database Mapping Utility ORG’s own database Mapping form MIC CORE Cataloging Utility MIC core registry METS MODS Mapping form METS Web search

UC vs. CU (OpenMIC)

Union Catalog•Primarily descriptive

•Batch import

Cataloging utility•Direct input

•End-to-end management

Page 26: OpenMIC - old.diglib.org · PostgreSQL database Mapping Utility ORG’s own database Mapping form MIC CORE Cataloging Utility MIC core registry METS MODS Mapping form METS Web search

Life Cycle Management

Acquisition Description Preservation Access

– Licensing– Exhibition– Research

Digitization

Page 27: OpenMIC - old.diglib.org · PostgreSQL database Mapping Utility ORG’s own database Mapping form MIC CORE Cataloging Utility MIC core registry METS MODS Mapping form METS Web search

PostgreSQL database

MappingUtility

ORG’sown

database

Mapping formMIC CORE

CatalogingUtility

MIC coreregistry

METS

MODSMapping form

METS

Web search interface

MIC XML file

NSDLrecords

ArchiveDirectory

ServiceProvidersDirectory

How MIC Works

Information resources

org org

AMIABib

utilities,remote

databases

P O R T A L S

Orginputs

records

Import utility

NSDL,consortiaOAI export utility

General export utility

General export utility

General export utilityImport utility

Page 28: OpenMIC - old.diglib.org · PostgreSQL database Mapping Utility ORG’s own database Mapping form MIC CORE Cataloging Utility MIC core registry METS MODS Mapping form METS Web search

PostgreSQL database

MappingUtility

ORG’sown

database

Mapping formMIC CORE

CatalogingUtility

MIC coreregistry

METS

MODSMapping form

METS

Web search interface

MIC XML file

NSDLrecords

ArchiveDirectory

ServiceProvidersDirectory

Information resources

org org

AMIABib

utilities,remote

databases

P O R T A L S

Orginputs

records

Import utility

NSDL,consortiaOAI export utility

General export utility

General export utility

General export utilityImport utility

How MIC Works

Page 29: OpenMIC - old.diglib.org · PostgreSQL database Mapping Utility ORG’s own database Mapping form MIC CORE Cataloging Utility MIC core registry METS MODS Mapping form METS Web search

• Complete metadata creation system• Web-based (low overhead,

infrastructure requirements)• All formats (print and non-print)• Open source• Based on Rutgers WMS• Built out moving image/recorded

sound technical metadata• Accommodates all materials• Import/export utilities• Configurable

Page 30: OpenMIC - old.diglib.org · PostgreSQL database Mapping Utility ORG’s own database Mapping form MIC CORE Cataloging Utility MIC core registry METS MODS Mapping form METS Web search

•Organization

•Collection (organizing mechanism)

•ResourceOpenMIC

Page 31: OpenMIC - old.diglib.org · PostgreSQL database Mapping Utility ORG’s own database Mapping form MIC CORE Cataloging Utility MIC core registry METS MODS Mapping form METS Web search

UCLA

Television Stock news MP Outfest

title title title

Org-Collection-Resource

Page 32: OpenMIC - old.diglib.org · PostgreSQL database Mapping Utility ORG’s own database Mapping form MIC CORE Cataloging Utility MIC core registry METS MODS Mapping form METS Web search

•Union Catalog environment

•Standalone

•Part of repository architectureOpenMIC

Page 33: OpenMIC - old.diglib.org · PostgreSQL database Mapping Utility ORG’s own database Mapping form MIC CORE Cataloging Utility MIC core registry METS MODS Mapping form METS Web search

WebsiteUnion CatalogArchive DirectoryVendor DirectoryInfo resourcesPortal structure

Cataloging utility *Auth/authorization *Mapping *Import *Export *Reports function

File handling forFedora-baseddigital repositories

MIC OpenMIC OpenWMS mic.loc.gov (phase 1) (phase 2)

MIC – OpenMIC - OpenWMS

Union Catalog Standalone Digital repository

Page 34: OpenMIC - old.diglib.org · PostgreSQL database Mapping Utility ORG’s own database Mapping form MIC CORE Cataloging Utility MIC core registry METS MODS Mapping form METS Web search

UCLA

Television Stock news MP Outfest

title title title

Org-Collection-Resource

Page 35: OpenMIC - old.diglib.org · PostgreSQL database Mapping Utility ORG’s own database Mapping form MIC CORE Cataloging Utility MIC core registry METS MODS Mapping form METS Web search

MIC

Page 36: OpenMIC - old.diglib.org · PostgreSQL database Mapping Utility ORG’s own database Mapping form MIC CORE Cataloging Utility MIC core registry METS MODS Mapping form METS Web search

•Organization

•Collection (organizing mechanism)

•Resource

Page 37: OpenMIC - old.diglib.org · PostgreSQL database Mapping Utility ORG’s own database Mapping form MIC CORE Cataloging Utility MIC core registry METS MODS Mapping form METS Web search

•Create organization

Page 38: OpenMIC - old.diglib.org · PostgreSQL database Mapping Utility ORG’s own database Mapping form MIC CORE Cataloging Utility MIC core registry METS MODS Mapping form METS Web search
Page 39: OpenMIC - old.diglib.org · PostgreSQL database Mapping Utility ORG’s own database Mapping form MIC CORE Cataloging Utility MIC core registry METS MODS Mapping form METS Web search
Page 40: OpenMIC - old.diglib.org · PostgreSQL database Mapping Utility ORG’s own database Mapping form MIC CORE Cataloging Utility MIC core registry METS MODS Mapping form METS Web search

•Create collection

Page 41: OpenMIC - old.diglib.org · PostgreSQL database Mapping Utility ORG’s own database Mapping form MIC CORE Cataloging Utility MIC core registry METS MODS Mapping form METS Web search
Page 42: OpenMIC - old.diglib.org · PostgreSQL database Mapping Utility ORG’s own database Mapping form MIC CORE Cataloging Utility MIC core registry METS MODS Mapping form METS Web search

OpenMIC•Create user(s) with role(s)

Page 43: OpenMIC - old.diglib.org · PostgreSQL database Mapping Utility ORG’s own database Mapping form MIC CORE Cataloging Utility MIC core registry METS MODS Mapping form METS Web search
Page 44: OpenMIC - old.diglib.org · PostgreSQL database Mapping Utility ORG’s own database Mapping form MIC CORE Cataloging Utility MIC core registry METS MODS Mapping form METS Web search
Page 45: OpenMIC - old.diglib.org · PostgreSQL database Mapping Utility ORG’s own database Mapping form MIC CORE Cataloging Utility MIC core registry METS MODS Mapping form METS Web search

•Create metadata for resource

Page 46: OpenMIC - old.diglib.org · PostgreSQL database Mapping Utility ORG’s own database Mapping form MIC CORE Cataloging Utility MIC core registry METS MODS Mapping form METS Web search

Cataloging Utility Standards

METS MODS PREMIS MIX AES Audio Object Schema

(AES-X098B)

Page 47: OpenMIC - old.diglib.org · PostgreSQL database Mapping Utility ORG’s own database Mapping form MIC CORE Cataloging Utility MIC core registry METS MODS Mapping form METS Web search

AES Audio Object Schema

Page 48: OpenMIC - old.diglib.org · PostgreSQL database Mapping Utility ORG’s own database Mapping form MIC CORE Cataloging Utility MIC core registry METS MODS Mapping form METS Web search

AES Scope

For long-term archival storage and presrvtnComprehensive metadata for preservation,

retrieval, playback, end user displayDigital or analogPhysical audio carriers or streams of bitsImplemented as XML schemaExtended to moving images for OpenMIC

Page 49: OpenMIC - old.diglib.org · PostgreSQL database Mapping Utility ORG’s own database Mapping form MIC CORE Cataloging Utility MIC core registry METS MODS Mapping form METS Web search

AES

GranularRigorous delineation between descriptive

and technical metadata Based on structure type,distinguishes media & shell (OpenMIC adds

container)

Page 50: OpenMIC - old.diglib.org · PostgreSQL database Mapping Utility ORG’s own database Mapping form MIC CORE Cataloging Utility MIC core registry METS MODS Mapping form METS Web search

Structure Types

Audiotape Optical disc Analog disc Cylinder Wire recording Film Videotape Videodisc

Page 51: OpenMIC - old.diglib.org · PostgreSQL database Mapping Utility ORG’s own database Mapping form MIC CORE Cataloging Utility MIC core registry METS MODS Mapping form METS Web search

Vocabularies-Diameter

AES4.4.2.1.2.8 diameterThe diameter element may be used to indicate the diameter of the

audio object. The diameter element is of type measurementTypeas described in 4.4.2.1.2.2. If the diameter of the audio object isunknown or not applicable, then the diameter element shall beomitted.

OpenMIC pulldown menu5.5 inches7 inches8 inches10 inches12 inches16 inches20 inchesOther

Page 52: OpenMIC - old.diglib.org · PostgreSQL database Mapping Utility ORG’s own database Mapping form MIC CORE Cataloging Utility MIC core registry METS MODS Mapping form METS Web search

Vocabulary sources

LC AV Prototype (based on draft AES standard)(http://www.loc.gov/rr/mopic/avprot/metsmenu2.html)

SMPTE RP210PBCoreMAVISNational Film and Sound ArchiveSound Directions documentationExperts (AMPAS, AMIA, ARSC, AES, LC, etc.)

Page 53: OpenMIC - old.diglib.org · PostgreSQL database Mapping Utility ORG’s own database Mapping form MIC CORE Cataloging Utility MIC core registry METS MODS Mapping form METS Web search

Events-Based Model

Events– Action occurring in particular place & time– Associated agents– Associated objects

Types of events– Descriptive– Provenance– Preservation– Condition evaluation– Rights

Page 54: OpenMIC - old.diglib.org · PostgreSQL database Mapping Utility ORG’s own database Mapping form MIC CORE Cataloging Utility MIC core registry METS MODS Mapping form METS Web search

Metadata tour

Page 55: OpenMIC - old.diglib.org · PostgreSQL database Mapping Utility ORG’s own database Mapping form MIC CORE Cataloging Utility MIC core registry METS MODS Mapping form METS Web search

Metadata tour

Page 56: OpenMIC - old.diglib.org · PostgreSQL database Mapping Utility ORG’s own database Mapping form MIC CORE Cataloging Utility MIC core registry METS MODS Mapping form METS Web search

Metadata tour

Page 57: OpenMIC - old.diglib.org · PostgreSQL database Mapping Utility ORG’s own database Mapping form MIC CORE Cataloging Utility MIC core registry METS MODS Mapping form METS Web search

Metadata tour

Page 58: OpenMIC - old.diglib.org · PostgreSQL database Mapping Utility ORG’s own database Mapping form MIC CORE Cataloging Utility MIC core registry METS MODS Mapping form METS Web search

Metadata tour

Page 59: OpenMIC - old.diglib.org · PostgreSQL database Mapping Utility ORG’s own database Mapping form MIC CORE Cataloging Utility MIC core registry METS MODS Mapping form METS Web search

Metadata tour

Page 60: OpenMIC - old.diglib.org · PostgreSQL database Mapping Utility ORG’s own database Mapping form MIC CORE Cataloging Utility MIC core registry METS MODS Mapping form METS Web search

Metadata tour

Page 61: OpenMIC - old.diglib.org · PostgreSQL database Mapping Utility ORG’s own database Mapping form MIC CORE Cataloging Utility MIC core registry METS MODS Mapping form METS Web search

Metadata tour

Page 62: OpenMIC - old.diglib.org · PostgreSQL database Mapping Utility ORG’s own database Mapping form MIC CORE Cataloging Utility MIC core registry METS MODS Mapping form METS Web search

T

DMD

T

R

S35mm

S16mm

SVT

T

S35mm

S35mm

Multiple Instantiations

Page 63: OpenMIC - old.diglib.org · PostgreSQL database Mapping Utility ORG’s own database Mapping form MIC CORE Cataloging Utility MIC core registry METS MODS Mapping form METS Web search
Page 64: OpenMIC - old.diglib.org · PostgreSQL database Mapping Utility ORG’s own database Mapping form MIC CORE Cataloging Utility MIC core registry METS MODS Mapping form METS Web search

•Rights declaration (tied to ID)

•Copyright status (protected, PD, unknown)

•Availability status (open, restriced, unavailable)

•Availability reason (© expired, mandated by law, permission/license,etc.)

•Publication status (published, unpublished, publication pending, etc.)

•Watermark

•Rights holder

•Rights event

Page 65: OpenMIC - old.diglib.org · PostgreSQL database Mapping Utility ORG’s own database Mapping form MIC CORE Cataloging Utility MIC core registry METS MODS Mapping form METS Web search
Page 66: OpenMIC - old.diglib.org · PostgreSQL database Mapping Utility ORG’s own database Mapping form MIC CORE Cataloging Utility MIC core registry METS MODS Mapping form METS Web search

Flexibility & Configurability

Enable/disable/add data elementsEdit controlled vocabulariesTemplates (personal and collection)Required elementsReportsAnnouncements

Page 67: OpenMIC - old.diglib.org · PostgreSQL database Mapping Utility ORG’s own database Mapping form MIC CORE Cataloging Utility MIC core registry METS MODS Mapping form METS Web search

More About MIC

Page 68: OpenMIC - old.diglib.org · PostgreSQL database Mapping Utility ORG’s own database Mapping form MIC CORE Cataloging Utility MIC core registry METS MODS Mapping form METS Web search

http://rucore.libraries.rutgers.edu

(for download information)

Page 69: OpenMIC - old.diglib.org · PostgreSQL database Mapping Utility ORG’s own database Mapping form MIC CORE Cataloging Utility MIC core registry METS MODS Mapping form METS Web search

The MIC Mission

To immerse moving imagesin the education mainstream, recognizing that

what society uses, it values, andwhat it values, it preserves.

Page 70: OpenMIC - old.diglib.org · PostgreSQL database Mapping Utility ORG’s own database Mapping form MIC CORE Cataloging Utility MIC core registry METS MODS Mapping form METS Web search
Page 71: OpenMIC - old.diglib.org · PostgreSQL database Mapping Utility ORG’s own database Mapping form MIC CORE Cataloging Utility MIC core registry METS MODS Mapping form METS Web search

Technical Specifications

Website and Catalog search andretrieval•Apache version (apache 1.3.27)•PHP version (php 4.3.3)

•LDAP type and version (ldap 3.3) - moving toMySQL v5.2

•Zebra version (idzebra 1.3.13)•Yaz version (yaz2.0.4)•IBM P610 server•SuSE Linux OS•MySQL v5.2

Archive Directory•Apache web server•PHP scripting•Certificate utility•LDAP database (ldap 3.3)•IBM P610 server•SuSE Linux OS

Service Providers Directory•Apache web server•PHP scripting•Certificate utility•MySQL v5.2•IBM P610 server•SuSE Linux OS

Cataloging & Ingest-Export Utilities•Apache web server•PHP scripting•Certificate utility•PostgreSQL database•IBM p630 server•IBM Linux OS