The Future of Technical The Future of Technical Services:Services:

Metadata: Standards and Metadata: Standards and New DevelopmentsNew Developments

NLA Annual Conference, October, NLA Annual Conference, October, 2005 2005

Reno, NevadaReno, Nevada

Vicki Toy SmithVicki Toy SmithUniversity of Nevada, University of Nevada,

RenoReno

Machine Readable Machine Readable Cataloging (MARC)Cataloging (MARC)

Standard in the 1960s Standard in the 1960s Revolutionary advancement at Revolutionary advancement at

the timethe time Development of MARC set the Development of MARC set the

stage for creation of centralized stage for creation of centralized library databaseslibrary databases

40 Years Later (2005)40 Years Later (2005)

Now is the time for recreation of Now is the time for recreation of bibliographic standardsbibliographic standards

Need for new infrastructure = Need for new infrastructure = Existing (MARC) + new standardsExisting (MARC) + new standards

Need for a new set of Need for a new set of standards to be developedstandards to be developed

Some Issues:Some Issues: VersatilityVersatility ExtensibilityExtensibility Cooperative managementCooperative management

What is Metadata?What is Metadata?

““Data about data”Data about data” 5 types of metadata:5 types of metadata:

Descriptive – Title, author, topic, etc.Descriptive – Title, author, topic, etc. Administrative – Record number, record Administrative – Record number, record

date, etc.date, etc. Technical – File size, software needed, etc.Technical – File size, software needed, etc. Rights – Copyright ownership, etc.Rights – Copyright ownership, etc. Management – typically by/for owning Management – typically by/for owning

agencyagency

(Price paid, circulation restrictions, etc.)(Price paid, circulation restrictions, etc.)

ExamplesExamples of metadata of metadata schemasschemas

Dublin Core (Cross disciplinary)Dublin Core (Cross disciplinary) DDI (Social sciences)DDI (Social sciences) EAD (Archives)EAD (Archives) FGDC (Geographic)FGDC (Geographic) IMS (Education)IMS (Education) LOM (Learning Object Metadata)LOM (Learning Object Metadata) MARC (Libraries)MARC (Libraries) METS (Structural metadata)METS (Structural metadata) ONIX (Publishers & booksellers)ONIX (Publishers & booksellers) TEI (Text encoding-Humanities)TEI (Text encoding-Humanities) VRA (Visual resources)VRA (Visual resources) Etc. …Etc. …

Why is Metadata Why is Metadata ImportantImportant??

Increased accessibilityIncreased accessibility Ability for different systems to talk to Ability for different systems to talk to

one anotherone another Expanding useExpanding use Multi-versioningMulti-versioning PreservationPreservation Cost considerationsCost considerations

Examples of Metadata Examples of Metadata Standards Web Sites:Standards Web Sites:

LC standards include:LC standards include: MARC: Machine-Encoded Cataloging:MARC: Machine-Encoded Cataloging:

http://www.loc.gov/marc/ MARCXMLMARCXML

http://www.loc.gov/standards/marcxml/ MODS: Metadata Object Description Schema:MODS: Metadata Object Description Schema:

http://www.loc.gov/standards/mods/ EAD: Encoded Archival Description (LC & SAA):EAD: Encoded Archival Description (LC & SAA):

http://www.loc.gov/ead/

Another standard—Developed by Dublin Core Another standard—Developed by Dublin Core Metadata Initiative:Metadata Initiative:

Dublin Core: Dublin Core: http://dublincore.org

Library related standards:Library related standards:ConsiderationsConsiderations

MARC21 Formats--Representation and communication of MARC21 Formats--Representation and communication of descriptive metadata about information items descriptive metadata about information items International standard (maintained by LC)International standard (maintained by LC) Field/record size limitationsField/record size limitations No ability to embed related objects (e.g. book cover GIF)No ability to embed related objects (e.g. book cover GIF) Limited ability to convey hierarchical/complex Limited ability to convey hierarchical/complex

relationshipsrelationships Narrow focus on catalogingNarrow focus on cataloging Cannot be directly processed by widely-used web Cannot be directly processed by widely-used web

applicationsapplications MARCXML – MARC21 data in an XML structure MARCXML – MARC21 data in an XML structure

Especially useful for description of complex digital library Especially useful for description of complex digital library objectsobjects

Allows libraries to use common computer languageAllows libraries to use common computer language Ignores/simplifies some MARC21 dataIgnores/simplifies some MARC21 data Not an international standard yet (maintained by LC)Not an international standard yet (maintained by LC)

LibraryLibrary related standards: related standards: Considerations (cont’d.)Considerations (cont’d.)

MODS (Metadata Object Description Standard)—XML MODS (Metadata Object Description Standard)—XML markup language for selected data from MARC21 markup language for selected data from MARC21 records as well as original resource descriptionrecords as well as original resource description Richer than Dublin Core; library-oriented XML Richer than Dublin Core; library-oriented XML

metadata schemametadata schema Can accommodate AACR2 standardsCan accommodate AACR2 standards Maintained by same agency (LC) that maintains Maintained by same agency (LC) that maintains

MARC21MARC21 Well-suited as a metadata format for OAI harvestingWell-suited as a metadata format for OAI harvesting Used by some publishers now (e.g. UC Press Used by some publishers now (e.g. UC Press

(California Digital Library) & University of Chicago (California Digital Library) & University of Chicago Press)Press)

MARC21 readily converts to MODS; however, cannot MARC21 readily converts to MODS; however, cannot readily do a reverse conversion of MODS to MARC21readily do a reverse conversion of MODS to MARC21

Community best practice guidelines would enhance Community best practice guidelines would enhance usefulnessusefulness

Archival related standard:Archival related standard:ConsiderationsConsiderations

EAD (Encoded Archival Description)—XML EAD (Encoded Archival Description)—XML markup design for encoded finding aids markup design for encoded finding aids using Standard Generalized Markup using Standard Generalized Markup LanguageLanguage EAD header carries metadata for finding EAD header carries metadata for finding

aidaid Standard maintained by LC along with Standard maintained by LC along with

SAASAA Best suited for archival descriptionBest suited for archival description Provides simple or complex mark-up Provides simple or complex mark-up

design to support varying levels of design to support varying levels of indexingindexing

Needs help at the item levelNeeds help at the item level

Dublin Core standard: Dublin Core standard: ConsiderationsConsiderations

Dublin Core – Metadata element set (for description of Dublin Core – Metadata element set (for description of digital objects)digital objects) Maintenance agency: Dublin Core Metadata Maintenance agency: Dublin Core Metadata

Initiative (DCMI) hosted by OCLC ResearchInitiative (DCMI) hosted by OCLC Research Intended for use by both non-catalogers and Intended for use by both non-catalogers and

specialistsspecialists No MARC tags used with Dublin Core metadataNo MARC tags used with Dublin Core metadata No consistency across different projects using No consistency across different projects using

Dublin CoreDublin Core Documentation for Dublin Core not well-definedDocumentation for Dublin Core not well-defined Western States Best Practices (version 2.0) usefulWestern States Best Practices (version 2.0) useful

http://www.cdpheritage.org/resource/metadata/http://www.cdpheritage.org/resource/metadata/wsdcmbp/wsdcmbp/

UALC Cataloging/Metadata Committee working on UALC Cataloging/Metadata Committee working on handbookhandbook

Some other types of Digital Some other types of Digital Library StandardsLibrary Standards

Library of Congress also working on:Library of Congress also working on: METS (Metadata Encoding & Transmission Standard)—METS (Metadata Encoding & Transmission Standard)—

Structure for encoding descriptive, administrative & Structure for encoding descriptive, administrative & structural metadata (www.loc.gov/mets)structural metadata (www.loc.gov/mets)

OCLC DPR, RLG, Harvard, National Library of Wales OCLC DPR, RLG, Harvard, National Library of Wales exploring or using for various projectsexploring or using for various projects

MIX (NISO Metadata for Images in XML)—XML schema MIX (NISO Metadata for Images in XML)—XML schema for encoding technical data elements required to for encoding technical data elements required to manage digital image collectionsmanage digital image collections

MIX still in developmental stagesMIX still in developmental stages

PREMIS (Preservation Metadata)—Data dictionary and PREMIS (Preservation Metadata)—Data dictionary and supporting XML schemas for core preservation supporting XML schemas for core preservation metadata needed to support the long-term preservation metadata needed to support the long-term preservation of digital materialsof digital materials

Standards necessary when Standards necessary when planning metadata projectsplanning metadata projects

Attention to rules/guidelines when Attention to rules/guidelines when implementing implementing a specific type of metadata a specific type of metadata

Community best practice guidelines need to Community best practice guidelines need to be developed for each schemabe developed for each schema

When standards are revised or extended, it When standards are revised or extended, it will be difficult to transform the metadata will be difficult to transform the metadata from one set to anotherfrom one set to another

When metadata standards are extended to When metadata standards are extended to represent local information, librarian needs represent local information, librarian needs to work with the vendor to accommodate to work with the vendor to accommodate the changethe change

Examine use of crosswalks Examine use of crosswalks

Why use Crosswalks?Why use Crosswalks? Allow for different systems to talk to one Allow for different systems to talk to one

anotheranother Break down data transfer barriers (different Break down data transfer barriers (different

systems can share)systems can share) Combine metadata catalogs (e.g. Union Combine metadata catalogs (e.g. Union

catalogs)catalogs) Provide cross search between unlike Provide cross search between unlike

databases (e.g. Federated search tools)databases (e.g. Federated search tools) Make data/metadata maintenance more Make data/metadata maintenance more

efficientefficient Enable conversion between record types Enable conversion between record types

(MARCXML, MODS, DC)(MARCXML, MODS, DC) Reduce cost in technical services processingReduce cost in technical services processing

Crosswalking challengesCrosswalking challenges Schema granularity: One to many matches; Schema granularity: One to many matches;

many to one matchesmany to one matches Crosswalking schemas need different Crosswalking schemas need different

granularity levelsgranularity levels Specificity lacking to describe library Specificity lacking to describe library

resourcesresources Handling object relationships or hierarchiesHandling object relationships or hierarchies

(e.g. EAD=>MARC, etc.)(e.g. EAD=>MARC, etc.) Crosswalking is rarely a one to one mappingCrosswalking is rarely a one to one mapping Process results in some “un-mappable” Process results in some “un-mappable”

datadata

Crosswalking model: MarcEdit allows catalogers to Crosswalking model: MarcEdit allows catalogers to translate data from one schema to anothertranslate data from one schema to another

(From Terry Reese’s metadata presentation at ALA (From Terry Reese’s metadata presentation at ALA Summer Program 2005)Summer Program 2005)

Future of technical services + Future of technical services + metadata?metadata?

Some issues to consider in planning new metadata projectsSome issues to consider in planning new metadata projects

Choose a metadata schema that can make web searching more Choose a metadata schema that can make web searching more meaningfulmeaningful

Choose a metadata schema that will help get your informationChoose a metadata schema that will help get your informationto the right audienceto the right audience

LC and others developing metadata tools LC and others developing metadata tools

LC providing tools for translating MARC records into MODSLC providing tools for translating MARC records into MODS

OCLC working on crosswalk (Metadata Switch Project)OCLC working on crosswalk (Metadata Switch Project)http://www.oclc.org/research/mswitch/default.htmhttp://www.oclc.org/research/mswitch/default.htm

OCLC working on FRBR algorithmOCLC working on FRBR algorithmhttp://www.oclc.org/research/projects/frbr/algorithm.htmhttp://www.oclc.org/research/projects/frbr/algorithm.htm

Future of technical services + metadata? (Cont’d.)Future of technical services + metadata? (Cont’d.)Individuals also creating metadata tools—Individuals also creating metadata tools—

Terry Reese’s Marc Edit tool Terry Reese’s Marc Edit tool

Future of technical services Future of technical services + metadata? (cont’d.)+ metadata? (cont’d.)

Examination of standards and protocols Examination of standards and protocols

being developed for the harvesting of being developed for the harvesting of metadatametadata e.g. Open Archives Initiative for Metadata e.g. Open Archives Initiative for Metadata

HarvestingHarvesting http://www.openarchives.org/http://www.openarchives.org/

New DevelopmentsNew Developments

System migration considerations for System migration considerations for all parties concernedall parties concerned

More publishers starting to provide More publishers starting to provide XML records XML records e.g. UC Press recordse.g. UC Press records

Federated Search Tools being Federated Search Tools being developeddeveloped e.g. Innovative Interfaces: Millennium e.g. Innovative Interfaces: Millennium

Access Plus (MAP)Access Plus (MAP)

New Developments (cont’d.)New Developments (cont’d.)

Vendors now providing XML tools to manage digital Vendors now providing XML tools to manage digital

collectionscollections

Innovative Interfaces products:Innovative Interfaces products: Millennium Media ManagementMillennium Media Management

Creates/stores media objects (e.g. images, sound Creates/stores media objects (e.g. images, sound files, audio files)files, audio files)

Also includes a Copyright/Access component to Also includes a Copyright/Access component to handle licensing/copyright issues of digital collectionshandle licensing/copyright issues of digital collections

XML HarvesterXML Harvester Gathers XML records from any serverGathers XML records from any server Parses/creates record on Innovative systemParses/creates record on Innovative system

Metadata Builder—Supports EAD, DC & XMLMetadata Builder—Supports EAD, DC & XML Stores XML in metadata schema of choiceStores XML in metadata schema of choice

What can libraries do today?What can libraries do today?

Libraries can provide metadata services (e.g. MIT):Libraries can provide metadata services (e.g. MIT): MIT’s Metadata services includes:MIT’s Metadata services includes: Data & conceptual modelsData & conceptual models XML bindingXML binding Best practicesBest practices ApplicationsApplications TrainingTraining

http://libraries.mit.edu/metadata/services.htmlhttp://libraries.mit.edu/metadata/services.html Libraries can develop new pilot projects to investigate uses of metadataLibraries can develop new pilot projects to investigate uses of metadata Libraries can request that vendors/publishers develop new products to Libraries can request that vendors/publishers develop new products to

facilitate changefacilitate change UNR has begun several pilot projects using:UNR has begun several pilot projects using:

Dublin CoreDublin Core EADEAD

Example of EAD Finding Aid (with style sheet)Example of EAD Finding Aid (with style sheet) http://www.library.unr.edu/specoll/9716.xmlhttp://www.library.unr.edu/specoll/9716.xml

MARC Edit toolkitMARC Edit toolkit

Current Metadata projects Current Metadata projects at UNRat UNR

Digital collections (using CONTENTdm) with metadata coded Digital collections (using CONTENTdm) with metadata coded in Dublin Core:in Dublin Core:

http://imageserver.library.unr.edu/http://imageserver.library.unr.edu/

Metadata harvesting by:Metadata harvesting by:

UALC’s Mountain West Digital LibraryUALC’s Mountain West Digital Library

http://www.lib.utah.edu/digital/mwdl/http://www.lib.utah.edu/digital/mwdl/

University of Michigan’s OAIsterUniversity of Michigan’s OAIster

http://oaister.umdl.umich.edu/o/oaister/http://oaister.umdl.umich.edu/o/oaister/

Useful Web SitesUseful Web Sites Standards at the Library of CongressStandards at the Library of Congress

http://www.loc.gov/standardshttp://www.loc.gov/standards XML Standards at the Library of Congress LC Network XML Standards at the Library of Congress LC Network

Development and MARC Standards ( framework for Development and MARC Standards ( framework for working with MARC data in a XML environment)working with MARC data in a XML environment) http://www.loc.gov/standards/marcxml/http://www.loc.gov/standards/marcxml/

Library of Congress Portals Applications Issues GroupLibrary of Congress Portals Applications Issues Group http://www.loc.gov/catdir/lcpaig/http://www.loc.gov/catdir/lcpaig/

NISO Web Site identifies, develops, maintains, NISO Web Site identifies, develops, maintains, publishes technical standards to manage information publishes technical standards to manage information in digital environmentin digital environment http://www.niso.org/http://www.niso.org/

NISO article on Understanding MetadataNISO article on Understanding Metadata http://www.niso.org/standards/resources/http://www.niso.org/standards/resources/

UnderstandingMetadata.pdfUnderstandingMetadata.pdf Terry Reese’s Marc Editing UtilityTerry Reese’s Marc Editing Utility

http://oregonstate.edu/~reeset/marcedit/html/http://oregonstate.edu/~reeset/marcedit/html/

Thank you!Thank you!

Vicki Toy Smith, Principal CatalogerVicki Toy Smith, Principal Cataloger

University of Nevada, RenoUniversity of Nevada, Reno

vicki@unr.eduvicki@unr.edu