National Digital Information Infrastructure and Preservation Program (NDIIPP)

National Digital Information Infrastructure and Preservation Program (NDIIPP)

CNI Project BriefingDecember 5, 2005

www.digitalpreservation.gov 2

NDIIPP Elements

Technical Architecture

Research

Preservation Partners


Lead Institutions for the 8 Partnerships

• California Digital Library: Web political content• Emory University: MetaArchive of Southern digital culture• UC Santa Barbara: NGDA Geospatial Data• NC State University: Geospatial Data• U of Maryland: Dot.com business records• U of Michigan: DataPASS--Social science data• U of Illinois, OCLC, State & academic libraries, NCSA: State

government publications, among other content• WNET/PBS: Digital television(red=represented in today’s panel)


Goals for the Partnerships• Identify/select/collect content;

communicate strategies for doing so• Probe intellectual property issues• Collaborate broadly in developing a

shared technical architecture• Study economic sustainability• Identify and share best practices• Learn how to build and incrementally

improve a preservation network


Network of Networks• LC pleased to see interconnections

between partners, other networks• Some examples:

– Association of Research Libraries– Digital Library Federation– Coalition for Networked Information – UK Joint Information Systems Committee


Broad Categories of Challenges

• Technical

• Legal

• Social

• Economic


MetaArchive Project Emory Univ. & partners

• Distributed preservation network of six institutions now deployed and functioning

• Conspectus database (based on UKOLN RSLP and DCC) of all collections archived in the network of nodes

• Now working on developing a long-term Cooperative to support our network

• Negotiating many issues about organizational roles and responsibilities in such a Cooperative

• Examining various organizational structures for the Cooperative, including unincorporated association for interim period of 1-2 years, and 501(c)(3) for subsequent long term; now drafting inter-institutional contracts


North Carolina Geospatial DataArchiving ProjectProject Goals• Preservation of state and local geospatial data

resources• Engaging existing spatial data infrastructureEmerging Challenges• Rethinking content: not just data--also cartographic

representation and geospatial documents• Technical challenges: handling complex objects in a

repository; spatial databases• Engaging the industry: making the case for historic

and temporal data--gathering use cases

UCSB—Geospatial Data: NGDA Overviewhttp://www.ngda.org


UCSB NGDA: FIRST YEAR PROGRESS AND ISSUES Designed NGDA architecture; combination of new and available:

Storage subsystem (Isilon, Archivas) Server to connect components and manage ingest Existing ADL as interface for access and federation Major challenge: Developing Geospatial Format Registry

Collections issues in archiving geospatial imagery: Developing collection policies and provider contracts Definition of “at-risk” digital information Identifying good collections to test/prototype system:

• UCSB: 3 TB CaSIL data; Stanford: .5 TB, Rumsey Collection

Major challenge: Multi-layered data environment and poorly documented formats

Team building challenges: People who understand mission and have technical skills Developing a common vocabulary

Year Two goals: Web-accessible prototype for demonstration Economic sustainability models Collections (MODIS, Landsat, Shapefiles, DOQQ)


ECHODepository: Illinois, OCLC, State & Academic Libraries, NCSA• Year 1 Accomplishments:

– Selection rationale (Arizona Model)– OCLC Web Archiving Workbench Tools– Repository evaluation– Repository interoperability: Hub & spoke

model – Partnership building: NCSA, CDL, others

• Challenges:– Scalability & flexibility of software &

storage architectures– Import/export commonalities: METS


CDL: Web at RiskA Distributed Approach to Preserving our Nation’s Heritage

• Project Goal: develop a web-archiving service to enable institutions to continue their historic collection, management, and preservation roles.

• Collection Challenges: web-based events (Katrina)– The nature of events on the web– Technical and social issues– Selection, collection & classification – Balancing rights and acquisition needs– Understanding information retrieval


Michigan: Data Preservation Alliance for the Social Sciences (DataPASS)• Goals:

– Build Partnership to Identify and preserve at-risk digital social science content

– Successful creation of a database of content

• What have we learned? – Identification/selection daunting – Technology challenging – Aided by social science metadata

standards– Building a partnership very useful


Emerging Issues

• Natural tension between collaboration and tradition of institution-specific approaches

• Much interest in joint infrastructure, but developing shared services will take time

• Existing preservation methods are being stretched

• Balancing a focus on project goals while also considering lots of interesting ideas


Learning and Incremental Development

• We need to get broad feedback and continue learning

• Still no “silver bullet” solution to digital preservation

• NDIIPP considering all viable approaches, working toward gradual development of decentralized, interoperable architecture

• Our partners are modeling this approach


Contact Information:• LOC: William Lefurgy• CDL: Patricia Cruse• Emory: Martin Halbert• Illinois: Beth Sandore • Michigan: Myron

Gutmann• NC State: Steven Morris• UCSB: Sarah Pritchard

[email protected]@[email protected]@[email protected][email protected]@library.ucsb.edu

National Digital Information Infrastructure and Preservation Program (NDIIPP)

Documents

Transcript of National Digital Information Infrastructure and Preservation Program (NDIIPP)