Artefactual Archivematica Annualmaintenanceagreement v2013!06!21
Building a Digital Archives at the City of Vancouver • METS • PREMIS. Digital Archives Project...
Transcript of Building a Digital Archives at the City of Vancouver • METS • PREMIS. Digital Archives Project...
![Page 1: Building a Digital Archives at the City of Vancouver • METS • PREMIS. Digital Archives Project – Selecting and Integrating Components ... Current Version – Archivematica 0.6](https://reader033.fdocuments.us/reader033/viewer/2022042219/5ec5b80b1f459c34c15fd771/html5/thumbnails/1.jpg)
Building a Digital Archives at the City of Vancouver
Glenn [email protected]
InterPARES 3 Project 3rd International Symposium
Vancouver, BC, Canada29 May 2010
![Page 2: Building a Digital Archives at the City of Vancouver • METS • PREMIS. Digital Archives Project – Selecting and Integrating Components ... Current Version – Archivematica 0.6](https://reader033.fdocuments.us/reader033/viewer/2022042219/5ec5b80b1f459c34c15fd771/html5/thumbnails/2.jpg)
Introduction
• City of Vancouver – Background and Context
• Addressing Digital Records Challenges– Current Challenges– Approach to Solutions
• Influence of Organizational Culture on Digital Preservation Planning
![Page 3: Building a Digital Archives at the City of Vancouver • METS • PREMIS. Digital Archives Project – Selecting and Integrating Components ... Current Version – Archivematica 0.6](https://reader033.fdocuments.us/reader033/viewer/2022042219/5ec5b80b1f459c34c15fd771/html5/thumbnails/3.jpg)
City of Vancouver – Some Context
Incorporated 1886
Largest city in BC and in the Metro region
Population ~580,000 (~28% of metro pop)
Regional centre for BusinessGovernment ServicesEntertainmentTransportation …
![Page 4: Building a Digital Archives at the City of Vancouver • METS • PREMIS. Digital Archives Project – Selecting and Integrating Components ... Current Version – Archivematica 0.6](https://reader033.fdocuments.us/reader033/viewer/2022042219/5ec5b80b1f459c34c15fd771/html5/thumbnails/4.jpg)
City of Vancouver – Organizational Entities
City of VancouverPolice Department
Board of Parks and Recreation
Public Library
Components of the City of Vancouver
![Page 5: Building a Digital Archives at the City of Vancouver • METS • PREMIS. Digital Archives Project – Selecting and Integrating Components ... Current Version – Archivematica 0.6](https://reader033.fdocuments.us/reader033/viewer/2022042219/5ec5b80b1f459c34c15fd771/html5/thumbnails/5.jpg)
Records and Archives – Organizational Context
City Manager’s Office
City Clerk’s Office
Records and Archives Division
Records & Information Management
City of Vancouver Archives
![Page 6: Building a Digital Archives at the City of Vancouver • METS • PREMIS. Digital Archives Project – Selecting and Integrating Components ... Current Version – Archivematica 0.6](https://reader033.fdocuments.us/reader033/viewer/2022042219/5ec5b80b1f459c34c15fd771/html5/thumbnails/6.jpg)
Digital Preservation Challenges
What are the digital preservation challenges specific to the
City of Vancouver?
![Page 7: Building a Digital Archives at the City of Vancouver • METS • PREMIS. Digital Archives Project – Selecting and Integrating Components ... Current Version – Archivematica 0.6](https://reader033.fdocuments.us/reader033/viewer/2022042219/5ec5b80b1f459c34c15fd771/html5/thumbnails/7.jpg)
Digital Preservation Challenges – Broad Acquisitions Mandate
Total Archives - Broad mandate to preserve and make available to the public:
• Public records created by the City and its Boards (Parks, Library & Police)
• Private records from individual, businesses and organizations that document the history of Vancouver
These records are being increasingly produced in digital form, and in many cases, exist only in digital form
![Page 8: Building a Digital Archives at the City of Vancouver • METS • PREMIS. Digital Archives Project – Selecting and Integrating Components ... Current Version – Archivematica 0.6](https://reader033.fdocuments.us/reader033/viewer/2022042219/5ec5b80b1f459c34c15fd771/html5/thumbnails/8.jpg)
Sources of Digital Records – Public Records
• Records Management System (VanDocs)• Unstructured network “shared drives” • Isolated Content Management systems• Enterprise Resource Planning systems
(SAP)• Geographic Information Systems
(VanMap)• Over 250 others on the IT Systems List
![Page 9: Building a Digital Archives at the City of Vancouver • METS • PREMIS. Digital Archives Project – Selecting and Integrating Components ... Current Version – Archivematica 0.6](https://reader033.fdocuments.us/reader033/viewer/2022042219/5ec5b80b1f459c34c15fd771/html5/thumbnails/9.jpg)
Sources of Digital Records – Private Records
Much less ability to control environment in which private records are created and kept
Potential donations range from small donations containing well known formats- digital images- office documents
![Page 10: Building a Digital Archives at the City of Vancouver • METS • PREMIS. Digital Archives Project – Selecting and Integrating Components ... Current Version – Archivematica 0.6](https://reader033.fdocuments.us/reader033/viewer/2022042219/5ec5b80b1f459c34c15fd771/html5/thumbnails/10.jpg)
Sources of Digital Records – Private Records
Also, some very large imminent donations…
![Page 11: Building a Digital Archives at the City of Vancouver • METS • PREMIS. Digital Archives Project – Selecting and Integrating Components ... Current Version – Archivematica 0.6](https://reader033.fdocuments.us/reader033/viewer/2022042219/5ec5b80b1f459c34c15fd771/html5/thumbnails/11.jpg)
Sources of Digital Records
![Page 12: Building a Digital Archives at the City of Vancouver • METS • PREMIS. Digital Archives Project – Selecting and Integrating Components ... Current Version – Archivematica 0.6](https://reader033.fdocuments.us/reader033/viewer/2022042219/5ec5b80b1f459c34c15fd771/html5/thumbnails/12.jpg)
Sources of Digital Records – Private Records
VANOC Records• City is obligated by the Host City
Agreement to preserve the records of the Games
• Almost entirely digital• Extremely large volume (>20 TB)• No influence over creation environment
![Page 13: Building a Digital Archives at the City of Vancouver • METS • PREMIS. Digital Archives Project – Selecting and Integrating Components ... Current Version – Archivematica 0.6](https://reader033.fdocuments.us/reader033/viewer/2022042219/5ec5b80b1f459c34c15fd771/html5/thumbnails/13.jpg)
CoV as Total Archives – Potential Sources of Records
![Page 14: Building a Digital Archives at the City of Vancouver • METS • PREMIS. Digital Archives Project – Selecting and Integrating Components ... Current Version – Archivematica 0.6](https://reader033.fdocuments.us/reader033/viewer/2022042219/5ec5b80b1f459c34c15fd771/html5/thumbnails/14.jpg)
Meeting the Challenge
How is the City of Vancouver Archives addressing these preservation
challenges?
![Page 15: Building a Digital Archives at the City of Vancouver • METS • PREMIS. Digital Archives Project – Selecting and Integrating Components ... Current Version – Archivematica 0.6](https://reader033.fdocuments.us/reader033/viewer/2022042219/5ec5b80b1f459c34c15fd771/html5/thumbnails/15.jpg)
Meeting the Challenge – Digital Archives Project
Phase 1 Phase 2
Timeline: Nov 2008-Oct 2009 Nov 2009-Dec 2010
Focus: Public records(ERDMS)
Private records(VANOC)
Funding: ~$150,000 ~$580,000
Source: ERDMS Project Funds
Olympic Legacy Fund
![Page 16: Building a Digital Archives at the City of Vancouver • METS • PREMIS. Digital Archives Project – Selecting and Integrating Components ... Current Version – Archivematica 0.6](https://reader033.fdocuments.us/reader033/viewer/2022042219/5ec5b80b1f459c34c15fd771/html5/thumbnails/16.jpg)
Digital Archives Project – Preservation Strategy
• Use available open source tools to prepare digital records for preservation– Integrity Checking– File Format Identification and Validation– Malware Checking– Metadata Extraction and Management– Format Migration to Normalized Preservation Copies
and Access Copies– Manage and Provide Web Access to Archival
Descriptions and Access Copies
![Page 17: Building a Digital Archives at the City of Vancouver • METS • PREMIS. Digital Archives Project – Selecting and Integrating Components ... Current Version – Archivematica 0.6](https://reader033.fdocuments.us/reader033/viewer/2022042219/5ec5b80b1f459c34c15fd771/html5/thumbnails/17.jpg)
Digital Archives Project - System Requirements
Looked at a number of requirement sources:
• OAIS Reference Model• InterPARES findings• UNESCO – Towards an Open Source Repository
• METS• PREMIS
![Page 18: Building a Digital Archives at the City of Vancouver • METS • PREMIS. Digital Archives Project – Selecting and Integrating Components ... Current Version – Archivematica 0.6](https://reader033.fdocuments.us/reader033/viewer/2022042219/5ec5b80b1f459c34c15fd771/html5/thumbnails/18.jpg)
Digital Archives Project – Selecting and Integrating Components
• XUbuntu Linux• EXT3 filesystem• Thunar file manager• incron• flock• md5deep and hashdeep• UUID• detox• easy-extract• File Information Tool Set
(FITS)• DROID
• JHOVE• NLNZ Metadata Extractor• Clam AV (anti-virus)• unoconv• OpenOffice.org• BagIt• Zip• Samba/CIFS• NFS-common• ICA-AtoM• Digital Collection Builder• Poster
![Page 19: Building a Digital Archives at the City of Vancouver • METS • PREMIS. Digital Archives Project – Selecting and Integrating Components ... Current Version – Archivematica 0.6](https://reader033.fdocuments.us/reader033/viewer/2022042219/5ec5b80b1f459c34c15fd771/html5/thumbnails/19.jpg)
Archivematica
![Page 20: Building a Digital Archives at the City of Vancouver • METS • PREMIS. Digital Archives Project – Selecting and Integrating Components ... Current Version – Archivematica 0.6](https://reader033.fdocuments.us/reader033/viewer/2022042219/5ec5b80b1f459c34c15fd771/html5/thumbnails/20.jpg)
Digital Archives Project - Archivematica
Project Consultant – Artefactual Systemswww.artefactual.com
Current Version – Archivematica 0.6www.archivematica.org
Expect to begin processing of VANOC records this summer using v0.7 release
![Page 21: Building a Digital Archives at the City of Vancouver • METS • PREMIS. Digital Archives Project – Selecting and Integrating Components ... Current Version – Archivematica 0.6](https://reader033.fdocuments.us/reader033/viewer/2022042219/5ec5b80b1f459c34c15fd771/html5/thumbnails/21.jpg)
InterPARES Participation
Role of InterPARES in CoV Digital Archives Development includes:
•Requirements Source•Feedback on Work•Contribution to Specific Problems
![Page 22: Building a Digital Archives at the City of Vancouver • METS • PREMIS. Digital Archives Project – Selecting and Integrating Components ... Current Version – Archivematica 0.6](https://reader033.fdocuments.us/reader033/viewer/2022042219/5ec5b80b1f459c34c15fd771/html5/thumbnails/22.jpg)
InterPARES Participation
System Requirements Evaluation
•Gap analysis of CoV Digital Archives Requirements against CoP model
•Next - Need to re-assess ‘as built’ system against CoP model
•Development of CoP requirements checklist
![Page 23: Building a Digital Archives at the City of Vancouver • METS • PREMIS. Digital Archives Project – Selecting and Integrating Components ... Current Version – Archivematica 0.6](https://reader033.fdocuments.us/reader033/viewer/2022042219/5ec5b80b1f459c34c15fd771/html5/thumbnails/23.jpg)
InterPARES Participation
Metadata Analysis• Help identifying necessary and sufficient metadata; how and where it is generated
• PREMIS-CoP Mapping –part of work towards building a metadata profile for our Digital Archives
![Page 24: Building a Digital Archives at the City of Vancouver • METS • PREMIS. Digital Archives Project – Selecting and Integrating Components ... Current Version – Archivematica 0.6](https://reader033.fdocuments.us/reader033/viewer/2022042219/5ec5b80b1f459c34c15fd771/html5/thumbnails/24.jpg)
Meeting the Challenge
Is this approach working?
![Page 25: Building a Digital Archives at the City of Vancouver • METS • PREMIS. Digital Archives Project – Selecting and Integrating Components ... Current Version – Archivematica 0.6](https://reader033.fdocuments.us/reader033/viewer/2022042219/5ec5b80b1f459c34c15fd771/html5/thumbnails/25.jpg)
Role of Organizational Culture in the Success of the Digital Archives Project
Project success in part attributed to supportive organizational culture
Combination of:– Us actively working towards contributing to a
favorable organizational culture– Taking advantage of fortuitous circumstances
![Page 26: Building a Digital Archives at the City of Vancouver • METS • PREMIS. Digital Archives Project – Selecting and Integrating Components ... Current Version – Archivematica 0.6](https://reader033.fdocuments.us/reader033/viewer/2022042219/5ec5b80b1f459c34c15fd771/html5/thumbnails/26.jpg)
Organizational Culture – Archives History
History of Canadian Firsts– 1st Municipal Archives– 1st Appointed City Archivist– 1st Purpose Built Municipal Archives Building
Institutional pride in taking a leadership role in the digital realm
![Page 27: Building a Digital Archives at the City of Vancouver • METS • PREMIS. Digital Archives Project – Selecting and Integrating Components ... Current Version – Archivematica 0.6](https://reader033.fdocuments.us/reader033/viewer/2022042219/5ec5b80b1f459c34c15fd771/html5/thumbnails/27.jpg)
Organizational Culture - Leadership
City Council aware of Records and Archives
Progressive attitude towards information technology issues
Open 3 Motion (Spring 2009) promoting– Open Source Software– Open Standards– Open Data
![Page 28: Building a Digital Archives at the City of Vancouver • METS • PREMIS. Digital Archives Project – Selecting and Integrating Components ... Current Version – Archivematica 0.6](https://reader033.fdocuments.us/reader033/viewer/2022042219/5ec5b80b1f459c34c15fd771/html5/thumbnails/28.jpg)
Organizational Culture – Size and Structure
Big and Decentralized• ‘organizational inertia’ • Locating authority can be problematic when
dealing with Records Management issues• Corporate IT vs. Departmental IT• Decentralized IT particularly problematic when
trying to address digital records issues • Archives has worked had to build a positive
relationship with IT
![Page 29: Building a Digital Archives at the City of Vancouver • METS • PREMIS. Digital Archives Project – Selecting and Integrating Components ... Current Version – Archivematica 0.6](https://reader033.fdocuments.us/reader033/viewer/2022042219/5ec5b80b1f459c34c15fd771/html5/thumbnails/29.jpg)
Organizational Culture – Size matters
Archives size is close to idealSmall enough to:
• enjoy relative independence• have minimal red tape within Archives itself
Large enough to:• have specialist staff• have access to resources to act on initiatives• have management whose voices get heard in
other parts of the City’s bureaucracy
![Page 30: Building a Digital Archives at the City of Vancouver • METS • PREMIS. Digital Archives Project – Selecting and Integrating Components ... Current Version – Archivematica 0.6](https://reader033.fdocuments.us/reader033/viewer/2022042219/5ec5b80b1f459c34c15fd771/html5/thumbnails/30.jpg)
Organizational Culture – Location, Location, Location
Reporting relationship – to City Clerk, not Library or Cultural Services
Level of integration and collaboration between Archives and Records Management
![Page 31: Building a Digital Archives at the City of Vancouver • METS • PREMIS. Digital Archives Project – Selecting and Integrating Components ... Current Version – Archivematica 0.6](https://reader033.fdocuments.us/reader033/viewer/2022042219/5ec5b80b1f459c34c15fd771/html5/thumbnails/31.jpg)
Organizational Culture – Professional Skills
Knowledge Base of Records and Archives Staff• Awareness of Digital Issues• Close relationship with MAS programme at UBC
SLAIS• InterPARES veterans
– Current Archives/RIM Staff – 5– Former Staff – 3– Consultants – 2
• Closely knit local archival community
![Page 32: Building a Digital Archives at the City of Vancouver • METS • PREMIS. Digital Archives Project – Selecting and Integrating Components ... Current Version – Archivematica 0.6](https://reader033.fdocuments.us/reader033/viewer/2022042219/5ec5b80b1f459c34c15fd771/html5/thumbnails/32.jpg)
Digital Archives Project (revisited)
Categorizing the Challenges• Technical• Policy• Resource
![Page 33: Building a Digital Archives at the City of Vancouver • METS • PREMIS. Digital Archives Project – Selecting and Integrating Components ... Current Version – Archivematica 0.6](https://reader033.fdocuments.us/reader033/viewer/2022042219/5ec5b80b1f459c34c15fd771/html5/thumbnails/33.jpg)
End
Thank-you