Digital Long-term Preservation Service in Finland

DLM Forum Members Meeting

13.5.2011

Digital preservation in Finland• 2000 SÄHKE work initiated• 2005 SÄHKE1 national standard

– Case mgmt requirements to records mgmt & Metadata model

• 2006 VAPA work initiated– Ingest, preservation and service

• 2009 SÄHKE2 standard– Information mgmt requirements

• 2011 VAPA completed– Information service with ASTIA service in-house project

• 2014(?) SÄHKE3 standard– Databases and registers– Flexibility added to Metadata model

What is VAPA Services

Included in VAPA Services

VAPA enterprise system

Dissemination servicesIngest services Administration services

Astia VirpaInformation

serviceIngest Reports

User mgmt

User access mgmt

Ingest service systems (Extranet)

SFTPJasper

Reports

Dissemination service systems

SDB

Administration systems

Information resources

ContentAccess rights

Users

User info mgmt

SDBmgmt

Identification services

VAPA Main Items• Ingest and submission• Workflow Management• User Management• Security• ASTIA integration• Piloting• Organization’s access to own content

Ingest and submission

• SÄHKE2 standard– Requirements on case mgmt– Metadata model XML schema– Transfer instructions– Workflow driven– Security through signature

• AIP sustainability

Submission prerequisites

• Permission to preserve digitally• Content complying to SÄHKE2 standard• Organizational readiness• Technical readiness• Transfer agreement

SÄHKE2 standard

Workflow Management

• SDB4 Workflow engine• Suitable for SÄHKE2 standard• Transparency• Error logging• Managing workflows by ourselves• Error action: Warning, cancel, halt

Workflow processVerify metadata filesAuthorize sender

Retrieve sender certificate from LDAP

Verify varmiste.sig with the certificate

Verify claimed relation with submission party is correct

Verify all attached metadata files are listed in the varmiste.sig and vice versa

Compare checksum of each attached metadata file with listed value in the varmiste.sig

Verify content files

Compare checksum of each attached content file with listed value in the referring metadata file

halt workflow

Validate supplied sahke metadata files

User Management

• Based on Liferay• Synchronization with LDAP• Transfer agreement• Organizations, groups and roles• Access rights to preserved content• ASTIA integration• Most concerns

Security

• Much emphasis on security• Auditing documents

– Describing processes, conventions

• Auditing environment– Security stress test

• Auditing system source code• Auditing pilots

Piloting Findings• Increase publicity and confidence• Increase organizational readiness• Implementation and deployment

– At organizational level– Many tasks to perform– Comply with SÄHKE and security requirements– Certification of case mgmt systems (RDMS)– Auditing SÄHKE conformance

• Resourcing– Training and support

Test Findings• Complex testing

– Configuration– Unique submissions

• Testing tool to produce

• Test report tool• Change mgmt• Regression testing

– Also required for production phase

Information service

• ASTIA and VIRPA services• Unassigned content: organization

– From its own operating system– VIRPA service with original, stored Ids

• Assigned content – National Archives– Organization disposes assigned content

ASTIA integration• User interface of content utilisers

– Querying all content resources• Paper and digitized content• Born digital content• OAI-PMH harvesting interface

• Delivering DIP and records– Synchronous, asynchronous

– Security, Session control• Common User Management

– Access rights management– Identification, registration and login

Organization access to own content – VIRPA service

• Reliable integration between systems– Government office system <> VAPA

• Security audit required at organization• Organization keeps Metadata of transferred records

and cases• Organization uses stored original ID’s• Organization’s access rules access

Future of digital preservation

• All administration 2015? (government, municipalities)• Preservation of fixed term content 2015?• SÄHKE3 implemented in VAPA 2015

– SÄHKE3 will define Metadata model for databases– SÄHKE3 preliminary work started– SÄHKE3 standard 2014– Database submissions from 2015