Building the Legal Deposit E-journal archive for the UK

Andrew MacEwan

7th September 2015

www.bl.uk 2

The path to legislation – electronic publications

1911

80s/90s

1997

2000

2003

Copyright Act 1911, Section 15…

LDLC and British Library campaigns for new legislation

Public Consultation

Code for Voluntary Deposit of Electronic Publications

Legal Deposit Libraries Act

www.bl.uk 3

6th April 2013…

• Legal Deposit Libraries (Non-Print Works) Regulations 2013

• Extension of existing legal framework

• Systematic collection of UK’s published output for heritage & preservation

• By 6 UK Legal Deposit Libraries

www.bl.uk 44

4

Print legal deposit infrastructure

British Library, St Pancras British Library, Boston Spa

Agency for the Legal Deposit Libraries (ALDL)The remaining 5 legal deposit libraries (i.e. excluding the BL) in the UK and Ireland manage their legal deposit claiming and receipting activities through a single, joint funded agency that operates on their behalf

www.bl.uk 5

Legal Deposit Libraries shared infrastructure for digital materials

Catalogue Access

DAMS

DLS

DLS

TDR

DLS

DLS

Others

= Legal deposit content

= Purchased & other content

DAMS = Digital Asset Management SystemDLS = Digital Library SystemTDR = Trusted Digital Repository

CatalogueAccess

DLS

Others

Catalogue Access

DLS

DLS

Catalogue Access

DLS

DLS

Legal deposit ingest

www.bl.uk 66

Digital storage – replication across 4 nodes

•

StP

BSp

NLW

NLS

Ox Ca

TCD

JANET

Access Gateway

Storage Node

www.bl.uk 7

Scope – the challenge for digital preservation of UK published output

• 2013 legislation covers systematic collection of UK’s published output for heritage & preservation:

• E-journals• E-books• Maps• Music scores• Newspapers• UK Web Archive

• including harvesting of significant documents published within websites

2017 review of legislation

www.bl.uk 8

Benefits of developing a shared infrastructure for digital content

• Reduces burden on publishers (deposit of 1 distributed copy rather than 6)

• Avoids duplication of effort across legal deposit libraries in the UK across digital life cycle

• Allows costs to be shared

• Standardises access – same legal deposit content accessible across all legal deposit libraries

• Pooling of expertise and knowledge

www.bl.uk 9

Challenges of a shared and collaborative approach

• System integration and compatibility across all LDLs

• Agreement needed across all LDLs to transition publishers from print to non print legal deposit

• Role of the national libraries v role of university libraries

• Increased collaboration/co-ordination with ALDL in managing publisher transition

• Metadata sharing and record enhancement

• Managing expectations and BL reputation

www.bl.uk 10

UK e-journal Legal Deposit – Progress to date

Journals - Titles• via Portico – c.3047 titles• via direct ftp feed –

• c.1375 titles new to legal deposit• c.5600 titles transitioned from voluntary deposit

• via publisher portal – a few titles with ISSNs deposited by small scale publishers

•Journals – volume of articles deposited as at 31 August 2015• • 1,035,574 articles

www.bl.uk 11

NPLD - Resource implications for the British Library• Work planned over coming 24 months to further scale up

capacity of workflows for non print legal deposit journals

• Increased automation required to continue to intake at scale

• Increased resources/skills development in area such as:– Content prioritisation– Publisher liaison/communication– Set up costs as publishers transition (BL/ALDL)– Processing of digital content and managing exceptions– Metadata normalisation– Adapting to new/developing formats– Digital preservation

www.bl.uk 12

1 - Publisher Engagement

Start of Year

•CDI•Potential Candidate publishers identified

Throughout Year

•CDAS•Prioritisation Group

August

•Serials Data Analysts

•Auto-Match Aleph checking

September

•CDI•Manual Aleph Checking

Early October

•Collection Processing – Print Serials Team

•Complete Aleph amendments

www.bl.uk 13

2 - Record Creation

October

•CDI• Final Agreement with Publisher

• List of agreed titles sent to BL

November

•Serials Data Analysts • Tracking spreadsheet created for collection processing to work from.

November /December

• Collection Processing - DPT & Print Serials • Aleph checked for suitable record / record created

• Admin data added to record

November / December

•Cataloguing•Records updated where necessary.

January

•Collection Processing – Print Serials •Print equivalent records on Aleph are closed.

www.bl.uk 14

3 - Arrival of Content

Throughout Year

•Portico•Portico supply titles via FTP – with normalised metadata

Throughout Year

•Items arrive in zipped files termed ‘deliveries

Throughout Year

•FTP feeds into Portico ingest platform

Throughout Year

•Collection Processing - DPT

•Articles are extracted from zips and processed

Throughout Year

• Collection Processing – Print Serials

• Auto-accessioning

• Exception handling

www.bl.uk 15

3 - Arrival of Content

www.bl.uk 16

Publisher Portal – basic capability for smaller publishers

www.bl.uk 17

Long term preservation of e-journals

• Ensure our digital repository can store and preserve our collections for the long term

• ISO 16363 Trustworthy Digital Repository Assessment– Organisational Infrastructure: including governance,

organisational structure, staffing, procedural accountability, policy framework, etc.

– Digital Object Management: including acquisition and ingest, preservation planning, creation and preservation of AIP, and information and access management.

– Infrastructure and Security Risk Management: including technical infrastructure risk management and security risk management.

www.bl.uk 18

The future…

• Develop capacity & capability– Harvesting documents (inc. serials) from websites– Improved use of identifiers in e-journal metadata (ISSNs,

DOIs, ISNIs)– Develop a more scalable Publisher Portal

Transition more publishers 2016 onwards

Contribute to 2017 review of the regulations

www.bl.uk 19

Any questions?