Europeana Newspapers Aggregation and Indexing Plan

39
Europeana Newspapers WP 4 Aggregation & Indexing Plan Anastasia Gacia and Markus Muhr

description

Presentation on WP4 (Aggregation and Indexing Plan) at Europeana Newspapers Annual Meeting in Vienna (Markus Muhr & Natasa Gassia)

Transcript of Europeana Newspapers Aggregation and Indexing Plan

Page 1: Europeana Newspapers Aggregation and Indexing Plan

Europeana Newspapers WP 4

Aggregation & Indexing Plan

Anastasia Gacia and Markus Muhr

Page 2: Europeana Newspapers Aggregation and Indexing Plan

2

Agenda

● Customer Relationship Management● Aggregation Workflow - Metadata

• Aggregation Workflow - Full-text and Images

• Newspaper Content Browser Options

• Viewing Images

• Delivery to Europeana / Zeitschriftendatenbank

• Aggregation and Indexing Plan

• Questions

Page 3: Europeana Newspapers Aggregation and Indexing Plan

3

Customer Relationship Management

• SugarCRM

• Management of all administrative information• Organisations, contacts, datasets, projects, etc.

• Important features for project handling• Newspaper collections• Cases per specific collection• Aggregation and Indexing Plan• Automatic reporting

Page 4: Europeana Newspapers Aggregation and Indexing Plan

4

Customer Relationship Management

Page 5: Europeana Newspapers Aggregation and Indexing Plan

5

Aggregation Workflow – Metadata

● Scheduling of ingestion● Datasets ready for harvesting● Create case in CRM: case # to provider● Harvesting metadata (OAI-PMH, FTP, ...)● Enhance metadata (VIAF, Geonames, MACS,...)● Indexing in acceptance portal ● E-mail to provider to accept dataset● Live index = live portal● Delivery to Europeana● Enhancing and publishing in Europeana

Page 6: Europeana Newspapers Aggregation and Indexing Plan

6

Aggregation Workflow - Full-text and Images

● Hard-disk delivery by UIBK/CSS● Hard-disk delivery to ULCC● Ingestion and alignment of fulltext and images with

harvested metadata● JPEG 2000 generation for hosted IIP image server● Enrichment with named entities from KB – Not Yet● Indexing into content browser● Adaptations of image viewer for external image servers

• E-mail to partner

Page 7: Europeana Newspapers Aggregation and Indexing Plan

7

Newspaper Content Browser Options

• Questionnaire to content providers determined how the content would appear in newspaper content browser

• Option 1 - Images and full-text (NLL, NLF)• Option 2 - Snippets of images and full-text (LFT)• Option 3 - Full-text only – Not supported (Nobody selected)• Option 4 - Metadata only – Not supported yet • Option 5 - Option 1 via external image server (ONB)• Option 6 - Option 2 via external image server – Not supported yet

Page 8: Europeana Newspapers Aggregation and Indexing Plan

8

Browser Option 1

Page 9: Europeana Newspapers Aggregation and Indexing Plan

9

Browser Option 2

Page 10: Europeana Newspapers Aggregation and Indexing Plan

10

Browser Option 5

Page 11: Europeana Newspapers Aggregation and Indexing Plan

11

Delivery to Europeana / Zeitschriftendatenbank

● Metadata from Full and Associate Partners should go into Newspapers content browser, Europeana portal and Zeitschriftendatenbank / Union Catalogue of Serials

● EDM to Europeana● Duplin Core to Zeitschriftendatenbank

● Europeana Data Model delivery should be finalised soon

Page 12: Europeana Newspapers Aggregation and Indexing Plan

12

Europeana Data Model

Page 13: Europeana Newspapers Aggregation and Indexing Plan

13

Dublin Core

Page 14: Europeana Newspapers Aggregation and Indexing Plan

14

Aggregation and Indexing Plan – Q3 2013

Page 15: Europeana Newspapers Aggregation and Indexing Plan

15

Aggregation and Indexing Plan – Q3 2013

● Österreichische Nationalbibliothek / Austrian National Library – Option 5

● Kansalliskirjasto / National Library of Finland – Option 1 (new)● Numbers are not matching hundred percent

Page 16: Europeana Newspapers Aggregation and Indexing Plan

16

Aggregation and Indexing Plan – Q4 2013

Page 17: Europeana Newspapers Aggregation and Indexing Plan

17

Aggregation and Indexing Plan – Q4 2013

Page 18: Europeana Newspapers Aggregation and Indexing Plan

18

Aggregation and Indexing Plan – Q4 2013

● Landesbibliothek Dr. Friedrich Teßmann / Teßmann Library – Option 2● Missing links to original at partner library

● Österreichische Nationalbibliothek / Austrian National Library – Option 5 and 4● Metadata only is missing

Page 19: Europeana Newspapers Aggregation and Indexing Plan

19

Aggregation and Indexing Plan – Q4 2014

● Bibliotheque Nationale de France / National Library France – Option 6● Moved to Q1 2014

● Latvijas Nacionala Biblitoteka / National Library of Latvia – Option 1● Missing links to original at partner library

Page 20: Europeana Newspapers Aggregation and Indexing Plan

20

Aggregation and Indexing Plan – Q4 2013

● Landsbókasafn Íslands - Háskólabókasafn / National and Univeristy Library of Iceland – Associated Partner

● National Library of Spain – Associated Partner

● Bibliothèque nationale de Luxembourg / National Library of

Luxembourg – Associated Partner● Working on it, problems with format

Page 21: Europeana Newspapers Aggregation and Indexing Plan

21

Aggregation and Indexing Plan – Q1 2014

● Bibliotheque Nationale de France / National Library France – Option 6

● Eesti Rahvusraamatukogu / Estonian National Library – Option 1

● Milli Kutuphane Baskanligi / National Library of Turkey – Option 4

Page 22: Europeana Newspapers Aggregation and Indexing Plan

22

Aggregation and Indexing Plan – Q1 2014

● Staatsbibliothek zu Berlin / Berlin State Library – Option 1

● Staats- und Universitätsbibliothek Hamburg / State and University Library Hamburg – Option 1

● Univerzitet u Beogradu / University Library of Belgrade – Option 1

Page 23: Europeana Newspapers Aggregation and Indexing Plan

23

Aggregation and Indexing Plan – Q1 2014

● National Library of Wales – Associated Partner

● National Library and University Library in Zagreb – Associated Partner

Page 24: Europeana Newspapers Aggregation and Indexing Plan

24

Aggregation and Indexing Plan – Q1 2014

● St. Cyril and Methodius National Library / The National Library of Bulgaria – Associated Partner

● National Library of Czech Republic – Associated Partner

Page 25: Europeana Newspapers Aggregation and Indexing Plan

25

Aggregation and Indexing Plan – Q2 2014

● Bibliotheque Nationale de France / National Library France – Option 5

● Eesti Rahvusraamatukogu / Estonian National Library – Option 1

Page 26: Europeana Newspapers Aggregation and Indexing Plan

26

Aggregation and Indexing Plan – Q2 2014

● Biblioteka Narodowa / National Library of Poland – Option 2

● Staats- und Universitätsbibliothek Hamburg / State and University Library Hamburg – Option 1

● Koninklijke Bibliotheek / National Library of the Netherlands – Option 5

Page 27: Europeana Newspapers Aggregation and Indexing Plan

27

Aggregation and Indexing Plan – Q2 2014

● Narodna in univerzitetna knjižnica / National and University Library of Slovenia – Associated Partner

● National Library of Portugal – Associated Partner

● National Library of Romania – Associated Partner

Page 28: Europeana Newspapers Aggregation and Indexing Plan

28

Aggregation and Indexing Plan – Q3 2014

● Bibliotheque Nationale de France / National Library France – Option 5

● Eesti Rahvusraamatukogu / Estonian National Library – Option 1

Page 29: Europeana Newspapers Aggregation and Indexing Plan

29

Aggregation and Indexing Plan – Q3 2014

● Staatsbibliothek zu Berlin / Berlin State Library – Option 1

● Staats- und Universitätsbibliothek Hamburg / State and University Library Hamburg – Option 1

Page 30: Europeana Newspapers Aggregation and Indexing Plan

30

Aggregation and Indexing Plan – Q4 2014

● Bibliotheque Nationale de France / National Library France – Option 5

● Eesti Rahvusraamatukogu / Estonian National Library – Option 1

Page 31: Europeana Newspapers Aggregation and Indexing Plan

31

Aggregation and Indexing Plan – Q4 2014

● Staatsbibliothek zu Berlin / Berlin State Library – Option 1

● Staats- und Universitätsbibliothek Hamburg / State and University Library Hamburg – Option 1

● Kansalliskirjasto / National Library of Finland – Option 1

Page 32: Europeana Newspapers Aggregation and Indexing Plan

32

Operations Officer

Anastasia Gasia

Junior Operations Officer

[email protected]

Operations Mailbox: [email protected]

Page 33: Europeana Newspapers Aggregation and Indexing Plan

Thank you for your attention!

Markus Muhr ([email protected])

www.europeana-newspapers.eu

Page 34: Europeana Newspapers Aggregation and Indexing Plan

34

Customer Relationship Management

Page 35: Europeana Newspapers Aggregation and Indexing Plan

35

Customer Relationship Management

Page 36: Europeana Newspapers Aggregation and Indexing Plan

36

Aggregation Workflow – Metadata

Page 37: Europeana Newspapers Aggregation and Indexing Plan

37

Viewing Images

● The European Library hosts images for Option 1 and 2 ● IIP Image Server with JPEG 2000● Viewing images transformed into JPEG 2000● Ingestion workflow includes transformation step for tifs and

jpgs● Time-demanding operation● Image viewer is IIPMooViewer● Open source projects ● Europeana Regia

http://www.theeuropeanlibrary.org/tel4/virtual/regia

Page 38: Europeana Newspapers Aggregation and Indexing Plan

38

Viewing Images

● External image servers for Option 5 and 6 ● Current support of external viewers via iframe

● Alignment and highlighting not available● Improved usage of content browser via integrated image

viewer● Adaptations for each different kind of image server● Time-demanding task● Existing viewer that can be easily embedded in the

Newspaper Content Browser are preferable● Technical support at partner libraries is necessary

Page 39: Europeana Newspapers Aggregation and Indexing Plan

39

Aggregation and Indexing Plan

● Plan includes aggregation of partners and 11 associated partners

● Q3 first quarter with indexing work● Aggregation and indexing is aligned with deliveries from

UIBK/CCS● Deliveries to Europeana & Zeitschriftendatenbank from Q4

onwards● Aggregation and indexing is split over multiple quarters for

some partners