CERN Document Server Status News Challenges User Group Workshop 2013 Juelich University Jean-Yves Le...

11
CERN Document Server Status News Challenges User Group Workshop 2013 Juelich University Jean-Yves Le Meur

Transcript of CERN Document Server Status News Challenges User Group Workshop 2013 Juelich University Jean-Yves Le...

Page 1: CERN Document Server Status News Challenges User Group Workshop 2013 Juelich University Jean-Yves Le Meur.

CERN Document Server

Status

News

Challenges

User Group Workshop 2013Juelich University

Jean-Yves Le Meur

Page 2: CERN Document Server Status News Challenges User Group Workshop 2013 Juelich University Jean-Yves Le Meur.

CDS statusRuns with Invenio v1.1.0 + cds-

overlay

Aiming at operating with a standardized SW process: code review,

> 1.5 M records

1000 collections

100 submissions Incubators for some (sub) modules

Set up to support peaks

Invenio integration, release & deployement

Page 3: CERN Document Server Status News Challenges User Group Workshop 2013 Juelich University Jean-Yves Le Meur.

Peaks: Nobel Prize, Open Days, Higgs discovery, LHC Startup

HW setup: LB + 6 nodes (3 virtuals)

SW setup: scheduler on multiple nodes + records cached + heavy processes stopped

→ Submission, search and access immediate

CDS peaks

Sustained ~230 web requests/second and rate

peaks of up to 800 requests/second

Sustained DB processing peaks of ~ 10,000

queries/second

Page 4: CERN Document Server Status News Challenges User Group Workshop 2013 Juelich University Jean-Yves Le Meur.

CDS IncubatingWebNews: highlighting features

Page 5: CERN Document Server Status News Challenges User Group Workshop 2013 Juelich University Jean-Yves Le Meur.

CDS IncubatingSearch Services: to derive user hints from

typed in queries

Page 6: CERN Document Server Status News Challenges User Group Workshop 2013 Juelich University Jean-Yves Le Meur.

CDS IncubatingGeneric submissions to

support various forms with a single WebSubmit config

Page 7: CERN Document Server Status News Challenges User Group Workshop 2013 Juelich University Jean-Yves Le Meur.

CDS IncubatingSearching with 'Add to Search' and bridges to Solr

search and ranking

Page 8: CERN Document Server Status News Challenges User Group Workshop 2013 Juelich University Jean-Yves Le Meur.

CDS ResourcesFull-time SW

engineers:

Institutional repository: 2.5

Multimedia: 1.5

E-Publishing: 1

Page 9: CERN Document Server Status News Challenges User Group Workshop 2013 Juelich University Jean-Yves Le Meur.

Next year(s) trend at CERN Focus on institutional

content and host collections from the subject repo (Inspire)

Use Invenio for admin document server: e.g. of CERN e-bidding app

Start collecting datasets from experiments

Page 10: CERN Document Server Status News Challenges User Group Workshop 2013 Juelich University Jean-Yves Le Meur.

CDS: conclusionCDS set up for peaks

'Incubated code' to go to the codebase

Migrate to 1.2 and then to next

Migrate ~100 submissions to WebDeposit

Continuous Integration into Invenio

Expand the use of Invenio to cover and manage more content (data)

Page 11: CERN Document Server Status News Challenges User Group Workshop 2013 Juelich University Jean-Yves Le Meur.

Thanks for your attention

Questions ?