Introduction

18
LCG Introduction John Gordon, STFC GDB meeting @CERN September 8 th 2010

description

Introduction. John Gordon, STFC GDB meeting @CERN September 8 th 2010. Since the Previous Meeting. Data Management and Storage Jamboree, Amsterdam, 16-18 June EGEE III Final Review Amsterdam 23-24 June LHC OPN, Barcelona, 28-29 June WLCG Workshop , London, 7-9 July. GDB meetings in 2010. - PowerPoint PPT Presentation

Transcript of Introduction

Page 1: Introduction

LCG

Introduction

John Gordon, STFC

GDB meeting @CERN September 8th 2010

Page 2: Introduction

LCG

Since the Previous Meeting

• Data Management and Storage Jamboree, Amsterdam, 16-18 June

• EGEE III Final Review Amsterdam 23-24 June • LHC OPN, Barcelona, 28-29 June• WLCG Workshop, London, 7-9 July

2

Page 3: Introduction

LCG GDB meetings in 2010• Second Wednesday of each month• Pre-GDB rooms booked, October

3

• January 13 • February 10 • March 24• May 12• June 9

• July 14• August 11• September 8• October 13• November 10• December 8

Page 4: Introduction

LCG GDB meetings in 2011• Propose second Wednesday of each month• Rooms booked• Do these dates clash with anything?• Offer from Lyon to visit in March

4

• January 12 • February 9 • March 9• April13 • May 11• June 8

• July 13• August 10• September 14• October 12• November 9• December 14

Page 5: Introduction

LCG

Pre-GDB meetings

• None currently planned• Could use October for DAaM demonstrators

Page 6: Introduction

LCG

Forthcoming Events

• EGI Technical Forum, Amsterdam,13-17 September• LHCOPN, CERN, 7-8 October • CHEP 10, Taipei, 17-22 October• HEPiX Fall Meeting, Cornell, 1-5 November

6

Page 7: Introduction

LCG

GDB Issues

• MU Pilot Jobs, SCAS, gLExec• CREAM • SL5

– Enough resources for experiments– Latest software releases SL5 only

• Virtualisation• Installed capacity

7

Page 8: Introduction

LCG

Main Topics Today

• Accounting• Software Distribution• Middleware• Network Monitoring• Operational Feedback from the experiments

Page 9: Introduction

LCG

[email protected] 9

• Pilot jobs, glexec, SCAS, etc (1st July)– Maarten’s summary on agenda– http://litmaath.home.cern.ch/litmaath/GDB/

• CREAM deployment:– >100 sites have a CREAM CE; – still missing job submission from condor-g (needed by ATLAS)– Stability and reliability of CREAM still not good enough to replace

LCG-CE, many open tickets

Milestones

Page 10: Introduction

LCG

[email protected] 10

• From DM and virtualisation activities:– Create a small architectural team – Address several strategic questions: (Nov)

• Xrootd as a strategy for data access by all experiments? • Need for ability to reserve whole WN (to better use cores) – is

this a clear requirement for all experiments?• CERNVM and/or CVMFS as a strategy for all experiments?

• Proposal for better managing Information System and data (end Sep)

Milestones – 2

Page 11: Introduction

LCG

[email protected] 11

• Action has been pending for a long time:– Information requested by RRB/RSG

• Significant effort was put into defining and agreeing how to publish and collect the data – via the information system. – Document has been available for some time

• Tool (gstat2) now has the ability to present this information – Significant effort still required to validate this data before it is

publishable– Propose to task Tier 1s with validation for Tier 2s, but Tier 1

data is not good yet!– Sites need to publish good data urgently– http://gstat-wlcg.cern.ch/apps/capacities/federations/

Installed capacity

Page 12: Introduction

LCG

[email protected] 12

Published capacities ...

Page 13: Introduction

LCG

[email protected] 13

Page 14: Introduction

LCG

14

Country Tier1 Physical Logical HS06 July Ratio Online July Ratio Nearline July Ratio

Canada CA-TRIUMF 464 1208 13460 13275 1.01 1100000 1100 1.00 750000 750 1.00

France FR-CCIN2P3 1143 4572 39438 44186 0.89 228887 5000 0.05 11267355 5300 2.13

Germany DE-KIT 2645 9770 88712 58730 1.51 0 6924 0.00 0 8932 0.00

Italy IT-INFN-CNAF 1332 4520 39197 32120 1.22 0 4000 0.00 0 5450 0.00

Netherlands NL-T1 2889 14064 150330 47296 3.18 4029371 3326 1.21 0 3593 0.00

Nordic NDFG 10284 10284 61122 13710 4.46 2704323 1720 1.57 0 1770 0.00

Spain ES-PIC 592 2368 24504 17504 1.40 0 2496 0.00 0 2368 0.00

Taiwan TW-ASGC 901 3981 800 30193 0.03 0 2500 0.00 0 2500 0.00

UK UK-T1-RAL 1316 5264 49692 44376 1.12 77981 4638 0.02 41943 4877 0.01

USA US-FNAL-CMS 0 0 0 44400 0.00 0 4100 0.00 0 11000 0.00

USA US-T1-BNL 0 0 0 49680 0.00 0 6100 0.00 0 4000 0.00

Page 15: Introduction

LCG

[email protected] 15

• Storage accounting reports:– For Tier 1 sites, proto-report for beginning Sep– For Tier 2 sites, for end Oct– Before these are regularly published significant

effort has to be devoted to checking the published data (see slide on installed capacity) – lots missing!

Milestones – 2

Page 16: Introduction

LCG

Availability Monitoring

• Changes discussed in June took place eventually• SAM tests are now evaluated by Nagios.• Previous interface still publishes results in old form with

new names. This eased the transition– For how long?

16

Page 17: Introduction

LCG

• CIC Operations Portal– Asked for additional requirements for more information or how it

could be stored/presented better.– Will be discussed at EGI-TF next week.

17

Page 18: Introduction

LCG

[email protected] 18

Schedule