Status of CAF

Marco MEONIJan Fiete GROSSE-OETRINGHAUS

CERN - Offline Week – 28.10.2009

AliEn SEs

CAF

...

Staging

CASTOR MSS

CERN Analysis Facility (CAF)

AuthenticationProof master,

xrootd redirector

LDAP

DirectAccess

2

SW• ROOT v5-24-00a

• ROOT v5-25-02 in preparation

• AliRoot v4-17-Release– deployed to AFS and enabled via meta par-files containing no source code

• AF-v4-17.par (loads VMC, Net, Tree, Physics, STEERBase, ANALYSIS, ESD, AOD, ANALYSISalice)

• AF-v4-17-rec.par (enables the full AliRoot)

• New features– Direct access to Grid files (read/write)

– Raw reconstruction (see Cvetan’s talk)

How to use CAF athttp://aliceinfo.cern.ch/Offline/Activities/Analysis/CAF/index.htmlHow to use CAF athttp://aliceinfo.cern.ch/Offline/Activities/Analysis/CAF/index.html

3

HW• Very few interventions on the CAF machines over the last 4 months

• 30 more machines in two batches of 15– one by end November– one by beginning of next year with similar configuration

CAF

Arch. Intel Xeon

CPU 15 x 8-core (IT standard)

Disk 15 x 2.33 TBRAID5

Workers 26 (2/node)

Mperf 8570

4

CAF UsageGroups #Users

PWG0 21

PWG1 3

PWG2 57

PWG3 30

PWG4 44

13 SUB-

DETECTORS

53

Not assigned 13

Up to 21 users in parallel

Not assigned users will be refused access to CAF in the future

They receive an email every hourCAF user ’foo' running in group 'default'

-Number of groups: 20-Number of unique users: 154 (a user can belong to several groups)

5

DatasetDisk space 30.0

TB

Disk used (COMMON) 5.4 TB +8%

Disk used (users) 4.4 TB +76%

#DSs (COMMON) 30 +50%

#DSs (users) 169 +302%

#DS has increased a lot and users should also remember cleanup

Dataset URI | # Files | Default tree | # Events | Disk | Staged…/COMMON/COMMON/LHC08c11_10TeV_0.5T | 1850 | /esdTree | 277500 | 129 GB | 100 %/COMMON/COMMON/LHC08c12_0.9TeV_0.5T | 2126 | /esdTree | 318900 | 101 GB | 100 %/COMMON/COMMON/LHC08c13_10TeV_0T | 2312 | /esdTree | 346350 | 213 GB | 99 %/COMMON/COMMON/LHC08c14_0.9TeV_0T | 1646 | /esdTree | 246900 | 94 GB | 100 %/COMMON/COMMON/LHC08c15_10TeV_0.5T_Phojet | 1526 | /esdTree | 222300 | 98 GB | 97 %/COMMON/COMMON/LHC08c16_0.9TeV_0.5T_Phojet| 1415 | /esdTree | 201750 | 71 GB | 95 %/COMMON/COMMON/LHC08c17_10TeV_0T_Phojet | 1314 | /esdTree | 180750 | 109 GB | 91 %/COMMON/COMMON/LHC08c18_0.9TeV_0T_Phojet | 1554 | /esdTree | 222750 | 96 GB | 95 %/COMMON/COMMON/LHC09a14_0.9TeV_0.5T | 1349 | /esdTree | 222780 | 38 GB | 99 %/COMMON/COMMON/LHC09a15_0.9TeV_0T | 1093 | /esdTree | 212600 | 42 GB | 97 %/COMMON/COMMON/LHC09a2_run8000X | 9795 | /esdTree | 683850 | 1 TB | 46 %/COMMON/COMMON/LHC09a4_10TeV | 6831 | /HLTesdTree | 1343400 | 486 GB | 98 %/COMMON/COMMON/LHC09a4_10TeV_200k | 989 | /HLTesdTree | 194000 | 70 GB | 98 %/COMMON/COMMON/LHC09a4_run8010X | 3042 | /HLTesdTree | 603400 | 250 GB | 99 %/COMMON/COMMON/LHC09a4_run8100X | 2947 | /HLTesdTree | 587800 | 154 GB | 99 %/COMMON/COMMON/LHC09a4_run81011 | 989 | /HLTesdTree | 197600 | 52 GB | 99 %/COMMON/COMMON/LHC09a4_run8101X | 7744 | /esdTree | 1547000 | 408 GB | 99 %/COMMON/COMMON/LHC09a4_run8158X | 9683 | /HLTesdTree | 1936600 | 512 GB | 100 %/COMMON/COMMON/LHC09a4_run8159X | 5745 | /HLTesdTree | 1149000 | 303 GB | 100 %/COMMON/COMMON/LHC09a5_run9000X | 8125 | /HLTesdTree | 1620600 | 452 GB | 99 %/COMMON/COMMON/LHC09a6_run9200X | 5791 | /HLTesdTree | 1148600 | 488 GB | 99 %/COMMON/COMMON/LHC09b10_0.9TeV_0.5T_Phojet| 1935 | /esdTree | 282000 | 75 GB | 72 %/COMMON/COMMON/LHC09b11_0.9TeV_0T_Phojet | 1176 | /esdTree | 232000 | 73 GB | 98 %/COMMON/COMMON/LHC09b12_7TeV_0.5T | 298 | /esdTree | 59600 | 22 GB | 100 %/COMMON/COMMON/LHC09b13_7TeV_0T | 1533 | /esdTree | 276600 | 127 GB | 90 %/COMMON/COMMON/LHC09b14_7TeV_0.5T_Phojet | 1157 | /esdTree | 217800 | 76 GB | 94 %/COMMON/COMMON/LHC09b15_7TeV_0T_Phojet | 1104 | /esdTree | 175400 | 76 GB | 79 %/COMMON/COMMON/LHC09b8_0.9TeV_0.5T | 468 | /esdTree | 93600 | 21 GB | 100 %/COMMON/COMMON/LHC09b9_0.9TeV_0T | 1883 | /esdTree | 275800 | 81 GB | 73 %/COMMON/COMMON/tutorial_small | 200 | /esdTree | 20000 | 8 GB | 100 %…

Dataset URI | # Files | Default tree | # Events | Disk | Staged…/COMMON/COMMON/LHC08c11_10TeV_0.5T | 1850 | /esdTree | 277500 | 129 GB | 100 %/COMMON/COMMON/LHC08c12_0.9TeV_0.5T | 2126 | /esdTree | 318900 | 101 GB | 100 %/COMMON/COMMON/LHC08c13_10TeV_0T | 2312 | /esdTree | 346350 | 213 GB | 99 %/COMMON/COMMON/LHC08c14_0.9TeV_0T | 1646 | /esdTree | 246900 | 94 GB | 100 %/COMMON/COMMON/LHC08c15_10TeV_0.5T_Phojet | 1526 | /esdTree | 222300 | 98 GB | 97 %/COMMON/COMMON/LHC08c16_0.9TeV_0.5T_Phojet| 1415 | /esdTree | 201750 | 71 GB | 95 %/COMMON/COMMON/LHC08c17_10TeV_0T_Phojet | 1314 | /esdTree | 180750 | 109 GB | 91 %/COMMON/COMMON/LHC08c18_0.9TeV_0T_Phojet | 1554 | /esdTree | 222750 | 96 GB | 95 %/COMMON/COMMON/LHC09a14_0.9TeV_0.5T | 1349 | /esdTree | 222780 | 38 GB | 99 %/COMMON/COMMON/LHC09a15_0.9TeV_0T | 1093 | /esdTree | 212600 | 42 GB | 97 %/COMMON/COMMON/LHC09a2_run8000X | 9795 | /esdTree | 683850 | 1 TB | 46 %/COMMON/COMMON/LHC09a4_10TeV | 6831 | /HLTesdTree | 1343400 | 486 GB | 98 %/COMMON/COMMON/LHC09a4_10TeV_200k | 989 | /HLTesdTree | 194000 | 70 GB | 98 %/COMMON/COMMON/LHC09a4_run8010X | 3042 | /HLTesdTree | 603400 | 250 GB | 99 %/COMMON/COMMON/LHC09a4_run8100X | 2947 | /HLTesdTree | 587800 | 154 GB | 99 %/COMMON/COMMON/LHC09a4_run81011 | 989 | /HLTesdTree | 197600 | 52 GB | 99 %/COMMON/COMMON/LHC09a4_run8101X | 7744 | /esdTree | 1547000 | 408 GB | 99 %/COMMON/COMMON/LHC09a4_run8158X | 9683 | /HLTesdTree | 1936600 | 512 GB | 100 %/COMMON/COMMON/LHC09a4_run8159X | 5745 | /HLTesdTree | 1149000 | 303 GB | 100 %/COMMON/COMMON/LHC09a5_run9000X | 8125 | /HLTesdTree | 1620600 | 452 GB | 99 %/COMMON/COMMON/LHC09a6_run9200X | 5791 | /HLTesdTree | 1148600 | 488 GB | 99 %/COMMON/COMMON/LHC09b10_0.9TeV_0.5T_Phojet| 1935 | /esdTree | 282000 | 75 GB | 72 %/COMMON/COMMON/LHC09b11_0.9TeV_0T_Phojet | 1176 | /esdTree | 232000 | 73 GB | 98 %/COMMON/COMMON/LHC09b12_7TeV_0.5T | 298 | /esdTree | 59600 | 22 GB | 100 %/COMMON/COMMON/LHC09b13_7TeV_0T | 1533 | /esdTree | 276600 | 127 GB | 90 %/COMMON/COMMON/LHC09b14_7TeV_0.5T_Phojet | 1157 | /esdTree | 217800 | 76 GB | 94 %/COMMON/COMMON/LHC09b15_7TeV_0T_Phojet | 1104 | /esdTree | 175400 | 76 GB | 79 %/COMMON/COMMON/LHC09b8_0.9TeV_0.5T | 468 | /esdTree | 93600 | 21 GB | 100 %/COMMON/COMMON/LHC09b9_0.9TeV_0T | 1883 | /esdTree | 275800 | 81 GB | 73 %/COMMON/COMMON/tutorial_small | 200 | /esdTree | 20000 | 8 GB | 100 %…

6

4 months, 1.1x109 secs

CPUtime=0.53x108 secs

CPU Usage

9 months, 2.47x109 secsCPUtime=1.03x108 secs

Average CPU Usage =

4.2%

Average CPU Usage =

4.2%

Average CPU Usage =

4.8%

Average CPU Usage =

4.8%

• CAF usage is significantly increased• Group default is not any more the most relevant• CAF usage is significantly increased• Group default is not any more the most relevant

CAF 10/08-06/09 06/09-10/09 +/-

Bytes read 234TB 332TB +219%

Events 4.8G 4.2G +97%

Queries 19200 12613 +48%

Overview• CAF

• Reached a proved stability, few reboots

• Current SW suite includes ROOT v5/24-00a + AliRoot v4-17-Release

• User support• Monthly tutorials at CERN, ~700 people attended so far• Mailing list: alice-project-analysis-task-force@cern.ch• Web page: http://aliceinfo.cern.ch/Offline/Analysis/CAF

• Under development• Top hits in Gerri’s talk

• Regular biweekly meeting among CAF/PROOF/Grid experts

8