1Oxford eSc – 1 st July03 GridPP2: Application Requirement & Developments Nick Brook University of...
-
Upload
sophia-bryant -
Category
Documents
-
view
216 -
download
2
Transcript of 1Oxford eSc – 1 st July03 GridPP2: Application Requirement & Developments Nick Brook University of...
1 Oxford eSc – 1st July’03
GridPP2: Application Requirement & Developments
Nick Brook
University of Bristol•ALICE
•Hardware Projections
•Applications Programme
2 Oxford eSc – 1st July’03
Hardware
• LHC experimental numbers based on ongoing re-assessment exercise– Computing Technical Design Reports due in 2005– Expts will be using LCG “system”
• Hardware and chosen middleware• Software tools – e.g. POOL for persistency
– Numbers include Tier-2 needs• Non LHC experiments also gave estimated forward
look– Based on MC production & analysis
• Expts are expecting a single, integrated Tier-1 centre
3 Oxford eSc – 1st July’03
Hardware
• Expts are expecting a single, integrated Tier-1
centre • Short term LHC expts expect some form of
centralised planning via LCG project– Projection Execution Board Grid Deployment
Board– GridPP participation in LCG bodies
• GridPP will continue with annual h/w review– CPU vs Disk
4 Oxford eSc – 1st July’03
Ongoing Activities
Example: LHCb Data Challenge –
>40M events – 170 yrs on a 1GHz PC
~1/3 events produced in the UK
5 Oxford eSc – 1st July’03
Ongoing Activities
Current usage of Tier-1/A centre dominated by BaBar usage – 60% of CPU, 90% of disk
6 Oxford eSc – 1st July’03
Networking
• Bandwidth dominated by replication in analysis stage of data processing– Use of tools, such as OptorSim, to understand
networking– LHC expts need to understand computing &
analysis models– Early estimates factor of 5 increase
• Current problems with MC production & bulk transfer– Unrelated to SuperJANET– Often attributable to links into the MAN
7 Oxford eSc – 1st July’03
CPU estimates
• CPU resource reqts are equivalent to 14k 2.4GHZ dual processors running continuously
• LHC expts: ~65% need in 2004 >80% in 2007
8 Oxford eSc – 1st July’03
Disk Requirements
• 60% of disk reqts in 2004 for LHC expts• 70% of disk storage in 2007 for LHC expts
– Non-LHC expts still data taking – need disk for finishing analyses
9 Oxford eSc – 1st July’03
Tape Requirments
• Tape usage completely dominated by LHC usage – 90%• Large level uncertainty
– 2007: ATLAS ( 850TB) vs CMS (1150TB)
10 Oxford eSc – 1st July’03
Needs in 2004End 2003 GridPP2 2004
New CPUs 500
kSI2k 667
£k 500
Total kSI2k 1007 2395
New disks 624
TB 146
£k 437
Total TB 215 396
New tapes 510
TB 100
New drivers 2
New servers 2
£k 96
Total TB 256 376
ADS maintenance 50
Replacements 20
11 Oxford eSc – 1st July’03
Application Development
• Building on current collaborative activity– GANGA: ATLAS & LHCb– SAM: CDF & DØ– BaBar: adoption of EDG s/w
• Prototyping Production environment– Monte Carlo production activity Analysis
environment• Grid technologies becoming more widely accepted
across HEP commuity– “old” experiments – UKDMC, ZEUS, …– “new” activities – LCFI, MICE, …
12 Oxford eSc – 1st July’03
Application Development
• Similar pattern of needs emerge from all experiments (not too suprisingly!)– Storage & location of data
• Replication issues
– Monte Carlo production tools• Seen as an obvious area for “efficiency” savings
– Analysis interfaces• Intelligent bookkeeping of a user’s analysis activities
– Persistency solutions• Composite objects spread across several storage
systems
13 Oxford eSc – 1st July’03
New Experiments
Experiment Proposed Activity
UKDMC MC ProductionAnalysis
ZEUS MC Production
phenoGrid Metadata
MICE MC productionData handling
ANTARES Data handling
CALICE Data handling
LC –ABD Metadata
14 Oxford eSc – 1st July’03
LHC experiments
Experiment Activity
ATLAS MC productionMetadataLCG integratiomPesistency & data management
CMS MC productionPersistency & data managementWorkload managementMonitoring
LHCb MC production MetadataLCG integrationPersistency & data management
GANGA (ATLAS & LHCb) Grid user interfaceLCG integrationMonitoring
15 Oxford eSc – 1st July’03
Non LHC expts
Experiment Activity
BaBar Job submissionData handlingPersistencyMC production
CDF MC productionSAM deployment
DØ MC productionSAM deployment
UKQCD Data handlingMetadata
16 Oxford eSc – 1st July’03
Application Call
• Essential continue to develop application interface through GridPP2– Expand activity to allow current none GridPP
supported expts to participate– Benefit from LCG developments
• Call for application posts – January’04 – Response by April– Reviewed à la GridPP (“Williams” committee)
• Expt activity in UK• Science o/p• Track record in Grid activity