Romanian Physics Grid: recent progress and outlook

Florin D. Buzatu

Horia Hulubei National Institute for Physics and Nuclear Engineering

Bucharest - Romania

NEC’2007, September 11, Varna - Bulgaria

FOUR YEARS AGO: NEC’03

Topics

Progress regarding:

- national Grid strategy

- network infrastructure

- particle physics Grid (LCG)

- participation to SEE-GRID(2)

Plans for the future

NATIONAL GRID STRATEGY IN ROMANIA

The Task Force for the National Grid Infrastructure (NGI)

Created through the decision of the National Authority for Scientific Research (NASR), in July 2005

Members: the Ministry of Education and Research, the Ministry of External Affairs, 7 universities, 7 research institutions, the National Research and Education Network RoEduNet.

Goal: to promote a strategic plan to be implemented by the pilotproject “Implementation of the National Grid Infrastructure”.

Guiding lines: open infrastructure, compatible with those existing in EU;exploitation of the internal production of scientific software; balancedinvestments between: networking / Grid hard&soft infrastructure / application software development

Objectives of the strategic plan

Gradual and balanced development of the NGI based on centers of competence and reuse of the results provided by (inter)national cooperation

Integration of the information society into a virtual global environment which - increases scientific potential & capacities for applied software development - ensures new resources for the research field - extends the impact of research results in economics and society

Promotion of new specific Grid technologies in Romania - focusing the academic, research and business communities towards the new virtual global environment - training and specialization of the human resources - supporting the transition towards the new system

Development of the data communications segment for the Romanian Gridframework.

Recent developments

NASR, as Funding Agency, has signed the Memorandum of Understandingfor Collaboration in the Deployment and Exploitation of the Worldwide LHC Computing Grid (MoU), with CERN (2006)

The Romanian Space Agency (ROSA) has applied for Certification Authority(CA) to EuGRIDPMA, according to the decision of NASR (operational soon)

An agreement between the Romanian Government and the Government ofHungary concerning the cooperation in Grid infrastructure has been signed

RoEduNet applied the SEELIGHT project in the frame of the HiPERB program, and NASR will support the co-financing

Funding: project based financial support only, no institutional financingProgrammes: CEEX - Centres of Excellence

Structural Funds (2007-2013)National Plan for R&D and Innovation (PNCDI-2)

NETWORK INFRASTRUCTURE - RoEduNet

RoEduNet = organization and layered data communication system

Layer 0 backbone links (including international) and 7 RoEduNet NetworkOperation Centers (NOCs): headquarter (Bucharest) + 6 regional NOCs

Layer 1: 33 RoEduNet Points of Presence (PoPs) from county capitals +communication lines between NOCs and PoPs.

Layer 2: institutions connected to RoEduNet - research institutions,universities, (high) schools, hospitals, other education related non-profitinstitutions

ConnectivityInternational: to GEANT 2 x STM4 circuits (1.244 Gbps)

to RENAM (Republic of Moldova) 34 MbpsNational: inter NOCs - at least 1 Gbps

NOC to POPs - 10 Mbps up to 30 Mbps

Results and plans for 2007

Separation of international and national backbone connections in thenational NOC (new data center)

Expected results of DANTE’s tender for dark fiber (DF) or lambda connectivity to Bucharest

SEELight project (regional funds) started, with the main goal to provideDF connectivity to Hungary and Bulgaria (apart from GEANT connection)

Upgrade of the production link Bucharest - Budapest to 10 Gbps

Start a pilot link for the SEELight project by planned connection Sofia -- Bucharest

Start of the RoEduNet2 project:Stage 1: DF connections and DWDM equipments betweenBucharest and four main cities (Cluj, Iasi, Galati, Craiova)

Networking - Long term plans

Finalize RoEduNet2 project to provide:At least 2x10 Gbps connections between NOCsAt least 1 Gbps connections between NOCs and POPsRedundancy for all connections inter NOCs and NOCs - PoPs

Organize the national headquarter and only 4 main NOCs

Implement new services:Lambda on demand for national connectivityNational VoIP for education and researchFull support for multicast applications

Implement lambda based logical network for Grid activities

Provide lambda based of DF connectivity for Black Sea region to GEANTusing owned national communication infrastructure

PARTICLE PHYSICS GRID IN ROMANIA

Long term collaboration with CERN

Large Hadron Collider (LHC) experiments:

ALICE

ATLAS

LHCb

Participation to the LHC Computing Grid (LCG) project

Once upon a time … (2003)

WLCG COLLABORATION

WLCG = Worldwide LHC Computing Grid

Purpose: to provide the computing resources needed to process and analyze the data gathered by the Large Hadron Collider experiments.

Strategy: smaller Grid centers should form federations in order to jointly comply with the minimal levels-of service criteria for an LCG Tier centre.

The existing LCG sites in Romania united in anational federation to form together a Tier-2 centre

The Romanian Authority for Scientific Research has signed the MoU in March 2006, as Funding Agency of the Romanian Tier-2 Federation.

ROMANIAN TIER-2 FEDERATION

ICIInstitute of RD in Informatics

ITIM - ClujInstitute of RD for Isotopic& Molecular Technologies

UPBUniversity ‘Politehnica’ Bucharest

IFIN-HH

ISSInstitute for Space Sciences

Tier-2 Federation Map

Romanian and Tier-2 Federation Contributions to Grid Production

RO1.50%

position13 / 41

Tier-22.86%

position7 / 22

ROMANIAN TIER-2 FEDERATION: SITES AND VOs

• Horia Hulubei National Institute of RD for Physics and Nuclear Engineering (IFIN-HH)• NIHAM (ALICE / AliEn); NIHAM (ALICE / GLITE)• RO-02-NIPNE (ATLAS, HONE / GLITE )• RO-07-NIPNE (ALICE, ATLAS, LHCb, SEE, SEEGRID / GLITE)• RO-11-NIPNE (LHCb)

• Institute for Space Sciences (ISS) • ISS (ALICE / AliEn)

• National Institute of RD in Informatics (ICI)• RO-01-ICI (LHCb, BIOMED, SEE, SEEGRID, ... / GLITE)

•Institutul National pentru Tehnologii Izotopice si Moleculare (ITIM-Cluj)• Contributing to ATLAS / GLITE

• University “Politehnica” Bucharest (UPB)• RO-03-UPB, UPB (ALICE / AliEn)

Grid production:distribution over Vos

NIHAM

• “Nuclear Interactions and Hadronic Matter” Centre of Excellence• Lead by Prof. Mihai Petrovici• Members from many IFIN-HH departments and from other institutions• The group is doing research in many areas of nuclear physics• Core members of the group were involved in the past or are involved

now in many international physics collaborations, such as DRACULA (designed by the group), CHIMERA, FOPI, ALICE, and also in the preliminary phase of CBM

• Members of the group were involved in the development of ALICE-TRD detector and frontend electronics

• NIHAM produce now >20% of ALICE-TRD chambers• Members of the group are involved in EGEE project• NIHAM GRID site• Web page: http://niham.nipne.ro

NIHAM Datacenter

• 1 industrial-grade cooling unit, 110 KW cooling (a second one scheduled for end of 2008)

• 3 industrial-grade UPS-es (240 KVA total capacity)

• Cat. 6 cabling• connection to Institute's Diesel generator

NIHAM cluster

• 168 CPU cores (WNs+services)• 2GB RAM / core• ~50 TB RAW dedicated storage (excluding HDDs on nodes)• 1Gb/s internal network• 10Gb/s uplink

NIHAM GRID site

• Integrated EGEE & AliEn site• Contributes to ALICE VO• ~850 kHours CPU Time (>1 mil. EGEE-

normalized CPU hours)• ~3mil. files stored on NIHAM SE• 6-7% of ALICE• >70% of country contribution to EGEE

RO-02-NIPNE site

Particle Physics Department GRID Site

•100 logical CPU, 1 GB per logical CPU, 10 TB storage

• Supported VOs: ATLAS – CERN (main), H1 – DESY, BIOMED & other VOs in future

RO-02-NIPNE: Monthly reports

ALL Vos

job distribution

ALL Vos success rate

LHCb Grid at RO-11-NIPNE

• 3 servers dual Xeon 3 GHz, 2 GB RAM (Worker Nodes - WNs), 80 GB HDD

• 15 nodes dual Xeon 3 GHz LV, 2 GB RAM, 80 GB HDD + 5 nodes dual Xeon Core Duo, 2GB RAM, 80GB HDD

• 2 Pentium D 3 GHz, 2 Gb RAM (Computing Element - CE, Storage Element - SE)

• 2 TB storage for SE

22

THE IT&C CENTER AT IFIN-HH (CITC)

Activities • Administration and development of the IT infrastructure of IFIN-HH• Administration and development of the Grid site RO-07-NIPNE• Coordination of the Romanian Tier-2 Federation• Administration of the communication node at IFIN (10 Gbps)• Grid computing, databases, algorithms for parallel computing, etc.

• Participation in the EU projects EGEE and SEE-GRID (as third party)

Cooperation programme "Hulubei-Meshcheryakov" together with the Laboratory of Information Technologies at JINR - Dubna, that promotes activities in fields of the information technology and computational physics like: Grid technology, Grid software and Grid development; numerical algorithms, methods and tools for the description and modeling of complex physical systems; etc.

Basic mission: operate, maintain, and develop the computing and networking infrastructure of IFIN-HH, providing the technical support required by the international scientific collaborations.

Members of the group collaborate with the Dept. of Computer Science of UCF, Orlando, directly participate to the ATLAS and DIRAC experiments at CERN and to the research activities at IN2P3 - France.

CITC: RO-O7-NIPNE

• 190 CPU cores (WNs+services) (258 logical CPUs), 3.0 GHz• 2GB RAM / core• 7 TB RAID 6 dedicated storage (excluding HDDs on nodes)• 1Gbps internal network• 10Gbps uplink• middleware GLITE• VOs: ATLAS, LHCb, ALICE, SEE, SEEGRID

SEE-GRID2: EARTHQUAKE SIMULATIONS

Gridification: Numerical simulation of earthquake generation in Vrancea county (Romania)

Work in progress for the gridification of the algorithm proposed by O. Carbunar (IFIN-HH), M. Radulian (Inst. for Earth Physics - Romania)Geophysical Research Abstracts 9, 05522 (2007)

The simulation algorithm reproduces the rate of the background seismic activity and the range of repetition of the seismic cycle for major events.

Application in development at IFIN-HH , registered at SEE-GRID2 under the name EQUSIM - Earthquake simulation

1. Weakening areas before major earthquake

2. Weakening areas after major earthquake

CITC - IFIN-HH participation at SEE-GRID2:

Grid production: RO-07-NIPNE realised 4.33% of thetotal SEE+SEEGRID production in July+August, ranking5 / 21.

• M. Dulea – CTIC (WLCG, RO-07)

• S. Zgura – NASR, ISS (ALICE)

• C. Schiaua – DFH (ALICE, NIHAM)

• C. Alexa, T. Preda (ATLAS, RO-02)

• E. Pauna (LHCb, RO-11)

Thanks