Future development at Future development at INCDTIM computing centerINCDTIM computing center

Dr. Ing. FDr. Ing. Făărcarcaşş Felix Felix

NATIONAL INSTITUTE FOR RESEARCH AND DEVELOPMENT OF ISOTOPICNATIONAL INSTITUTE FOR RESEARCH AND DEVELOPMENT OF ISOTOPIC AND MOLECULAR TECHNOLOGIESAND MOLECULAR TECHNOLOGIES

Donath St. 65-103, 400293, Cluj-Napoca, ROMANIADonath St. 65-103, 400293, Cluj-Napoca, ROMANIA Tel.: +40-264-584037; Fax:Tel.: +40-264-584037; Fax: +40-264-420042; GSM: +40-731-030060+40-264-420042; GSM: +40-731-030060

e-mail: e-mail: itim@itim-cj.ro, web: , web: http://www.itim-cj.ro

Achievements in 2011 Achievements in 2011

1.1. A 10 GBps Uplink A 10 GBps Uplink

2.2. Multiple Back up solutionsMultiple Back up solutions

3.3. MPI ClusterMPI Cluster

4.4. A functional Grid site processing ATLAS jobsA functional Grid site processing ATLAS jobs

Grid, MPI and NetworkGrid, MPI and Network

22

INCDTIM

Network abilitiesNetwork abilities

Cisco Catalyst 6509E Layer 3 systemCisco Catalyst 6509E Layer 3 system

ITIM – RoEduNet 10 GB from 1 Mar. 2011ITIM – RoEduNet 10 GB from 1 Mar. 2011

Nexus system through the Grid systemNexus system through the Grid system– ~40 GB between WN and SE, Cream~40 GB between WN and SE, Cream– ~20 GB between Site and Switch~20 GB between Site and Switch

INCDTIM

33

44

NetworkNetworkLinkLink

Network Link 2008Farcas F. - AQTR 2008

Traffic measurement

0

100

200

300

400

500

0 4 8 12 16 20 24 28 32 36 40 44 48

Time [h]

Sp

eed

[M

bp

s]

Network Link 2009

Farcas F. – CISSE 2009

INCDTIM

Testing the speed with MGEN program, March 2011 44

55

Multiple Backup solution Multiple Backup solution

Power generator 275kW

Uninterruptible

Power Source ~

APC Symetra of

max 160 KVA full

redundant

INCDTIM

U

P

S

Power Generator

275 KW, start in

full 8 seconds55

MPI ClusterMPI Cluster

Program installedProgram installed– CASTEP (NMR, CASTEP (NMR,

Forcite, Reflex Plus, Forcite, Reflex Plus, Conformers - Conformers - Moduls) (Moduls) (licenselicense))

– MolPro, SIESTA, MolPro, SIESTA, Quantum Expresso, Quantum Expresso, ProChem, Orca, etcProChem, Orca, etc

Module Environment Module Environment PackagePackage for job for job

MonitoredMonitored by Ganglia by Ganglia

25 processing station25 processing station

INCDTIM

66

RO-14-ITIM RO-14-ITIM Grid Site Grid Site Four Main station (Cream, Apel, SE, UI)Four Main station (Cream, Apel, SE, UI)

Max number of processing core 300 Max number of processing core 300

Storage = 100 TB, online 35 (for the moment) Storage = 100 TB, online 35 (for the moment)

Technology usedTechnology used, next slide…, next slide…

INCDTIM

77

88

Technology usedTechnology used INCDTIM

Blade system and MSA storage

IBM and HP Blade system, total of IBM and HP Blade system, total of 46 46 Blades in only Blades in only 29 U29 UIntel 1U SeverIntel 1U SeverProcessing power: 432Processing power: 432 corecoreManagement -> through web based Management -> through web based interfacesinterfacesMSA Storage capacity: 50 TB, MSA Storage capacity: 50 TB, Less space for 46 PC => Less space for 46 PC => core increase core increase by 56%by 56%Less Less powerpower consume - consume - reduced reduced by by 34%34%

HP & IBM web management interface

Grid Results 2011Grid Results 2011 INCDTIM

CPU EfficiencyCPU Efficiency

~270.000 jobs (1.01 - 1.11.2011) = 6%(RO)~270.000 jobs (1.01 - 1.11.2011) = 6%(RO)

in 2010 ~6000 jobsin 2010 ~6000 jobs

99

1010

Network Configuration Network Configuration and and Logical Schema of the DatacenterLogical Schema of the Datacenter

INCDTIM

Farcas F& all – REV 2011

Future development for 2012Future development for 2012

Grid site DevelopmentGrid site Development

MPI cluster DevelopmentMPI cluster Development

Improving monitoring in the site and Improving monitoring in the site and clustercluster

IPv6 implementationIPv6 implementation

What are the Financial sourcesWhat are the Financial sources??

RO-LCG 2012 symposium/conference RO-LCG 2012 symposium/conference organizingorganizing

1111

INCDTIM

Grid developmentGrid development

Improving Improving MemoryMemory (3 GB/core) (3 GB/core)

Improving Improving StorageStorage capacitycapacity (online 150 (online 150 TB)TB)

Building a Building a virtual virtual Grid site based on Grid site based on EMI (European Middleware Initiative) EMI (European Middleware Initiative) for testingfor testing

If the testing are successful If the testing are successful implementing the Grid site with EMIimplementing the Grid site with EMI

Implementing Implementing IPv6IPv6 in the virtual site in the virtual site

INCDTIM

1212

INCDTIMhttp://grid.itim-cj.rohttp://grid.itim-cj.ro

1313

MPI developmentMPI developmentINCDTIM

1414

Building a strong monitoring system Building a strong monitoring system ((nagios, ganglianagios, ganglia))

Implementing special queues for special Implementing special queues for special processing programprocessing program

Installing new software (Installing new software (Gaussian 2009, Gaussian 2009, CRYSTAL & WIEN2k))

Acquiring Acquiring 80 processor80 processor for MPI for MPI processing, technology unknown !yet! processing, technology unknown !yet!

Fund through National Authority for Science Research Fund through National Authority for Science Research (NASR)(NASR)Continuing the 12 EUContinuing the 12 EU – ConDeGrid / 2009 - 2014 – ConDeGrid / 2009 - 2014Continuing the 15 EUContinuing the 15 EU / 2009-2014 / 2009-2014Cooperation programCooperation program "Hulubei-Meshcheryakov“ together "Hulubei-Meshcheryakov“ together with the Laboratory of Information Technologies at JINR –with the Laboratory of Information Technologies at JINR –Dubna 2010-2013Dubna 2010-2013POS-CCE 192POS-CCE 192, , Improving the capacity and reliability of Improving the capacity and reliability of INCDTIM GRID center for integration in international INCDTIM GRID center for integration in international networks (INGRID)networks (INGRID)POS-CCE 536POS-CCE 536, Axis 2, operation 2.1.2, Axis 2, operation 2.1.2PN-II-RU-TE-2011-3-0124PN-II-RU-TE-2011-3-0124 PN-II-RU-TE-2011-3-0085PN-II-RU-TE-2011-3-0085: : „Modelarea First-Principles a „Modelarea First-Principles a Oxizilor bazati pe SrTiO3 pentru Aplicatii Termoelectrice”Oxizilor bazati pe SrTiO3 pentru Aplicatii Termoelectrice” ..PN-II-KAI2.2- O2.2.1-2PM/2008PN-II-KAI2.2- O2.2.1-2PM/2008 Molecular and Molecular and Biomolecular Physics Department Upgrading – Biomolecular Physics Department Upgrading – MDFMOLBIOMDFMOLBIO

INCDTIMFinancial ResourcesFinancial Resources

1515

POS-CCE 192POS-CCE 192

Improving the capacity and reliability of Improving the capacity and reliability of INCDTIM GRID center for integration in INCDTIM GRID center for integration in

international networksinternational networks

(INGRID)(INGRID)

UNIUNEA EUROPEANA GUVERNUL ROMÂNIEI INCDTIM

Project 192 Project 192 contract no: 42/11.05.2009contract no: 42/11.05.2009

Total valueTotal value: : 2.345.8002.345.800 lei lei ~ ~ 500.000 Euro 500.000 Euro

11.05.200911.05.2009 to to 10.03.201110.03.2011

INCDTIM

Main acquisitionsMain acquisitions

Power generator ( ~Power generator ( ~21.250 21.250 Euro)Euro)

HP Blade system ( ~HP Blade system ( ~193.000193.000 Euro) Euro)

Cisco Catalyst 6509E system ( ~Cisco Catalyst 6509E system ( ~141.000141.000 Euro) Euro)

APC UPS system ( ~APC UPS system ( ~95.00095.000 Euro) Euro)

1717

http://www.itim-cj.ro/PNCDI/ingridhttp://www.itim-cj.ro/PNCDI/ingridINCDTIM

1818

1919

http://www.itim-cj.ro/mdfmolbio INCDTIM

Research area applied Research area applied for MPI resourcesfor MPI resources

Molecular and Molecular and biomolecular biomolecular physicsphysics– Numerical Numerical

ModelingModeling – Molecular and Molecular and

Biomolecular Biomolecular ModelingModeling

– Structural Analysis Structural Analysis on Solidson Solids

INCDTIM

2020

2012 RO-LCG meeting2012 RO-LCG meeting

We are organizing the RO-LCG meeting We are organizing the RO-LCG meeting next year in next year in Cluj-Napoca at INCDTIMCluj-Napoca at INCDTIM

We are doing it with the support of IEEE We are doing it with the support of IEEE RomaniaRomania

We will publish your contribution in an We will publish your contribution in an IEEE volumeIEEE volume

We are waiting for We are waiting for interestinginteresting reports and reports and contribution in LCG and Parallel contribution in LCG and Parallel computing domain.computing domain.

INCDTIM

2121

Published articles 2011Published articles 2011

1.1. F. Farcas, R. Trusca, S. Albert, Izabella Szabo & G. Popeneciu, F. Farcas, R. Trusca, S. Albert, Izabella Szabo & G. Popeneciu, Application of Green IT for Physics Data Processing at Application of Green IT for Physics Data Processing at INCDTIMINCDTIM, PIM 2011, PIM 2011

2.2. Trusca MRC, Farcas F, Szabo I, Albert S, Floare C.G., Trusca MRC, Farcas F, Szabo I, Albert S, Floare C.G., Techniques for parameters monitoring in datacenterTechniques for parameters monitoring in datacenter , XXIII , XXIII International Symposium on Nuclear Electronuics & Computing, International Symposium on Nuclear Electronuics & Computing, NEC 2011, Varna 2011NEC 2011, Varna 2011

3.3. Felix Farcas, Felix Farcas, Development of INCDTIM Datacenter using „green Development of INCDTIM Datacenter using „green IT”IT”, XXIII International Symposium on Nuclear Electronuics & , XXIII International Symposium on Nuclear Electronuics & Computing, NEC 2011, Book of Abstract, plenary session.Computing, NEC 2011, Book of Abstract, plenary session.

4.4. Felix Farcas, Radu Trusca, Felix Farcas, Radu Trusca, Grid computing Improvment at Grid computing Improvment at INCDTIM ClujINCDTIM Cluj, Proceedins REV-2011, Remote Engineering and , Proceedins REV-2011, Remote Engineering and Virtual Instrumentation, International Association of Online Virtual Instrumentation, International Association of Online Engineering, ISBN  978-3-89958-55-1Engineering, ISBN  978-3-89958-55-1..

INCDTIM

2222

Thank you for your attentionThank you for your attentionINCDTIM

Happy Happy StSt. . NicholasNicholas, Merry Christmas and , Merry Christmas and A Happy New YearA Happy New Year 2323