Institute of Physics, BelgradeScientific Computing Laboratory

March 4, 2007

Petnica Science Center

FREE SCIENTIFIC COMPUTINGFREE SCIENTIFIC COMPUTING

GRID COMPUTINGGRID COMPUTING

Branimir AckovićBranimir Acković

Petnica, March 4, 2007. Free Scientific Computing

OverviewOverview 1/2 1/2 eScience Brief History of UNIX Feeling Free

Licensing, Copyright, Copyleft GNU, Free Software Foundation Open Source Licenses

Linux Supercomputers Clusters Why do we need Grid?

Petnica, March 4, 2007. Free Scientific Computing

OverviewOverview 2/2 2/2 Making Grid to work

Problems VOs Grid Site What really happens? Middleware

Developing & Using Grid EGEE SEE-GRID AEGIS

Petnica, March 4, 2007. Free Scientific Computing

eScienceeScience Trivial:

text editing, Internet services elementary visualization, special functions, ...

Nontrivial: differential eq., large linear systems, searching combinatorial spaces complex symbolic algebraic statistical data analysis complex visualization, ...

Advanced: stochastic simulations part functions/functional integrals risk assessment in complex systems dynamics of the systems with many degrees of freedom, ...

Petnica, March 4, 2007. Free Scientific Computing

Brief History of UNIXBrief History of UNIX

Petnica, March 4, 2007. Free Scientific Computing

Feeling FreeFeeling Free – Licensing, Copyright, Copyleft – Licensing, Copyright, Copyleft 1/3 1/3

1973. Licensing of UNIX by AT&T Copyright Copyleft

Petnica, March 4, 2007. Free Scientific Computing

Feeling FreeFeeling Free - GNU, Free Software Foundation - GNU, Free Software Foundation 2/3 2/3 “Free software” is the matter of liberty, not price. To understand the

concept you should think of “free” as in “free speech”, not as in “free beer”.

1983/1984. GNU's not UNIX – Richard Stallman

Free Software Foundation The freedom to run the program, for any purpose (freedom 0). The freedom to study how the program works, and adapt it to your needs

(freedom 1). Access to the source code is a precondition for this. The freedom to redistribute copies so you can help your neighbor (freedom 2). The freedom to improve the program, and release your improvements to the

public, so that the whole community benefits (freedom 3). Access to the source code is a precondition for this.

Petnica, March 4, 2007. Free Scientific Computing

Feeling FreeFeeling Free - Open Source Licenses - Open Source Licenses 3/3 3/3 GPL, GLPL BSD Licenses Apache License MIT (X11) License Mozilla Public License

Petnica, March 4, 2007. Free Scientific Computing

LinuxLinux Main distributions

Red Hat, Fedora Core SuSE Linux Enterprize, Open SuSE Debian Slackware Mandriva Ubuntu

Scientific Linux, CERN Linux

Shell

Desktop Environments KDE GNOME Window Maker Black Box

Petnica, March 4, 2007. Free Scientific Computing

SupercomputersSupercomputers First computers were supercomputers? TOP500.ORG

Petnica, March 4, 2007. Free Scientific Computing

ClustersClusters Commodity hardware become available in the last 10 years Local network 100-1000 Mbps easily deployed Linux mature and widely available Software available and even standardized - MPI

Petnica, March 4, 2007. Free Scientific Computing

Why do we need GridWhy do we need Grid Dramatically increasing efficiency Easy ti install Easy to maintenance Easy to use Easy to upgrade

Petnica, March 4, 2007. Free Scientific Computing

Making Grid to workMaking Grid to work – problems – problems 1/51/5 Too hard to keep track of authentication data (ID/password) across

institutions SOLUTION: VOs

Too hard to monitor system and application status across institutions SOLUTION: Grid Monitoring Tools

Too many ways to submit jobs SOLUTION: GDL - Grid Description Language

Too many ways to store, access & keep track of files and data SOLUTION: LFC – Logical Filename Catalog

Petnica, March 4, 2007. Free Scientific Computing

Making Grid to workMaking Grid to work – VOs – VOs 2/52/5

ComputingCenter

VO ComputingCenter

Service

Petnica, March 4, 2007. Free Scientific Computing

Making Grid to workMaking Grid to work – Grid Site – Grid Site 3/53/5

InformationServices

Computingelement

Storageelement

Disk poolWorkernodes

Petnica, March 4, 2007. Free Scientific Computing

Making Grid to workMaking Grid to work – What really happens? – What really happens? 4/54/5

ReplicaReplicaCatalogueCatalogue

Logging &Logging &Book-keepingBook-keeping

WorkloadWorkloadmanagementmanagementSystemSystem

ComputingComputingElementElement

Job Status

DataSets info

Auth.&Auth.

Job

Su

bm

it Even

t

Job

Qu

ery Job

Sta

tus

Input“sandbox”

Input “sandbox” +

Broker Info

Output “sandbox”

Output“sandbox”

Pu

blish

SE & CE info

User User interfaceinterface

Petnica, March 4, 2007. Free Scientific Computing

Making Grid to workMaking Grid to work – Middleware – Middleware 5/55/5 EDG – European Data Grid LCG – Large Hadron Collider Computing Grid gLite

Globus 2 based Web services based

EGEE-2EGEE-1LCG-2LCG-1

Petnica, March 4, 2007. Free Scientific Computing

EGEEEGEE Enabling Grids for eScience About 50 countries More than 220 sites About 40000 CPUs More than 13 PB storage

Petnica, March 4, 2007. Free Scientific Computing

SEE-GRIDSEE-GRID South East Europe GRID 13 countries

Greece – project lider, SEE-GRID CA, backup VOMS, Serbia – WP3 lider, RB, WMS, BDII, My proxy, LFC Turkey – WP4 lider, backup RB Croatia - WP4 lider, VOMS Hungary - pgrade Bosnia and Herzegovina – SAM tests Bulgaria - Registry FYR of Macedonia – Gridice Romania - Security Albania, Moldavia, Switzerland

About 30 sites About 430 CPUs More than 13 TB storage

Petnica, March 4, 2007. Free Scientific Computing

AEGIS01-PHY-SCLAEGIS01-PHY-SCL 1/5 1/5 Scientific Computing Laboratory, Institute of Physics, Belgrade wns: 100 CPU – 25x dual dual Xeon 2.8GHz, 1GB RAM services: CE, gCE, SE core services: RB, WMS, VOMS, BDII, MyProxy VOs: AEGIS, Atlas, CMS, ESR, Dteam, SEE-GRID, SEE, OPS

Petnica, March 4, 2007. Free Scientific Computing

AEGIS02-RCUBAEGIS02-RCUB 2/5 2/5 RCUB, University of Belgrade scavenger wns: 14 CPU 2.0GHz AMD Sempron, 1GB RAM services: CE, SE core services: LFC VOs: AEGIS, SEE-GRID, Dteam, SGDemo

Petnica, March 4, 2007. Free Scientific Computing

AEGIS03-ELEF-LEDAAEGIS03-ELEF-LEDA 3/5 3/5 Laboratory for Electronic Design Automation, Faculty of Electric

Engineering, University of Nis wns: 4 CPU PIV 2.4GHz, 512MB RAM services: CE, SE VOs: Aegis, SEE-GRID, Dteam

Petnica, March 4, 2007. Free Scientific Computing

AEGIS04-KGAEGIS04-KG 4/5 4/5 Center for Scientific Research, University of Kragujevac wns: 8 CPU PIV 1.7GHz, 1GB RAM services: CE, SE, gCE VOs: AEGIS, SEE-GRID, Dteam

Petnica, March 4, 2007. Free Scientific Computing

AEGIS05-ETFBGAEGIS05-ETFBG 5/5 5/5 School of Electrical Engineering, University of Belgrade scavenger wns: 30 CPU 2.6GHz AMD Sempron, 1GB RAM services: CE, SE