Post on 31-Dec-2015
www.see-grid-sci.eu
SEE-GRID-SCI
Regional Grid Infrastructure: Resource for e-Science
Regional eInfrastructure development and resultsIT’10, Zabljak, Montenegro, 25 Feb 2010
Dr. Antun BalazInstitute of Physics Belgrade
antun@ipb.ac.rs
The SEE-GRID-SCI initiative is co-funded by the European Commission under the FP7 Research Infrastructures contract no. 211338
Regional eInfrastructure development and results, IT’10, Zabljak, Montenegro, February 25, 2010
Overview
Regional Grid infrastructure developmentCore Grid servicesManagement of eInfrastructureUsage of regional Grid infrastructureRegional resources for e-Science collaboration
Regional eInfrastructure development and results, IT’10, Zabljak, Montenegro, February 25, 2010
Infrastructure development (1)
History available athttps://http.ipb.ac.rs/documents/seegrid_infrastructure_development/History available athttps://http.ipb.ac.rs/documents/seegrid_infrastructure_development/
Regional eInfrastructure development and results, IT’10, Zabljak, Montenegro, February 25, 2010
Infrastructure development (2)
SEE-GRID-SCI infrastructure contains currently the following resources: Total CPUs: more than 3000 Storage: more than 450 TB 44 sites in SEE-GRID-SCI production Typical machine configuration: dual or quad-core CPUs, with 1GB of
RAM per CPU core; many sites with 64-bit architecture
Regional eInfrastructure development and results, IT’10, Zabljak, Montenegro, February 25, 2010
Core services
Catch-all Certification Authority enables regional sites to obtain user and host certificates
Virtual Organisation Management Service (VOMS), For each scientific community deployed in two instances for failover Supporting groups and roles
Workload management service (glite-WMS/LB) and Information Services (BDII)
For each scientific community deployed in several instances for failover Logical File Catalogue (LFC)
For each scientific community deployed in several instances for failover MyProxy
Supports certificate renewal for all deployed WMS/RB services For each scientific community deployed in several instances for failover
File Transfer Service (FTS) Used in production
Relational Grid Monitoring Architecture (R-GMA) Registry and Schema SEE-GRID accounting publisher, with support for MPI jobs accounting
AMGA Metadata Catalogue
Regional eInfrastructure development and results, IT’10, Zabljak, Montenegro, February 25, 2010
Core services map
Regional eInfrastructure development and results, IT’10, Zabljak, Montenegro, February 25, 2010
Infrastructure management
Regional eInfrastructure development and results, IT’10, Zabljak, Montenegro, February 25, 2010
Operational/monitoring tools (1)
Hierarchical Grid Site Management (HGSM) (+interface to GOCDB) – TurkeyBBMSAM Service Availability Monitoring + extensions – Bosnia and Herzegovina with Serbia supportHelpdesk + NMTT (+ interoperation with EGEE-SEE and GGUS + intergration with Nagios) – Romania with CERN supportSEE-GRID GoogleEarth – Turkey + ic.ac.ukGlobal Grid Information Monitoring System (GStat) – ASGC, TaiwanR-GMA and Accounting Portal – BulgariaNagios - BulgariaReal Time Monitor (RTM) – ic.ac.uk and Turkey (HGSM)MONitoring Agents using a Large Integrated Services Architecture (MonALISA) – RomaniaWhat is at the Grid (WatG) – SerbiaWMSMON tool – SerbiaPakiti – GreeceGSSVA (security-enabled Pakiti extension) – SZTAKISEE-GRID Wiki with detailed information for site administrators
Regional eInfrastructure development and results, IT’10, Zabljak, Montenegro, February 25, 2010
Operational/monitoring tools (2)
Static Database: HGSM Static database containing all
relevant data about all SEE-GRID-SCI sites
Synchronized with the real situation
Monitoring BBmSAM
Portal that provides access to the database of SAM tests results
Central tools for identification of operational problems
Provides SLA metrics
Regional eInfrastructure development and results, IT’10, Zabljak, Montenegro, February 25, 2010
Operational/monitoring tools (3)
Gstat Central tool for monitoring of the
information system of SEE-GRID-SCI infrastructure
Nagios Collection of alarms raised by
various tools In the future, automatic creation of
Helpdesk tickets will be implemented
Pakiti Helps the system administrator
keeping multiples machines up-to-date and prevent unpatched machines to be kept silently on the network.
GSSVA (JRA1)
Regional eInfrastructure development and results, IT’10, Zabljak, Montenegro, February 25, 2010
Operational/monitoring tools (4)
WMSMON Aggregated and detailed
status view of all monitored WMS services
Links to the appropriate troubleshooting guides
Real Time Monitor Using satellite imagery
from NASA, these clients display the SEE-GRID-SCI as it is geographically spread over the region
Googlemap MonaLisa
Regional eInfrastructure development and results, IT’10, Zabljak, Montenegro, February 25, 2010
Operational/monitoring tools (5)
Helpdesk: OneOrZero Central reference point for tracking
of all operational and user problems Identified problems are reported
through the Helpdesk and assigned to the appropriate supported
NMTT (JRA1)
Accounting portal Collects the accounting data from
all SEE-GRID-SCI sites through apel MPI-enabled accounting publisher developed by the project
Provides aggregated accounting data by site, country, institution, application
Operations wiki
Regional eInfrastructure development and results, IT’10, Zabljak, Montenegro, February 25, 2010
Infrastructure usage (1)
Regional eInfrastructure development and results, IT’10, Zabljak, Montenegro, February 25, 2010
Infrastructure usage (2)
Regional eInfrastructure development and results, IT’10, Zabljak, Montenegro, February 25, 2010
Infrastructure usage (3)
Overall accounting: 2566.80 Base CPU years SEE-GRID-SCI VOs: 253.41 Base CPU years (9.87%) EGEE VOs: 694.70 Base CPU years (27.06%) National VOs: 1618.69 Base CPU years (63.06%)
SEE-GRID-SCI VOs supported on all sites ENV: 5.81 Base CPU years METEO: 5.17 Base CPU years SEISMO: 0.13 Base CPU years
Number of jobs for SEE-GRID-SCI VOs: around 500k
Regional eInfrastructure development and results, IT’10, Zabljak, Montenegro, February 25, 2010
Regional resources for e-Science collaboration
Grid eInfrastructure is by far the largest computing and storage resource available in the South Eastern EuropeHowever, it is only a resource for e-Science collaboration in the region and on the pan-European levelSignificant usage demonstrates already established research collaboration in various scientific fields Meteorology Seismology Environmental sciences
All partners from the region are very open for further cooperation Computer science Physics Chemistry…