Grid Information Services - ut · LDAP database TOP GIIS TOP GIIS GIIS EE GIIS FI GIIS SE SITE GIIS...
Transcript of Grid Information Services - ut · LDAP database TOP GIIS TOP GIIS GIIS EE GIIS FI GIIS SE SITE GIIS...
![Page 1: Grid Information Services - ut · LDAP database TOP GIIS TOP GIIS GIIS EE GIIS FI GIIS SE SITE GIIS SITE GIISSITE GIIS ... Grid Configuration Database (GOCDB) ... ARGUS – is a system](https://reader035.fdocuments.us/reader035/viewer/2022071410/61045c92b94fb1401f620e84/html5/thumbnails/1.jpg)
Grid Information Services
Week #3Basics of Grid and Cloud computing
Hardi [email protected]
University of TartuFebruary 27th 2013
![Page 2: Grid Information Services - ut · LDAP database TOP GIIS TOP GIIS GIIS EE GIIS FI GIIS SE SITE GIIS SITE GIISSITE GIIS ... Grid Configuration Database (GOCDB) ... ARGUS – is a system](https://reader035.fdocuments.us/reader035/viewer/2022071410/61045c92b94fb1401f620e84/html5/thumbnails/2.jpg)
Basics of Grid and Cloud computing 2/28
Overview
● Grid information services● ARC CE and its services● Information indexing● Accounting records● Service monitoring● Authorization services
![Page 3: Grid Information Services - ut · LDAP database TOP GIIS TOP GIIS GIIS EE GIIS FI GIIS SE SITE GIIS SITE GIISSITE GIIS ... Grid Configuration Database (GOCDB) ... ARGUS – is a system](https://reader035.fdocuments.us/reader035/viewer/2022071410/61045c92b94fb1401f620e84/html5/thumbnails/3.jpg)
Basics of Grid and Cloud computing 3/28
Grid acronyms
● EGI Glossary● http://www.egi.eu/about/glossary/ ● Goole search helps
● EGI Security Policy Glossary of Terms● https://documents.egi.eu/public/ShowDocument?docid=71
![Page 4: Grid Information Services - ut · LDAP database TOP GIIS TOP GIIS GIIS EE GIIS FI GIIS SE SITE GIIS SITE GIISSITE GIIS ... Grid Configuration Database (GOCDB) ... ARGUS – is a system](https://reader035.fdocuments.us/reader035/viewer/2022071410/61045c92b94fb1401f620e84/html5/thumbnails/4.jpg)
Basics of Grid and Cloud computing 4/28
Grid
Grid is securely share distributed resources (computation, storage, etc) so that users can collaborate within Virtual Organisations (VO):
![Page 5: Grid Information Services - ut · LDAP database TOP GIIS TOP GIIS GIIS EE GIIS FI GIIS SE SITE GIIS SITE GIISSITE GIIS ... Grid Configuration Database (GOCDB) ... ARGUS – is a system](https://reader035.fdocuments.us/reader035/viewer/2022071410/61045c92b94fb1401f620e84/html5/thumbnails/5.jpg)
Basics of Grid and Cloud computing 5/28
GRID
MIDDLEWARE
Visualization
Supercomputer, PC-Cluster
Data-storage, Sensors, Experiments
Internet, networks
Desktop
Mobile Access
![Page 6: Grid Information Services - ut · LDAP database TOP GIIS TOP GIIS GIIS EE GIIS FI GIIS SE SITE GIIS SITE GIISSITE GIIS ... Grid Configuration Database (GOCDB) ... ARGUS – is a system](https://reader035.fdocuments.us/reader035/viewer/2022071410/61045c92b94fb1401f620e84/html5/thumbnails/6.jpg)
Basics of Grid and Cloud computing 6/28
Grid foundations
![Page 7: Grid Information Services - ut · LDAP database TOP GIIS TOP GIIS GIIS EE GIIS FI GIIS SE SITE GIIS SITE GIISSITE GIIS ... Grid Configuration Database (GOCDB) ... ARGUS – is a system](https://reader035.fdocuments.us/reader035/viewer/2022071410/61045c92b94fb1401f620e84/html5/thumbnails/7.jpg)
Basics of Grid and Cloud computing 7/28
Information services
● Maintains information about hardware, software, services and people participating in a Virtual Organization– Should scale with the Grid´s growth
– Sharing jobs
– Logging and accounting
– Monitoring
![Page 8: Grid Information Services - ut · LDAP database TOP GIIS TOP GIIS GIIS EE GIIS FI GIIS SE SITE GIIS SITE GIISSITE GIIS ... Grid Configuration Database (GOCDB) ... ARGUS – is a system](https://reader035.fdocuments.us/reader035/viewer/2022071410/61045c92b94fb1401f620e84/html5/thumbnails/8.jpg)
Basics of Grid and Cloud computing 8/28
Real Life - Services in ARC CE
![Page 9: Grid Information Services - ut · LDAP database TOP GIIS TOP GIIS GIIS EE GIIS FI GIIS SE SITE GIIS SITE GIISSITE GIIS ... Grid Configuration Database (GOCDB) ... ARGUS – is a system](https://reader035.fdocuments.us/reader035/viewer/2022071410/61045c92b94fb1401f620e84/html5/thumbnails/9.jpg)
Basics of Grid and Cloud computing 9/28
Batch system
● “Batch processing is execution of a series of programs ("jobs") on a computer without manual intervention.” Wikipedia.org
● Many users● Different priorities● Different resources
● Condor, LoadLeveler, LSF, PBS/Torque + maui, Grid Engine, SLURM
![Page 10: Grid Information Services - ut · LDAP database TOP GIIS TOP GIIS GIIS EE GIIS FI GIIS SE SITE GIIS SITE GIISSITE GIIS ... Grid Configuration Database (GOCDB) ... ARGUS – is a system](https://reader035.fdocuments.us/reader035/viewer/2022071410/61045c92b94fb1401f620e84/html5/thumbnails/10.jpg)
Basics of Grid and Cloud computing 10/28
ARC Computing Element (CE)
● Universal frontend for different batch systems
● Standard and custom interfaces
● Status information publishing
● File handling
![Page 11: Grid Information Services - ut · LDAP database TOP GIIS TOP GIIS GIIS EE GIIS FI GIIS SE SITE GIIS SITE GIISSITE GIIS ... Grid Configuration Database (GOCDB) ... ARGUS – is a system](https://reader035.fdocuments.us/reader035/viewer/2022071410/61045c92b94fb1401f620e84/html5/thumbnails/11.jpg)
Basics of Grid and Cloud computing 11/28
ARC CE internals
● All services are only in the frontend
● Grid users are mapped to local identities
![Page 12: Grid Information Services - ut · LDAP database TOP GIIS TOP GIIS GIIS EE GIIS FI GIIS SE SITE GIIS SITE GIISSITE GIIS ... Grid Configuration Database (GOCDB) ... ARGUS – is a system](https://reader035.fdocuments.us/reader035/viewer/2022071410/61045c92b94fb1401f620e84/html5/thumbnails/12.jpg)
Basics of Grid and Cloud computing 12/28
Information Indexing
● GIIS – Nordugrid
● BDII – gLite
1
![Page 13: Grid Information Services - ut · LDAP database TOP GIIS TOP GIIS GIIS EE GIIS FI GIIS SE SITE GIIS SITE GIISSITE GIIS ... Grid Configuration Database (GOCDB) ... ARGUS – is a system](https://reader035.fdocuments.us/reader035/viewer/2022071410/61045c92b94fb1401f620e84/html5/thumbnails/13.jpg)
Basics of Grid and Cloud computing 13/28
SITE GIISSITE GIIS
GIIS DK
TOP GIIS
Grid Index Information service (GIIS)
● Tree-like hierarchy
● Three levels● Top level● Country level ● Site level
● LDAP database
TOP GIIS TOP GIIS
GIIS EE GIIS FI GIIS SE
TOP GIIS
SITE GIIS
GIIS EE
SITE GIISSITE GIISSITE GIISSITE GIISSITE GIISSITE GIIS
![Page 14: Grid Information Services - ut · LDAP database TOP GIIS TOP GIIS GIIS EE GIIS FI GIIS SE SITE GIIS SITE GIISSITE GIIS ... Grid Configuration Database (GOCDB) ... ARGUS – is a system](https://reader035.fdocuments.us/reader035/viewer/2022071410/61045c92b94fb1401f620e84/html5/thumbnails/14.jpg)
Basics of Grid and Cloud computing 14/28
NorduGrid monitor
● Information about all sites available at TOP level GIIS.
● Participating countries
● Site info
● Jobs info
![Page 15: Grid Information Services - ut · LDAP database TOP GIIS TOP GIIS GIIS EE GIIS FI GIIS SE SITE GIIS SITE GIISSITE GIIS ... Grid Configuration Database (GOCDB) ... ARGUS – is a system](https://reader035.fdocuments.us/reader035/viewer/2022071410/61045c92b94fb1401f620e84/html5/thumbnails/15.jpg)
Basics of Grid and Cloud computing 15/28
Estonian Grid monitor
● http://monitor.grid.ee/
● Information from Estonian top level GIIS
● Faster than NG monitor
![Page 16: Grid Information Services - ut · LDAP database TOP GIIS TOP GIIS GIIS EE GIIS FI GIIS SE SITE GIIS SITE GIISSITE GIIS ... Grid Configuration Database (GOCDB) ... ARGUS – is a system](https://reader035.fdocuments.us/reader035/viewer/2022071410/61045c92b94fb1401f620e84/html5/thumbnails/16.jpg)
Basics of Grid and Cloud computing 16/28
Accounting records
● SGAS for “local” accounting
● EGI central accounting portal
2
![Page 17: Grid Information Services - ut · LDAP database TOP GIIS TOP GIIS GIIS EE GIIS FI GIIS SE SITE GIIS SITE GIISSITE GIIS ... Grid Configuration Database (GOCDB) ... ARGUS – is a system](https://reader035.fdocuments.us/reader035/viewer/2022071410/61045c92b94fb1401f620e84/html5/thumbnails/17.jpg)
Basics of Grid and Cloud computing 17/28
SGAS
● SGAS – SweGrid Accounting System
● Originally developed for SweGrid
● Now used also for other NGIs
● For local/NGI accounting
![Page 18: Grid Information Services - ut · LDAP database TOP GIIS TOP GIIS GIIS EE GIIS FI GIIS SE SITE GIIS SITE GIISSITE GIIS ... Grid Configuration Database (GOCDB) ... ARGUS – is a system](https://reader035.fdocuments.us/reader035/viewer/2022071410/61045c92b94fb1401f620e84/html5/thumbnails/18.jpg)
Basics of Grid and Cloud computing 18/28
EGI accounting
● EGI accounting portal● accounting.egi.eu● Global view● VO manager/member view● Site admin view● User view
![Page 19: Grid Information Services - ut · LDAP database TOP GIIS TOP GIIS GIIS EE GIIS FI GIIS SE SITE GIIS SITE GIISSITE GIIS ... Grid Configuration Database (GOCDB) ... ARGUS – is a system](https://reader035.fdocuments.us/reader035/viewer/2022071410/61045c92b94fb1401f620e84/html5/thumbnails/19.jpg)
Basics of Grid and Cloud computing 19/28
Service monitoring
● GOCDB portal
● SAM portal● Nagios tests
3
![Page 20: Grid Information Services - ut · LDAP database TOP GIIS TOP GIIS GIIS EE GIIS FI GIIS SE SITE GIIS SITE GIISSITE GIIS ... Grid Configuration Database (GOCDB) ... ARGUS – is a system](https://reader035.fdocuments.us/reader035/viewer/2022071410/61045c92b94fb1401f620e84/html5/thumbnails/20.jpg)
Basics of Grid and Cloud computing 20/28
Service monitoring
● Grid Configuration Database (GOCDB)
● Contains general info about the sites participating to the production Grid
● https://goc.egi.eu ● NGI information● Contacts of sites and
services
![Page 21: Grid Information Services - ut · LDAP database TOP GIIS TOP GIIS GIIS EE GIIS FI GIIS SE SITE GIIS SITE GIISSITE GIIS ... Grid Configuration Database (GOCDB) ... ARGUS – is a system](https://reader035.fdocuments.us/reader035/viewer/2022071410/61045c92b94fb1401f620e84/html5/thumbnails/21.jpg)
Basics of Grid and Cloud computing 21/28
Service monitoring
● GOCDB site view● Contacts● Project info● Networking info● Location info● List of services● List of people
![Page 22: Grid Information Services - ut · LDAP database TOP GIIS TOP GIIS GIIS EE GIIS FI GIIS SE SITE GIIS SITE GIISSITE GIIS ... Grid Configuration Database (GOCDB) ... ARGUS – is a system](https://reader035.fdocuments.us/reader035/viewer/2022071410/61045c92b94fb1401f620e84/html5/thumbnails/22.jpg)
Basics of Grid and Cloud computing 22/28
Service monitoring
● MyEGI – Service Availability Monitoring Portal
● grid-monitoring.cern.ch/myegi/
●
![Page 23: Grid Information Services - ut · LDAP database TOP GIIS TOP GIIS GIIS EE GIIS FI GIIS SE SITE GIIS SITE GIISSITE GIIS ... Grid Configuration Database (GOCDB) ... ARGUS – is a system](https://reader035.fdocuments.us/reader035/viewer/2022071410/61045c92b94fb1401f620e84/html5/thumbnails/23.jpg)
Basics of Grid and Cloud computing 23/28
Service monitoring
● NAGIOS monitoring● SAM test● Site status● Trouble tickets
![Page 24: Grid Information Services - ut · LDAP database TOP GIIS TOP GIIS GIIS EE GIIS FI GIIS SE SITE GIIS SITE GIISSITE GIIS ... Grid Configuration Database (GOCDB) ... ARGUS – is a system](https://reader035.fdocuments.us/reader035/viewer/2022071410/61045c92b94fb1401f620e84/html5/thumbnails/24.jpg)
Basics of Grid and Cloud computing 24/28
Authorization service
● VOMS service
● ARGUS – is a system meant to render consistent authorization decisions for distributed services
4
![Page 25: Grid Information Services - ut · LDAP database TOP GIIS TOP GIIS GIIS EE GIIS FI GIIS SE SITE GIIS SITE GIISSITE GIIS ... Grid Configuration Database (GOCDB) ... ARGUS – is a system](https://reader035.fdocuments.us/reader035/viewer/2022071410/61045c92b94fb1401f620e84/html5/thumbnails/25.jpg)
Basics of Grid and Cloud computing 25/28
arcinfo
● ARC client tool for site info
![Page 26: Grid Information Services - ut · LDAP database TOP GIIS TOP GIIS GIIS EE GIIS FI GIIS SE SITE GIIS SITE GIISSITE GIIS ... Grid Configuration Database (GOCDB) ... ARGUS – is a system](https://reader035.fdocuments.us/reader035/viewer/2022071410/61045c92b94fb1401f620e84/html5/thumbnails/26.jpg)
Basics of Grid and Cloud computing 26/28
Services in ARC CE
![Page 27: Grid Information Services - ut · LDAP database TOP GIIS TOP GIIS GIIS EE GIIS FI GIIS SE SITE GIIS SITE GIISSITE GIIS ... Grid Configuration Database (GOCDB) ... ARGUS – is a system](https://reader035.fdocuments.us/reader035/viewer/2022071410/61045c92b94fb1401f620e84/html5/thumbnails/27.jpg)
Basics of Grid and Cloud computing 27/28
References
● I used several pictures from Oxana Smirnova's presentation
● http://www.nordugrid.org/slides/20111207-oxana.pdf
● More information about information services:● https://wiki.egi.eu/wiki/Tools ● http://www.nordugrid.org/papers.html
![Page 28: Grid Information Services - ut · LDAP database TOP GIIS TOP GIIS GIIS EE GIIS FI GIIS SE SITE GIIS SITE GIISSITE GIIS ... Grid Configuration Database (GOCDB) ... ARGUS – is a system](https://reader035.fdocuments.us/reader035/viewer/2022071410/61045c92b94fb1401f620e84/html5/thumbnails/28.jpg)
Basics of Grid and Cloud computing 28/28
Thank you● More information from:
● Hardi Teder [email protected]
● http://courses.cs.ut.ee/2013/cloud