13th EELA Tutorial, La Antigua, 18-19, October 2007
www.eu-eela.org
E-infrastructure shared between Europe and Latin America
FP6−2004−Infrastructures−6-SSA-026409
Introducción a la Tecnología Grid y GILDA
Richard Miguel
SENAMHI - PERU
La Antigua, 18 – 19 Octubre 2007
E-infrastructure shared between Europe and Latin America
13th EELA Tutorial, La Antigua, 18-19 October 2007FP6−2004−Infrastructures−6-SSA-026409
Agenda
• Introducción• Conceptos de Grid• Beneficios• Seguridad • Gilda
2
E-infrastructure shared between Europe and Latin America
13th EELA Tutorial, La Antigua, 18-19 October 2007FP6−2004−Infrastructures−6-SSA-026409
Introducción
• Que es Grid?– Grid puede ser comparado con una red eléctrica donde los
usuarios pueden conectar cualquier dispositivo desde cualquier parte de ella sin necesidad de saber de donde proviene la energía.
– Analógicamente, los usuarios de la GRID pueden conectar su computador a una red de recursos computacionales y acceder a la potencia de ellos sin necesidad de saber donde se encuentran estos recursos.
– También se dice que es un “cluster de clusters” donde se agrupan recursos de computo separados geográficamente a través de una red de comunicación para tal fin.
3
E-infrastructure shared between Europe and Latin America
13th EELA Tutorial, La Antigua, 18-19 October 2007FP6−2004−Infrastructures−6-SSA-026409
GRID
4
Site1Site2
User Interface
E-infrastructure shared between Europe and Latin America
13th EELA Tutorial, La Antigua, 18-19 October 2007FP6−2004−Infrastructures−6-SSA-026409
Conceptos de GRID
• Recursos Computacionales– Equipos o computadores donde los usuarios puedan ejecutar
“jobs”, aplicaciones, almacenar o recuperar datos sin importar el lugar geografico donde se encuentre dicho recurso.
• Job– Es una tarea computacional, (ejecutable o script) que los
usuarios pueden ejecutar en el GRID con la finalidad de obtener un resultado final de regreso a un recurso al cual tenga acceso.
• Job Submission– Es el acto por el cual un usuario delega al GRID la
responsabilidad de hallar el mejor recurso disponible en cualquier lugar del mundo y enviar el job para ser ejecutado en dicho recurso.
5
E-infrastructure shared between Europe and Latin America
13th EELA Tutorial, La Antigua, 18-19 October 2007FP6−2004−Infrastructures−6-SSA-026409
Conceptos de GRID
6
• VOs:Individuos u organizaciones que tienen acceso a los recursos de GRID
User Interface
User Interface
Grid services
E-infrastructure shared between Europe and Latin America
13th EELA Tutorial, La Antigua, 18-19 October 2007FP6−2004−Infrastructures−6-SSA-026409 7
Multi-VOs
• Usuarios se unen a VOs
• Una Organizacion Virtual ofrece recursos & negocia accessos
• El middleware de GRID se ejecuta en cada site– “Storage elements”
– “Compute elements”
• Servicios adicionales (tanto usuarios y grid middleware) habilita el GRID
• Efecto:
colaboración
INTERNET
E-infrastructure shared between Europe and Latin America
13th EELA Tutorial, La Antigua, 18-19 October 2007FP6−2004−Infrastructures−6-SSA-026409 8
Requerimientos del GRID
• Heterogéneo• VO Resource Sharing• Uso de Recursos• Job Execution• Data Services• Seguridad• Costos Administrativos• Escalabilidad• Disponibilidad• Requerimientos Específicos
E-infrastructure shared between Europe and Latin America
13th EELA Tutorial, La Antigua, 18-19 October 2007FP6−2004−Infrastructures−6-SSA-026409
Middleware
• Es la capa intermedia entre las aplicaciones de los Usuarios y los Recursos de Grid.
9
E-infrastructure shared between Europe and Latin America
13th EELA Tutorial, La Antigua, 18-19 October 2007FP6−2004−Infrastructures−6-SSA-026409
Middleware Grid
10
E-infrastructure shared between Europe and Latin America
13th EELA Tutorial, La Antigua, 18-19 October 2007FP6−2004−Infrastructures−6-SSA-026409
Beneficios del Grid
• Explotar los recursos no utilizados o sub utilizados.• Capacidad de acceder a grandes recursos de computo.• La tecnología GRID nos proporciona la posibilidad de
colaborar con otro investigadores en distintas partes del mundo y obtener resultados positivos de dicha colaboración.
• Proporciona la posibilidad de balancear recursos.• Confiabilidad.• Seguridad.
11
E-infrastructure shared between Europe and Latin America
13th EELA Tutorial, La Antigua, 18-19 October 2007FP6−2004−Infrastructures−6-SSA-026409
Seguridad
• Basada en Certificados Digitales X.509
12
E-infrastructure shared between Europe and Latin America
13th EELA Tutorial, La Antigua, 18-19 October 2007FP6−2004−Infrastructures−6-SSA-026409 13
Futuro del GRID
• Incremento del número de usuarios de la infraestructura– Diseminacion de los resultados– Entrenamiento y Educacion– Grids ofrecen nuevas opotunidades para trabajo colaborativo.
• Incremento del numero de aplicaciones para mejorar el soporte de aplicaciones y las funcionalidades del middleware.– Incremento de la estabilidad, escalabilidad y usabilidad.– Mayores esfuerzos son necesarios particularmente sobre la administracion de
un VO, seguridad de la infraestructura, administracion de datos y administraciond e jobs.
– Extensiones del middleware del Grid de alto nivel.
• Incremento de la infrastructure de Grid • Incremento de la administrabilidad de los servicios de GRID.
– Reduciendo el costo de la operacion – Asegurando la interoperatibilidad entre infraestructuras.
E-infrastructure shared between Europe and Latin America
13th EELA Tutorial, La Antigua, 18-19 October 2007FP6−2004−Infrastructures−6-SSA-026409
The GILDA Project – web portal
•https://gilda.ct.infn.it
E-infrastructure shared between Europe and Latin America
13th EELA Tutorial, La Antigua, 18-19 October 2007FP6−2004−Infrastructures−6-SSA-026409
Por qué t-Infrastructure?
• Evita la interrupción de los sistemas de producción de los proyectos de Grid.
• Prepara participantes para futuras actualizaciones del middleware.
• Fácil punto de entrada para nuevas comunidades y usuarios.
• Proporciona operación garantizada para un Tutorial.
E-infrastructure shared between Europe and Latin America
13th EELA Tutorial, La Antigua, 18-19 October 2007FP6−2004−Infrastructures−6-SSA-026409 16•Lima, 12th EELA Tutorial, 24.09.2007
GILDA Test-bed
•~ 20 sites in 4 continents
E-infrastructure shared between Europe and Latin America
13th EELA Tutorial, La Antigua, 18-19 October 2007FP6−2004−Infrastructures−6-SSA-026409 17•Lima, 12th EELA Tutorial, 24.09.2007
Todos los servicios gLite en GILDA
•MIDDLEWARE VERSION: gLite 3.0.0
E-infrastructure shared between Europe and Latin America
13th EELA Tutorial, La Antigua, 18-19 October 2007FP6−2004−Infrastructures−6-SSA-026409 18•Lima, 12th EELA Tutorial, 24.09.2007
GILDA Sponsors (https://gilda.ct.infn.it/sponsors.html)
E-infrastructure shared between Europe and Latin America
13th EELA Tutorial, La Antigua, 18-19 October 2007FP6−2004−Infrastructures−6-SSA-026409 19•Lima, 12th EELA Tutorial, 24.09.2007
Training Strategy (1)
E-infrastructure shared between Europe and Latin America
13th EELA Tutorial, La Antigua, 18-19 October 2007FP6−2004−Infrastructures−6-SSA-026409
Before trying GILDA…
• First Steps:
•1
•2
•3 •4
1. Ask for a GILDA personal certificate
2. Load the certificate in your browser
3. Accept Use Policy
4. Subscribe to the GILDA Virtual Organisation
E-infrastructure shared between Europe and Latin America
13th EELA Tutorial, La Antigua, 18-19 October 2007FP6−2004−Infrastructures−6-SSA-026409 21
The GILDA Certification Authority(https://gilda.ct.infn.it/CA)
E-infrastructure shared between Europe and Latin America
13th EELA Tutorial, La Antigua, 18-19 October 2007FP6−2004−Infrastructures−6-SSA-026409 22
Training Strategy (2)
E-infrastructure shared between Europe and Latin America
13th EELA Tutorial, La Antigua, 18-19 October 2007FP6−2004−Infrastructures−6-SSA-026409 23
The GILDA VOMS(https://voms.ct.infn.it:8443/voms/gilda/)
E-infrastructure shared between Europe and Latin America
13th EELA Tutorial, La Antigua, 18-19 October 2007FP6−2004−Infrastructures−6-SSA-026409 24
Training Strategy (3)
•Site Managers •Beginners
•Application•Developers
E-infrastructure shared between Europe and Latin America
13th EELA Tutorial, La Antigua, 18-19 October 2007FP6−2004−Infrastructures−6-SSA-026409 25
Tutorial: Beginners•Beginners
•USER INTERFACE
•PLUG AND PLAY
•USER INTERFACE
•VIRTUAL MACHINE
•USER INTERFACE
•REAL (gLite-tutor)
•GENIUS
•WEB PORTAL
•https://glite-tutor.ct.infn.it
•[glite-tutor] /home/giorgio > voms-proxy-init --voms gilda•Cannot find file or dir: /home/giorgio/.glite/vomses•Your identity: /C=IT/O=GILDA/OU=Personal Certificate/L=INFN/CN=Emidio Giorgio/[email protected]•Enter GRID pass phrase:•Your proxy is valid until Mon Jan 30 23:35:51 2006•Creating temporary proxy.................................Done•Contacting voms.ct.infn.it:15001 [/C=IT/O=GILDA/OU=Host/L=INFN Catania/CN=voms.ct.infn.it/[email protected]] "gilda"•Creating proxy ...................................... Done•Your proxy is valid until Mon Jan 30 23:35:51 2006
E-infrastructure shared between Europe and Latin America
13th EELA Tutorial, La Antigua, 18-19 October 2007FP6−2004−Infrastructures−6-SSA-026409 26
Tutorial: Site Managers
•Site Managers
•HOST
•CERTS
•GILDA TESTBED
•( SERVICES AND
•SITES )
•GILDA VIRTUAL
•SERVICES MACHINES
•GILDA MONITORING
•SYSTEMS
•HOST
•CERTS•HOST
•CERTS
E-infrastructure shared between Europe and Latin America
13th EELA Tutorial, La Antigua, 18-19 October 2007FP6−2004−Infrastructures−6-SSA-026409 27
Tutorial: Application Developers•Application
Developers
•GILDA
•DEMONSTRATOR
•https://glite-demo.ct.infn.it •GILDA USE CASES
•HOW TO USE CLI/API/WEB
SERVICES in gLite
•GILDA TEAM SUPPORT FOR
•APPLICATION INTEGRATION
•(GENIUS ALSO) •Demonstrative
• Applications
E-infrastructure shared between Europe and Latin America
13th EELA Tutorial, La Antigua, 18-19 October 2007FP6−2004−Infrastructures−6-SSA-026409 28
Some of the Applications ported on GILDA
• 8 Virtual Organizations supported: – Biomedicine (Biomed)– Earth Science Academy (ESR)– Earth Science Industry (CGG)– Astroparticle Physics (MAGIC)– Computational Chemistry (GEMS)– Grid Search Engines (GRACE)– Astrophysics (PLANCK)– Computation Archaeology (ARCHAEOGRID)
• Development of complete interfaces with GENIUS for 3 Biomed Applications: GATE, hadronTherapy, and Friction/Arlecore
• Development of complete interfaces with GENIUS for 4 Generic Applications: EGEODE (CGG), MAGIC, GEMS, and CODESA-3D (ESR) (successfull demos of EGEODE and GEMS at EGEE review)
• Development of complete interfaces with GENIUS for 16 demonstrative applications available on the GILDA Grid Demonstrator (https://grid-demo.ct.infn.it)
• Development of complete interface with CLI for NEMO
E-infrastructure shared between Europe and Latin America
13th EELA Tutorial, La Antigua, 18-19 October 2007FP6−2004−Infrastructures−6-SSA-026409 29
The GILDA Training Material(https://grid.ct.infn.it/twiki/bin/view/GILDA/WebHome)
E-infrastructure shared between Europe and Latin America
13th EELA Tutorial, La Antigua, 18-19 October 2007FP6−2004−Infrastructures−6-SSA-026409 30
The GILDA Support System
•http://gilda-support.ct.infn.it
E-infrastructure shared between Europe and Latin America
13th EELA Tutorial, La Antigua, 18-19 October 2007FP6−2004−Infrastructures−6-SSA-026409 31
Ticket Creation (1/2)
E-infrastructure shared between Europe and Latin America
13th EELA Tutorial, La Antigua, 18-19 October 2007FP6−2004−Infrastructures−6-SSA-026409 32
Ticket Creation (2/2)
E-infrastructure shared between Europe and Latin America
13th EELA Tutorial, La Antigua, 18-19 October 2007FP6−2004−Infrastructures−6-SSA-026409 33
Standard tutorial layout
•Local site
•User Interface
•Resource
Broker
•BDII
•Students’Room
•ssh •Worker nodes
•Worker nodes
•CE
•LFC
•SE
•VOMS
•GILDA t-Infrastructure
•User•Desktop
•Virtual•UI
•Virtual•UI
•Virtual•UI
E-infrastructure shared between Europe and Latin America
13th EELA Tutorial, La Antigua, 18-19 October 2007FP6−2004−Infrastructures−6-SSA-026409 39
Stats
• Used in more than 180 tutorials• 7693 certificates issued• > 3 TB of videos and Virtual Grid
services downloaded• Web portal: 768.880 hits in 2006
E-infrastructure shared between Europe and Latin America
13th EELA Tutorial, La Antigua, 18-19 October 2007FP6−2004−Infrastructures−6-SSA-026409 40•Lima, 12th EELA Tutorial, 24.09.2007
Stats
E-infrastructure shared between Europe and Latin America
13th EELA Tutorial, La Antigua, 18-19 October 2007FP6−2004−Infrastructures−6-SSA-026409 41•Lima, 12th EELA Tutorial, 24.09.2007
Non EU countries benefited by GILDA courses
•Basic / user tutorial
•Advanced / sysadmin
•Application Porting
E-infrastructure shared between Europe and Latin America
13th EELA Tutorial, La Antigua, 18-19 October 2007FP6−2004−Infrastructures−6-SSA-026409 42•Lima, 12th EELA Tutorial, 24.09.2007
Non EU countries benefited by GILDA courses
•Basic / user tutorial
•Advanced / sysadmin
•4 •7•1
•Application Porting
E-infrastructure shared between Europe and Latin America
13th EELA Tutorial, La Antigua, 18-19 October 2007FP6−2004−Infrastructures−6-SSA-026409 43
Summary and conclusions
• GILDA is a virtual laboratory for dissemination of grid computing:
– It is a “de facto” standard t-Infrastructure adopted both by EGEE and many EU-FP6 projects (EELA, EUCHINAGRID, EUMEDGRID, EUINDIAGRID, ICEAGE, etc.)
– It is a complete suite of grid elements (test-bed, CA, VO, monitoring system, web portal, user interfaces, support system) and applications fully dedicated to dissemination purposes and pre-porting of new applications to EGEE Infrastructure
– GILDA runs latest production version of the gLite middleware to make the transition from the t-Infrastructure to the e-Infrastructure easy and transparent
E-infrastructure shared between Europe and Latin America
13th EELA Tutorial, La Antigua, 18-19 October 2007FP6−2004−Infrastructures−6-SSA-026409 44
Links• GILDA home page
– https://gilda.ct.infn.it• GILDA Certification Authority
– https://gilda.ct.infn.it/CA/• GILDA Virtual Organization
– https://voms.ct.infn.it:8443/voms/gilda/• GILDA Support System
– http://gilda-support.ct.infn.it• GILDA Form for Bookings
– http://gilda-support.ct.infn.it• GILDA Repository of Training Material
– https://grid.ct.infn.it/twiki/bin/view/GILDA/WebHome • GILDA Virtual Services
– https://gilda.ct.infn.it/VirtualServices.html
E-infrastructure shared between Europe and Latin America
13th EELA Tutorial, La Antigua, 18-19 October 2007FP6−2004−Infrastructures−6-SSA-026409 45
Preguntas
Top Related