Www.gisela-grid.eu Grid Initiatives for e-Science virtual communities in Europe and Latin America...

16
www.gisela-grid.eu Grid Initiatives for e-Science virtual communities in Europe and Latin America GISELA : - A Resource Provider - An opportunity for VRCs Ph.Gavillet on behalf of the GISELA Project EGI Technical Forum, 19 th -23 rd September 2011 Lyon (France)

Transcript of Www.gisela-grid.eu Grid Initiatives for e-Science virtual communities in Europe and Latin America...

www.gisela-grid.eu

Grid Initiatives for e-Science virtual communities in Europe and Latin America

GISELA :

- A Resource Provider

- An opportunity for VRCs

Ph.Gavillet on behalf of the GISELA Project

EGI Technical Forum, 19th-23rd September 2011Lyon (France)

EGI Technical Forum (19-23 Sep. 2011 - Lyon / France) 3www.gisela-grid.eu 3

GISELA as Resource Provider

– General is much experienced in Grid computing has a powerful Infrastructure complies with EGI policies & recommendations

– Specificities Both Service (gLite) and Opportunistic Computing (OurGrid) supported

EGI Technical Forum (19-23 Sep. 2011 - Lyon / France) 4www.gisela-grid.eu 4

Long record in e-Science support

• Fruit of 5-6 year experience of successful e-Science EU-LA Collaboration, through EU funded projects (EELA, EELA-2, GISELA)

• Present in almost all LA countries

• Most encompassing e-Infrastructure for scientific collaborations between Latin America and Europe

• Sound long-term sustainability approach rooted on CLARA, NRENs, LA NGIs

EGI Technical Forum (19-23 Sep. 2011 - Lyon / France)www.gisela-grid.eu 5

Year 1 Year 2Pledge

Powerful e-Infrastructure in Latin America

“Extra” resources for the prod.vo.eu-eela.eu VO

EGI Technical Forum (19-23 Sep. 2011 - Lyon / France)www.gisela-grid.eu 6

Recource Centres contributions

Cumulative GISELA contribution per site (normalised CPU hours)

EGI Technical Forum (19-23 Sep. 2011 - Lyon / France) 7www.gisela-grid.eu

EGI compliant Infrastructure

• EGI – UFRJ (on behalf of GISELA) Resource Provider MoU

• EGI compliance is based on the adoption of common services and practices

– The Operational Level Agreement (OLA) (http://documents.gisela-grid.eu/record/87?ln=en)

– Monitoring System (Nagios)

– Ticket System (xGUS)

– Accounting System (APEL)

– Middleware (gLite)

– Resource database (GOCDB)

– Operations Dashboard

EGI Technical Forum (19-23 Sep. 2011 - Lyon / France) 8www.gisela-grid.eu 8

Specificity: gLite <-> OurGrid interoperability

• Latin American context:– Large Universities (UFRJ, USP,…) in International collaborations thus

complying with the corresponding computing model and middlewares (gLite, OSG,..)

– Several small Universities naturally adopting the Desktop-based opportunistic Grid approach and using the OurGrid middleware

EGI Technical Forum (19-23 Sep. 2011 - Lyon / France) 9www.gisela-grid.eu 9

GISELA: an opportunity for VRCs

– Platform for all kinds of Applications– Offers a series of well-supported Services (e.g. DIRAC)– Training & Support– Collaborates with EGI and Regional Initiatives

EGI Technical Forum (19-23 Sep. 2011 - Lyon / France) 10www.gisela-grid.eu

Platform for all kind of Applications / VRCs

10

• VRCs– A few large VRCs from Life Sciences (e.g. WeNMR, Biomed), Earth Sciences (WRF4G,

Seismic simulations) and HEP (Auger, LHC expts) – Legacy: EELA-2 User Communities, typically 1-2 Institution group(s), largely located in

Latin America– 34 Applications are in a production stage

• MoU signed with EGI-InSPIRE enables…

– VRC members in Europe exploit GISELA resources– VRC members in LA exploit EGI resources (most usual)– Publishing GISELA applications in the EGI Applications data base http://appdb.egi.eu/

EGI Technical Forum (19-23 Sep. 2011 - Lyon / France) 11www.gisela-grid.eu

Usage statistics

11

• Accumulated CPU-hours, grouped by VOs:

• prod.vo.eu-eela.eu: catch all VO (Earth Sciences, EELA-2 legacy,..)

EGI Technical Forum (19-23 Sep. 2011 - Lyon / France) 12www.gisela-grid.eu 12

Portfolio of Services

• Supported services (extract) :– Application-related Services

Job Catalogue, File and Data Management• Digital archives, Secure storage, WatchDog, lcg-rec toolkit

– Data processing and user analysis services DIRAC: workload and data management system

• Possibility of development of new services– Industry portal– Dynamic creation of Customised Virtual Clusters (CVC -

Uniandes)– Development of a VRC-driven Web site

EGI Technical Forum (19-23 Sep. 2011 - Lyon / France) 13www.gisela-grid.eu 13

DIRAC as a complete VRC solution

• DIRAC is a complete VRC Grid solution

• Already used by several large VRCs:– HEP (LHCb, Belle, ILC, Magic)

– BIOMED(VIP)

• Development coordinated by CPPM (Marseille), a GISELA Partner

• Fully supported within WP6

EGI Technical Forum (19-23 Sep. 2011 - Lyon / France) 14www.gisela-grid.eu 14

Collaboration with EGI & Regional

projects • EGI

– Resource Providers MoU, signed with EGI-eu– Project MoU (Dissemination, Training, Support tools & Services),

signed with EGI-InSPIRE

• EGI-related projects / Regional Initiatives

– DEGISCO (UFCG-Brazil also partner) Volunteer computing support (gLite <-> OurGrid bridge)

– CHAIN (CLARA, INFN, CIEMAT also partners) (MoU foreseen) Focus on VRC support (e.g. training)

– EPIKH (Brazil: CEFET/RJ, UFRJ, Chile: UTFSM, Mexico: UNAM) Joint sponsoring /organisation of Tutorials & Workshops (MoU signed)

– EU-IndiaGrid2 (MoU signed)

EGI Technical Forum (19-23 Sep. 2011 - Lyon / France) 15www.gisela-grid.eu 15

GISELA interests

– Welcome international VRCs– Interest in VRCs collaborating with LA– Efficient communication scheme between VRCs and GISELA – Efficient collaboration with EGI on VRC support

EGI Technical Forum (19-23 Sep. 2011 - Lyon / France) 16www.gisela-grid.eu 16

GISELA interests (1/2)

• Welcome international VRCs– DoW: “GISELA is open to collaboration with institutions / projects, public or

private, whose activities are compatible with its Objectives”

– On top of mentioned VRCs, production from Earth Sciences (Academia Sinica), Astrophysics team (UFRJ-BR), Solid state physics team (UFRJ-BR)

• Interest in VRCs collaborating with Latin America– GISELA is naturally (but not exclusively) looking for existing or foreseen

collaborations with Latin America

• GISELA <-> VRC: Simple, albeit efficient communication scheme– Vilnius – EGI UF

At an early stage have a concise Technical document defining the characteristics of VO, Applications, WE, SE, batch queues, support aspects,…

One point-to-point interface covering all matters (VO-related, training,...) Definition of a simple follow-up scheme, monitoring of activities based on

standard tools (e.g. NAGIOS screen…)– Lyon – EGI TF

Status: to be discussed at this Workshop

EGI Technical Forum (19-23 Sep. 2011 - Lyon / France) 17www.gisela-grid.eu 17

GISELA interests (2/2)

• GISELA – EGI: Efficient cooperation via the User Community Support Team (UCST) and the User Communities Board (UCB):

– EGI-InSPIRE – GISELA Project MoU as instrument to coordinate VRC support

• Common (RPs – VRCs – EGI) dissemination / outreach activities – Common participation in UCST, UCB

– GISELA – e-ScienceTalk MoU (signed) as instrument of coordinated dissemination

Use channels as the GridCafé, GridCast, iSGTW and GridGuide

– Cross participation in Forum, Conferences,…