Www.egi.eu EGI-InSPIRE RI-261323 EGI-InSPIRE EGI-InSPIRE RI-261323 Astro-CG OGF35 19 June 2012 EGI...

21
www.egi.eu EGI-InSPIRE RI-261323 EGI- InSPIRE www.egi.eu EGI-InSPIRE RI-261323 Astro-CG OGF35 19 June 2012 EGI and the European Scientific Communities: Astro-CG, OGF35, Delft, NL 1 Steve Brewer, Chief Community Officer, EGI.eu [email protected]

Transcript of Www.egi.eu EGI-InSPIRE RI-261323 EGI-InSPIRE EGI-InSPIRE RI-261323 Astro-CG OGF35 19 June 2012 EGI...

Page 1: Www.egi.eu EGI-InSPIRE RI-261323 EGI-InSPIRE  EGI-InSPIRE RI-261323 Astro-CG OGF35 19 June 2012 EGI and the European Scientific Communities:

www.egi.euEGI-InSPIRE RI-261323

EGI-InSPIRE

www.egi.euEGI-InSPIRE RI-261323Astro-CG OGF35 19 June 2012

EGI and the European Scientific Communities:

Astro-CG, OGF35, Delft, NL

1

Steve Brewer, Chief Community Officer, EGI.eu

[email protected]

Page 2: Www.egi.eu EGI-InSPIRE RI-261323 EGI-InSPIRE  EGI-InSPIRE RI-261323 Astro-CG OGF35 19 June 2012 EGI and the European Scientific Communities:

www.egi.euEGI-InSPIRE RI-261323

Outline

1. The landscape for integrated e-infrastructure

2. Overview of grid user communities

3. Roadmap for community collaboration

2Astro-CG OGF35 19 June 2012

Page 3: Www.egi.eu EGI-InSPIRE RI-261323 EGI-InSPIRE  EGI-InSPIRE RI-261323 Astro-CG OGF35 19 June 2012 EGI and the European Scientific Communities:

www.egi.euEGI-InSPIRE RI-261323

Outline

1. The landscape for integrated e-infrastructure

2. Overview of grid user communities

3. Roadmap for community collaboration

3Astro-CG OGF35 19 June 2012

Page 4: Www.egi.eu EGI-InSPIRE RI-261323 EGI-InSPIRE  EGI-InSPIRE RI-261323 Astro-CG OGF35 19 June 2012 EGI and the European Scientific Communities:

www.egi.euEGI-InSPIRE RI-261323

C21: Digital Research

4Astro-CG OGF35 19 June 2012

Extracting Knowledge from the Data Deluge

Requires an infrastructure to share services and tools personalised to individual

research communities

Page 5: Www.egi.eu EGI-InSPIRE RI-261323 EGI-InSPIRE  EGI-InSPIRE RI-261323 Astro-CG OGF35 19 June 2012 EGI and the European Scientific Communities:

www.egi.euEGI-InSPIRE RI-261323

Digital Agenda for Europe

5Astro-CG OGF35 19 June 2012

• Borderless Services• Interoperability• Supporting Innovation

Digital Agenda for Europe“Europe should also build its innovative

advantage in key areas through reinforced e-Infrastructures (i.e. GEANT & EGI)”

remove barriers to the free movement

of knowledge

Page 6: Www.egi.eu EGI-InSPIRE RI-261323 EGI-InSPIRE  EGI-InSPIRE RI-261323 Astro-CG OGF35 19 June 2012 EGI and the European Scientific Communities:

www.egi.euEGI-InSPIRE RI-261323

What is EGI?

• European Grid Infrastructure (EGI)– Federation of National Grid

Infrastructures– Represented by EGI.eu (Dutch

foundation)

• National Grid Infrastructures (NGIs)– Sole national point of contact for

‘Grids‘– Integrates individual resource

centres

• Current Status:– 35+ NGIs & 350+ resource centres– 300,000 CPUs & 200PB+ storage

6Astro-CG OGF35 19 June 2012

EGI.eu partners

Page 7: Www.egi.eu EGI-InSPIRE RI-261323 EGI-InSPIRE  EGI-InSPIRE RI-261323 Astro-CG OGF35 19 June 2012 EGI and the European Scientific Communities:

www.egi.euEGI-InSPIRE RI-261323

EGI-InSPIRE Project

Integrated Sustainable Pan-European Infrastructure for Researchers in Europe

A 4 year project with €25M EC contribution

– Project cost €72M– Total Effort ~€330M– Effort: 9261PMs

7Astro-CG OGF35 19 June 2012

Project Partners (50)

EGI.eu, 38 NGIs, 2 EIROs

Asia Pacific (9 partners)

Page 8: Www.egi.eu EGI-InSPIRE RI-261323 EGI-InSPIRE  EGI-InSPIRE RI-261323 Astro-CG OGF35 19 June 2012 EGI and the European Scientific Communities:

www.egi.euEGI-InSPIRE RI-261323

Outline

1. The landscape for integrated e-infrastructure

2. Overview of grid user communities

3. Roadmap for community collaboration

8Astro-CG OGF35 19 June 2012

Page 9: Www.egi.eu EGI-InSPIRE RI-261323 EGI-InSPIRE  EGI-InSPIRE RI-261323 Astro-CG OGF35 19 June 2012 EGI and the European Scientific Communities:

www.egi.euEGI-InSPIRE RI-261323

VO Statistics (April 2012)

9Astro-CG OGF35 19 June 2012

Metrics Value

Registered national and international VOs

226 (3.20% )

Registered users 20883 (14.30% )

Active VOs (High/Medium/Low)

25/23/8

ArcheologyAstronomyAstrophysicsCivil ProtectionComp. ChemistryEarth SciencesFinance

FusionGeophysicsHigh Energy PhysicsLife SciencesMultimediaMaterial Sciences

Supported Research Communities

Page 10: Www.egi.eu EGI-InSPIRE RI-261323 EGI-InSPIRE  EGI-InSPIRE RI-261323 Astro-CG OGF35 19 June 2012 EGI and the European Scientific Communities:

www.egi.euEGI-InSPIRE RI-261323

Technology Innovation

10Astro-CG OGF35 19 June 2012

• Will come from outside EGI– Moving research technologies into production

• Partnership with technology projects– EMI (European Middleware Initiative)– IGE (Initiative for Globus in Europe)– EDGI (European Desktop Grid Initiative)– StratusLab– VenusC– SAGA

Page 11: Www.egi.eu EGI-InSPIRE RI-261323 EGI-InSPIRE  EGI-InSPIRE RI-261323 Astro-CG OGF35 19 June 2012 EGI and the European Scientific Communities:

www.egi.euEGI-InSPIRE RI-261323

VOs, VRCs and partner projects

11

• Virtual Organisations: rules defining people & resources

• VRCs are self-organised (virtual) research communities which give individuals within their community a clear mandate to represent the interests of their research field within the EGI ecosystem.

• Current EGI VRCs: (http://www.egi.eu/community/vrcs/)– WeNMR - Structural biology– LSGC – Life sciences– HMRC – Hydro-meteorology– WLCG – High energy physics– CLARIN/DARIAH – Humanities (with a Letter of Intent)

Plus: Astro, Earth Sciences, Comp. Chem., Fusion, Digital Cultural Heritage

Astro-CG OGF35 19 June 2012

Page 12: Www.egi.eu EGI-InSPIRE RI-261323 EGI-InSPIRE  EGI-InSPIRE RI-261323 Astro-CG OGF35 19 June 2012 EGI and the European Scientific Communities:

www.egi.euEGI-InSPIRE RI-261323

EGI: strategy for 2020

Pillars of the strategy:• Community & Coordination

– Community building through events– Community networking through the NGIs

• Operational Infrastructure– Operate a European wide infrastructure– Offer its use to other research infrastructures– Build a federated cloud environment

• Virtual Research Environments– Enable 3rd party integration & operation of VREs

http://go.egi.eu/EGI2020

12Astro-CG OGF35 19 June 2012

Page 13: Www.egi.eu EGI-InSPIRE RI-261323 EGI-InSPIRE  EGI-InSPIRE RI-261323 Astro-CG OGF35 19 June 2012 EGI and the European Scientific Communities:

www.egi.euEGI-InSPIRE RI-26132313

VRCs – VREs & EGI

EGI Community

Platform

EGI Collaboration

platform

EGI resources(clusters, storages,...)Dedicated or shared resources/platforms

(e.g. Clusters; EC2, PRACE, XSEDE)

Research facilities (e.g. detectors, sensor

networks)

VMVM

VM

SWVM

VMSW EGI Infrastructure platform

DB

DB

Virtual Research

Environment

Created by a project such as CLARIN, ELIXIR,

LifeWatch, ...

Virtual Research Communities

Astro-CG OGF35 19 June 2012

Page 14: Www.egi.eu EGI-InSPIRE RI-261323 EGI-InSPIRE  EGI-InSPIRE RI-261323 Astro-CG OGF35 19 June 2012 EGI and the European Scientific Communities:

www.egi.euEGI-InSPIRE RI-261323

Services(Applications & data)

Anatomy of a VRE

14

Service access (Science gateways - portal, desktop and mobile)

Off-the-shelf and custom VM images

Domain specific and generic data

repositories

Off-the-shelf and custom applications

Service integration(workflows)

EGI support

EGI support

EGI support

EGI suppo

rt

Astro-CG OGF35 19 June 2012

Page 15: Www.egi.eu EGI-InSPIRE RI-261323 EGI-InSPIRE  EGI-InSPIRE RI-261323 Astro-CG OGF35 19 June 2012 EGI and the European Scientific Communities:

www.egi.euEGI-InSPIRE RI-261323

EGI support:Service access

• Catalogue of existing solutions– http://go.egi.eu/sciencegateways

• Gateway components repository– SCI-BUS portlet repository

will be used (see MoU)

• Plan: “How-to” documentation– Develop an EGI science gateway primer

(through a new EGI Virtual Team project and [email protected])

• Portal & gateway workshops– CF & TF– Portal workshops by NGIs– Community workshops on portals

15Astro-CG OGF35 19 June 2012

Page 16: Www.egi.eu EGI-InSPIRE RI-261323 EGI-InSPIRE  EGI-InSPIRE RI-261323 Astro-CG OGF35 19 June 2012 EGI and the European Scientific Communities:

www.egi.euEGI-InSPIRE RI-261323

EGI support: Cross cutting support

• Applications Database (EGI software catalogue)– Stores information about any EGI software– Tags:

• Organise software into clusters

– Subscription:• Join an item/cluster as supporter

(developer, operator, expert)

– Notifications:• To get informed about changes

– Web gadgets:• Embed customised lists of software into your website

– Write API Planned• Itegrate the catalogue with the EGI platform (e.g. Info system)• Integrate the catalogue with other catalogues

• Training Marketplace– Advertise and search for events, materials, online courses– Web gadgets:

• Embed customised lists of software into your website

• Events– Community and Technical Forums (Call for TF2012 co-located events is open!)– Topical workshops (hosted by NGIs)

16Astro-CG OGF35 19 June 2012

Page 17: Www.egi.eu EGI-InSPIRE RI-261323 EGI-InSPIRE  EGI-InSPIRE RI-261323 Astro-CG OGF35 19 June 2012 EGI and the European Scientific Communities:

www.egi.euEGI-InSPIRE RI-261323

Outline

1. The landscape for integrated e-infrastructure

2. Overview of grid user communities

3. Roadmap for community collaboration

18Astro-CG OGF35 19 June 2012

Page 18: Www.egi.eu EGI-InSPIRE RI-261323 EGI-InSPIRE  EGI-InSPIRE RI-261323 Astro-CG OGF35 19 June 2012 EGI and the European Scientific Communities:

www.egi.euEGI-InSPIRE RI-261323

Roadmap for collaboration

• EGI wants to support Astronomy– work with Astro-CG, AA VRC, other projects– What is needed? VRE, gateways, apps?– Virtual Teams to achieve short-term goals

• Specific use cases and scenarios – descriptions?

• Formally involve specific NGIs – which?

• Virtualisation to achieve scalability of solutions?

• Identify which software applications are needed?

• Data archiving and reuse; sharing and security

19Astro-CG OGF35 19 June 2012

Page 19: Www.egi.eu EGI-InSPIRE RI-261323 EGI-InSPIRE  EGI-InSPIRE RI-261323 Astro-CG OGF35 19 June 2012 EGI and the European Scientific Communities:

www.egi.euEGI-InSPIRE RI-261323

VT projects and more

Initiatives of relevance to Astronomy

21Astro-CG OGF35 19 June 2012

1. The Federated Cloud Task Force is already providing a cloud infrastructure through a few committed NGIs. Pilot resources are being made available to various research communities participating in the Task. (User workshop in July in Amsterdam)

2. A lively portal developer and provider community is being supported by EGI. The group is able to setup and operate custom, application and/or community specific portals for members of the community to interact with EGI.

3. A project to assess the possibilities for federated identity management in EGI and the readiness of EGI member states for federated authentication and authorisation mechanisms will deliver greater flexibility for integrated services.

4. EGI’s operating resources and user support services continue to grow, with new types of services and infrastructures, such as desktop grids, map-reduce frameworks, GPU clusters continuously being developed and made available.

5. Virtual Team (VT) projects – 3- 6 months (with NGIs)

Suggestions for future VT projects may emerge from discussions at OGF35Further information on VTs: https://wiki.egi.eu/wiki/Virtual_teams

Page 20: Www.egi.eu EGI-InSPIRE RI-261323 EGI-InSPIRE  EGI-InSPIRE RI-261323 Astro-CG OGF35 19 June 2012 EGI and the European Scientific Communities:

www.egi.euEGI-InSPIRE RI-261323

Conclusions

• EGI is more than a production infrastructure:– A framework for sharing and innovation– A forum for communication and collaboration

• Astronomy research community has strong grid history– Many years experience plus involved from the start of EGI– Many grid-based applications, research and publications

• Astronomy community is a key part of future EGI Strategy– EGI Strategy is aligned with EU 2020 strategy inc. Innovation Union – EGI will support and partner various ESFRI projects and researchers– EGI will develop requirements with technology developers & providers

22Astro-CG OGF35 19 June 2012

Page 21: Www.egi.eu EGI-InSPIRE RI-261323 EGI-InSPIRE  EGI-InSPIRE RI-261323 Astro-CG OGF35 19 June 2012 EGI and the European Scientific Communities:

www.egi.euEGI-InSPIRE RI-261323

EGI-InSPIRE

www.egi.euEGI-InSPIRE RI-261323Astro-CG OGF35 19 June 2012

Questions?

EGI user community support team:

[email protected]

23

See you at the EGI Technical Forum 2012,Prague, Czech Republic between 17–21 September