www.consorzio-cometa.it

FESR

Consorzio COMETA - Progetto PI2S2

The COMETA consortium and its activities for Grid adoption by Industry in the context of the PI2S2 Project

Roberto Barbera

University of Catania and INFN

Business Track at EGEE’07

Budapest, 02.10.2007

Budapest, Business Track at EGEE’07, 02.10.2007 2

Outline

• Introduction

• The PI2S2 Project…

• … and its activities related to Industry

• Summary and Conclusions

Budapest, Business Track at EGEE’07, 02.10.2007 3

The Pillars of the Italian e-Infrastructure

The

NetworkThe Grid

FESR

Budapest, Business Track at EGEE’07, 02.10.2007 4

Objectives of an e-Infrastructure in Sicily

• Create a Virtual Laboratory in Sicily, both for scientific and industrial applications, built on top of a grid infrastructure

• Connect the Sicilian e-Infrastructure to those already existing in Italy, in Europe, and in the rest of the world improving the scientific collaboration and increasing the “competitiveness” of e-Science and e-Industry “made in Sicily”

• Disseminate the “grid paradigm” through the organization of dedicated events and training courses

• Trigger/foster the creation of spin-offs in the ICT area in order to reduce the “brain drain” of brilliant young people to other parts of Italy and beyond

Budapest, Business Track at EGEE’07, 02.10.2007 5

~15.000.000 € in 3 years!~300 FTE’s ! (2/3 new hired staff)

2500+ CPUs4+ TFlops250+ TBytes

The Sicilian Grid in one slide

Budapest, Business Track at EGEE’07, 02.10.2007 6

The Sicilian Grid Projects

Budapest, Business Track at EGEE’07, 02.10.2007 7

The PI2S2 Project’s budget

• Total budget: € 11,338,250 (€ 8,503,687 from EC and € 2,834,563 from Consorzio COMETA)

PI2S2 Budget

MIUR75%

Consorzio COMETA

25%

PI2S2 Budget

Internal staff24%

External staff37%

Technological services

1%

R&D indirect costs4%

Infrastructure29%

Counselling4%

Softw are1%

Budapest, Business Track at EGEE’07, 02.10.2007 8

The COMETA Consortium(http://www.consorzio-cometa.it)

Budapest, Business Track at EGEE’07, 02.10.2007 9

Project Workplan

Work Packages

WP1 Design and creation of a GRID infrastructure

WP2Middleware integration with design and development of test procedures

WP3Hardware and software platforms for dissemination and training

WP4Development and integration of applications in the GRID

Budapest, Business Track at EGEE’07, 02.10.2007 10

The PI2S2 Production Service (1/3)

Catania

Budapest, Business Track at EGEE’07, 02.10.2007 11

The PI2S2 Production Service (2/3)

1. ~300 cores AMD Opteron 2218

2. 2 GB of memory per core

3. LSF 6.2 as LRMS everywhere

4. Infiniband-4X at all sites

1. ~60 TB of raw disk storage

2. Distributed/parallel GPFS filesystem

gLite v3.0 middleware everywhere !New delivery of ~1600 cores and ~140 TB

of storage expected by the end of October

Budapest, Business Track at EGEE’07, 02.10.2007 12

The PI2S2 Production Service (3/3)

350 jobs/day – 10 CPU years in 1 month

Budapest, Business Track at EGEE’07, 02.10.2007 13

Relationships with Private Companies

• Official agreement signed with ORACLE for the S-Sicilia Project aiming at setting-up a Competence Centre in Sicily for QoS accounting on a grid environment in collaboration with the Consorzio COMETA and a University of Messina spin-off SME (see ORACLE presentation in the plenary session of yesterday).

• Agreement finalized with MICROSOFT for the adoption of Conference-XP as a platform to be used for/during grid training events.

• Other agreements under formalization with Ferrari, FIAT, and Technipetrol.

Budapest, Business Track at EGEE’07, 02.10.2007 14

The S-Sicilia Project

Budapest, Business Track at EGEE’07, 02.10.2007 15

• Presently on gLite– Users use the gLite middleware

services from Linux-based User Interfaces via a CLI

– (almost) All gLite resources are Linux-based

• This implies– Grid users need to be trained– Only Linux-based applications

can be deployed onto the Grid

• Porting of gLite to Windows– User Interface– Computing Element (farm of

WNs)

Gatekeeper + LRMS

User Interface

Linux WNs

WMProxy

User Interface

WindowsXP Wns

new users can use the grid !

windows applications can run on the grid !

Porting of gLite on Windows platform (1/2)

Budapest, Business Track at EGEE’07, 02.10.2007 16

Porting of gLite on Windows platform (2/2)

Gatekeeper + LRMS

User Interface

Linux WNs

WMProxy

User Interface

WindowsXP Wns

new users can use the grid !

Windows applications can run on the grid !

Stable prototype of a GUI

for Windows available.

Windows sites already available .

Budapest, Business Track at EGEE’07, 02.10.2007 17

Grid2Win User Interface

Local file system explorer

Grid file system explorer

Budapest, Business Track at EGEE’07, 02.10.2007 18

A gLite site running Windows !

Budapest, Business Track at EGEE’07, 02.10.2007 19

SE

Key Repository

SE

USER VIRTUAL ORGANIZATION

Key

File Encryption /Decryption

Encrypted File

Encrypted File

The Problem of Insider Abuse and the Secure Storage

SECURE ENVIRONMENTSECURE ENVIRONMENT

Budapest, Business Track at EGEE’07, 02.10.2007 20

Encryption and Storage (lcg-scr)

1) Create random “Key” and “IV”

2) Encrypt “File” using the Key (AES 256 bit)

3) Store “Key”, “IV” and

UI

Keystore

KeyFileE )(

SE

IVKeyKeyFileE )(

Budapest, Business Track at EGEE’07, 02.10.2007 21

Retrieval and Decryption (lcg-scp)

1) Retrieve “Key”, “IV” and

2) Decrypt “File” using Key

UI

Keystore

KeyFileE )(

KeyFileE )(

SE

KeyFileE )(

File

IVKey

Budapest, Business Track at EGEE’07, 02.10.2007 22

Secure Storage vs. EDS (Hydra)

Budapest, Business Track at EGEE’07, 02.10.2007 23

The GENIUS Grid Portal

NICE is one of the companies officially

collaborating with the Consorzio COMETA

Budapest, Business Track at EGEE’07, 02.10.2007 24

The GENIUS Job Wizard(“à la Sun Grid”)

1

3

2

4First prototype ready by Q1/2008

Budapest, Business Track at EGEE’07, 02.10.2007 25

Other middleware developments

• Development of methods for grid advance reservation/allocation and access to data and computing resources.

• Storage Accounting in a grid environment.

• Creation of a grid-security-enabled license server (based on FlexLM) for commercial software.

• Seamless integration of gLite WMS with MPICH-2 (with and without native Infiniband support).

Budapest, Business Track at EGEE’07, 02.10.2007 26

• Co-organized by Consorzio COMETA and EGEE• 2 full days; more than 80 participants• Participation of many Companies. Among them:

– APC– DATAMAT– FERRARI– FIAT– HP– IBM– MICROSOFT– ORACLE– RITTAL

• Concrete interest of Industry to “try” grid infrastructures for on-demand computing

The Grid Industry Day(http://indico.ct.infn.it/conferenceDisplay.py?confId=a066)

Budapest, Business Track at EGEE’07, 02.10.2007 27

Other Dissemination&Training eventsThe First International Grid School for Industrial Applications

Budapest, Business Track at EGEE’07, 02.10.2007 28

The PI2S2 Application Questionnaire(http://www.consorzio-cometa.it/questionario/quest.php)

http://www.pi2s2.it/tc/show_quest_2006.php

Industrial Partners willing to submit use cases are welcome!

Budapest, Business Track at EGEE’07, 02.10.2007 29

Summary and Conclusions

• Sicilian grid projects are the first ones in Italy at a true regional level.

• The PI2S2 Infrastructure is available for users (it will reach its nominal size by the end of year) and many services/developments target Industry involvment and uptake.

• We are open to collaborate with Industrial Partners and I hope that this Conference will be very useful in this respect.

Budapest, Business Track at EGEE’07, 02.10.2007 30

Any Questions ?

Thank you very much for your kind attention!