Developing a ROOT Interface for gLiteDeveloping a ROOT Interface for gLiteAnar Manafov, Kilian Schwarz (GSI, Germany)Anar Manafov, Kilian Schwarz (GSI, Germany)

Since September 2005, five Community projects and the D-Grid Integration project (DGI) started within the D-Grid Consortium to build a sustainable Grid Since September 2005, five Community projects and the D-Grid Integration project (DGI) started within the D-Grid Consortium to build a sustainable Grid infrastructure in Germany. This will help to establish methods of e-science in the German scientific community. infrastructure in Germany. This will help to establish methods of e-science in the German scientific community.

To achieve our aim we need toTo achieve our aim we need to• get access to a gLite testbed or install it ourselves;get access to a gLite testbed or install it ourselves;• investigate available gLite API and tools;investigate available gLite API and tools;• implement TGridXXXX ROOT interfaces for gLite;implement TGridXXXX ROOT interfaces for gLite;• try to reproduce “ALICE-like” analysis using our new basis;try to reproduce “ALICE-like” analysis using our new basis;• learn and understand the tools;learn and understand the tools;• investigate possible gaps in TGrid and in gLite.investigate possible gaps in TGrid and in gLite.

Comments on the project timelineComments on the project timeline• Significant time of the project was spent on installation and Significant time of the project was spent on installation and configuration of gLite (R1.4 and R1.5) testbed.configuration of gLite (R1.4 and R1.5) testbed.• gLite API has very good documentation and tests, which gLite API has very good documentation and tests, which are very handy for our development.are very handy for our development.• It is very helpful for our project to have TAlienXXXX It is very helpful for our project to have TAlienXXXX implementation. It is the very first implementation of implementation. It is the very first implementation of TGridXXXX interfaces.TGridXXXX interfaces.• A first alpha release of TGliteXXXX implementation is A first alpha release of TGliteXXXX implementation is expected in the end of February 2006.expected in the end of February 2006.

Grid Access using ROOT facilityGrid Access using ROOT facility

UI to GridUI to GridService + FilesService + Files

Abstract Base Abstract Base ClassesClasses

Grid Plug-in Grid Plug-in ClassesClasses

TGrid TAlienTGrid::Connect(“alien://...)Alien API Service

TGrid TGLiteTGrid::Connect(“glite://...) gLite C++ API

TGrid TGlobus4TGrid::Connect(“globus4...) Globus4 API

Could be implement in the

future?

TGridAbstract base class defining interface to common Grid services.

TGridResultAbstract base class defining interface to a Grid result. Objects of this class are created by TGrid methods.

TGridJobPure Abstract class. Abstract base class defining interface to a Grid job.

TGridJDLPure Abstract class. To generate JDL files for job submission to the Grid.

TGridJobStatusPure Abstract class. Abstract base class containing the status of a Grid job.

TGridCollectionClass which manages collection files on the Grid.

Set of ROOT Interfaces to the GridSet of ROOT Interfaces to the Grid

TAlienXXXXTAlienXXXX TGLiteXXXXTGLiteXXXX

“ “realized”realized”• TAlienTAlien – Based on AliEn middleware; initially developed and used by the ALICE collaboration. – Based on AliEn middleware; initially developed and used by the ALICE collaboration.• TGliteTGlite – Based on gLite middleware. In terms of the EGEE project it can be used by HEP (4 LHC – Based on gLite middleware. In terms of the EGEE project it can be used by HEP (4 LHC experiments) + Biomedical + other VOs.experiments) + Biomedical + other VOs.

www.gsi.de www.bmbf.de public.eu-egee.orgroot.cern.chaliceinfo.cern.chwww.d-grid.de

gLite WMProxy C++ APIgLite WMProxy C++ API• Parametric JobsParametric Jobs• Bulk submission/Job CollectionsBulk submission/Job Collections• Shared sandboxShared sandbox• Shared requirements Shared requirements • “ “non-local” Input Sandboxes non-local” Input Sandboxes • Automatic upload of Output Sandboxes Automatic upload of Output Sandboxes • FQAN based authZ/mapping FQAN based authZ/mapping • JDL extensions JDL extensions • Partitioning on dataPartitioning on data

ROOT FacilityROOT Facility

TGLiteXXXXTGLiteXXXX

gLite User InterfacegLite User Interface

gLite APIgLite APIgLite WMS & LBgLite WMS & LB

TGLiteXXXX Schema TGLiteXXXX Schema

WMProxy C++ APIWMProxy C++ API RGMA C++ APIRGMA C++ API

As a WM API we find the gLite WMProxy C++ API best choice, because it has As a WM API we find the gLite WMProxy C++ API best choice, because it has several advantages in comparing to the old WM UI APIseveral advantages in comparing to the old WM UI API

User InterfaceUser Interface• ALICE users access any Grid ALICE users access any Grid Infrastructure via AliEn or Infrastructure via AliEn or ROOT/PROOF UI.ROOT/PROOF UI.

ALICE Analysis Basic ConceptsALICE Analysis Basic ConceptsAliEnAliEn

• Native and “Grid on a Grid” (LCG/EGEE, ARC, Native and “Grid on a Grid” (LCG/EGEE, ARC, OSG);OSG);• integrate as much as possible common integrate as much as possible common componentscomponents

• LFC, FTS, WMS, MonALISA ...LFC, FTS, WMS, MonALISA ...

Analysis ModelsAnalysis Models• Prompt analysis at T0 using PROOF (+file Prompt analysis at T0 using PROOF (+file catalogue) infrastructure;catalogue) infrastructure;• batch Analysis using Grid infrastructure;batch Analysis using Grid infrastructure;• interactive Analysis using PROOF (+Grid) interactive Analysis using PROOF (+Grid) infrastructure.infrastructure.

PROOF/ROOTPROOF/ROOT• Single-/Multi- tier static and dynamic PROOF Single-/Multi- tier static and dynamic PROOF cluster;cluster;• Grid API class TGrid (virtual) ---> TAliEn Grid API class TGrid (virtual) ---> TAliEn (implementation).(implementation).

PROOF Session DiagramPROOF Session Diagram

Client Grid query

ClientClient MasterMaster GridGrid

Grid UI

PROOF steering reserves PROOF slaves with Grid query dataset

PROOF steering populates Grid or batch queue with new slaves or discovers static slavesClient sends

analysis request to PROOF Steering

Client Grid queryPhase I:Phase I:Grid MWGrid MWdependentdependent

Private PROOF master sends session timeout to client

Private PROOF master connects to remote slaves via 'localhost' proxies

Client terminates

Client runs analysis on Grid query dataset

Client connects to private PROOF master

Remote Slaves

Phase II:Phase II:Grid MWGrid MWindependentindependent

*) Based on presentation of Fons Rademakers, “PROOF with AliEn and GLite”, GridKA School 2004.

• Most of the PROOF components are MW Most of the PROOF components are MW independent.independent.

• To use PROOF on Grid we have to take To use PROOF on Grid we have to take care of the part which is MW dependent.care of the part which is MW dependent.

• For a user MW dependent components For a user MW dependent components are hidden behind TGridXXXX interfaces.are hidden behind TGridXXXX interfaces.

• Our goal is to implement TGridXXXX for Our goal is to implement TGridXXXX for gLite and for other MW.gLite and for other MW.

• Combined with Grid middleware PROOF Combined with Grid middleware PROOF becomes a powerful environment for becomes a powerful environment for “interactive” parallel analysis of globally “interactive” parallel analysis of globally distributed data.distributed data.

The main aimThe main aim of this study is to investigate whether we can use “ALICE–like” interactive analysis in of this study is to investigate whether we can use “ALICE–like” interactive analysis in the Grid environment without requiring AliEn everywhere. As a good basis we took gLite the Grid environment without requiring AliEn everywhere. As a good basis we took gLite middleware, since it is going to be general middleware for LHC experiments in near future (in terms middleware, since it is going to be general middleware for LHC experiments in near future (in terms of EGEE project). In the same time we try to proof that the same can be done with other types of of EGEE project). In the same time we try to proof that the same can be done with other types of Grid middleware like Globus4, for instance.Grid middleware like Globus4, for instance.

Contact: A.Manafov@gsi.de (Anar Manafov)

TGrid example with AliEn/gLiteTGrid example with AliEn/gLite// ConnectTGrid grid = TGrid::Connect(“alien://”); // Connect(“glite…”

// QueryTGridResult *res = grid.Query(“/home/test_user/analysis/”, ”*.root“);// List of filesTList *listf = res->GetFileInfoList();// Create chainTChain chain(“Events", “session");Chain.AddFileInfoList(listf);// Start PROOFTProof proof(“remote”);// Process your queryChain.Process(“selector.C”);

2005-11-01 2006-05-01

Project timeline snapshot

2006-01-01 - 2006-02-05gLite testbed

2005-11-19 - 2006-01-01Investigating gLite API

2005-11-01 - 2005-11-17gLite testbed

2005-11-07RGLite Kick-off meeting

2006-01-23Tests of gLite API R1.5

2005-11-01 - 2006-02-02gLite testbed installation and configuration (gLite R1.4 and R1.5)

2006-02-06 - 2006-03-26Developing TGLiteXXXX

2006-02-27The First prototype

of TGLiteXXXX

2006-03-25 - 2006-04-17Investigate gaps