BalticGrid-II ProjectBalticGrid-II Project

The Second BalticGrid-II All-Hands Meeting, Riga, 12-14 May, 2009 1

Joint Research Activity

Enhanced Application Services on Sustainable e-Infrastructure

Joint Research Activity

Enhanced Application Services on Sustainable e-Infrastructure

Bartek PalakBartek Palakbartek@man.poznan.pl

Poznan Supercomputing and Networking CenterPoznan Supercomputing and Networking Center

The Second BalticGrid-II All-Hands Meeting, Riga, 12-14 May, 2009 2

OutlineOutline

ObjectivesObjectives

Partners & ProductsPartners & Products

Summary of work doneSummary of work done

Plans for the next periodPlans for the next period

ConclusionsConclusions

The Second BalticGrid-II All-Hands Meeting, Riga, 12-14 May, 2009

ObjectivesObjectives

Extending the e-Infrastructure with advanced services necessary Extending the e-Infrastructure with advanced services necessary from the user, application and administrator point of view - the from the user, application and administrator point of view - the GUI levelGUI level

Providing uProviding user-level support for Grid advanced data management ser-level support for Grid advanced data management

Adaptation of Adaptation of task flow task flow definition and management mechanisms definition and management mechanisms

Providing visualization tools for scientific computing in GridProviding visualization tools for scientific computing in Grid

Development of a user-friendly Development of a user-friendly group work group work environmentenvironment

Enhancements of existing services enabling user-friendly and Enhancements of existing services enabling user-friendly and intuitive access to Grid environment intuitive access to Grid environment

Support of the education process organised by NA2Support of the education process organised by NA2

The Second BalticGrid-II All-Hands Meeting, Riga, 12-14 May, 2009 4

Partners & ProductsPartners & Products

PartnersPartners Poznan Supercomputing and Networking Center (AL)Poznan Supercomputing and Networking Center (AL) Vilnius UniversityVilnius University Vilnius Gediminas Technical UniversityVilnius Gediminas Technical University

The three most important components:The three most important components: Migrating Desktop Platform developmentMigrating Desktop Platform development Visualisation of specific computing resultsVisualisation of specific computing results Development of Gridcom - a web-based innovative groupware for grid Development of Gridcom - a web-based innovative groupware for grid

technologytechnology

The Second BalticGrid-II All-Hands Meeting, Riga, 12-14 May, 2009 5

First prototype readyFirst prototype ready (MJRA 1.2) (MJRA 1.2)

Enhancement of BalticGridEnhancement of BalticGrid-I -I NA3 project components to be compatible NA3 project components to be compatible with Grid standards with Grid standards

Providing support for advanced data managementProviding support for advanced data management File manager (File manager (GridCommanderGridCommander))

as an independent network applicationas an independent network application Restructuring of The Migrating Desktop Restructuring of The Migrating Desktop Mechanism for easy integration of various file systemsMechanism for easy integration of various file systems Changes in implementation of existing file systemsChanges in implementation of existing file systems Support for Support for Grid Grid data access mechanismsdata access mechanisms

Gridcom groupware developmentGridcom groupware development The first deployable releaseThe first deployable release Gridcom recovering after system restartGridcom recovering after system restart AAdministrative commands dministrative commands for for system system configurationconfiguration Error handling improvementsError handling improvements Security enhancementsSecurity enhancements

Summary of work done - MJRA1.2 (1)Summary of work done - MJRA1.2 (1)

The Second BalticGrid-II All-Hands Meeting, Riga, 12-14 May, 2009 6

First prototype readyFirst prototype ready (MJRA 1.2) - continued (MJRA 1.2) - continuedDeployment of the software in BG-II testbed for visualizationDeployment of the software in BG-II testbed for visualization Considering outcome of performance analysis three different visualization tools have been Considering outcome of performance analysis three different visualization tools have been

deployed. All tools are based on deployed. All tools are based on VTK in order to minimize development efforts. Moreover, VTK in order to minimize development efforts. Moreover, architectures of the tools are fully compatible with architectures of the tools are fully compatible with gLite middleware.gLite middleware.– ParaView 3.4.0ParaView 3.4.0 isis an open-source software perfectly suitable for parallel visualization an open-source software perfectly suitable for parallel visualization

and parallel rendering of large datasets.and parallel rendering of large datasets. – Visualization e-serviceVisualization e-service VizLitGVizLitG isis designed for convenient access and visualization of designed for convenient access and visualization of

remote data files located in grid.remote data files located in grid. – VTK 5.2.1 applicationsVTK 5.2.1 applications interactively run on grid by means ofinteractively run on grid by means of GVidGVid software. BG-II software. BG-II

users can users can employ full power of huge toolkit functionality and flexible interactivityemploy full power of huge toolkit functionality and flexible interactivity.

Milestone Milestone reached on timereached on time (PM09) (PM09)

The The first first prototype details described in raport:prototype details described in raport: DJRA1.3 - DJRA1.3 - “Fi“Firrst prototypest prototype […]” […]” ((PM09PM09))

Summary of work done - MJRA1.2 (2)Summary of work done - MJRA1.2 (2)

The Second BalticGrid-II All-Hands Meeting, Riga, 12-14 May, 2009 7

Summary of work done - otherSummary of work done - other

AActivities not plannedctivities not planned::Demo “CoPS - The Complex Comparison of Protein Demo “CoPS - The Complex Comparison of Protein Structures supported by grid” Structures supported by grid” for for EGEE UF’09 EGEE UF’09 conference (Catania, 2009)conference (Catania, 2009)

‘‘The Migrating Desktop as a framework for grid The Migrating Desktop as a framework for grid applications” presented at applications” presented at EGEE UF’09 conference EGEE UF’09 conference (Catania, 2009)(Catania, 2009)

Preparation of JRA technical brochurePreparation of JRA technical brochure

The Second BalticGrid-II All-Hands Meeting, Riga, 12-14 May, 2009 8

Plans for the next period (1)Plans for the next period (1)

MJRA1.3 Second prototype ready (PM18)MJRA1.3 Second prototype ready (PM18)Support for advanced data management to the user Support for advanced data management to the user Enhancements of Enhancements of graphical file manager graphical file manager ((Grid CommanderGrid Commander)) NNew file system implementations ew file system implementations CCodes optimizodes optimizationation to increase stability and efficiency to increase stability and efficiency

AAdvanced job managementdvanced job management Possibility of submitting of set of jobs Possibility of submitting of set of jobs DDefinition and management of task flow efinition and management of task flow (a(adaptationdaptation))

Extension of MD functionality to follow requirements and Extension of MD functionality to follow requirements and recommendations coming frrecommendations coming froom other activities m other activities ((limited by limited by resources available within JRA)resources available within JRA)

Further development of Gridcom groupwareFurther development of Gridcom groupware Implementation of user management interfaceImplementation of user management interface Detailed tool documentationDetailed tool documentation

The Second BalticGrid-II All-Hands Meeting, Riga, 12-14 May, 2009 9

Plans for the next period (2)Plans for the next period (2)

MJRA1.3 Second prototype ready (PM18) – cont.MJRA1.3 Second prototype ready (PM18) – cont.Open-source package Open-source package ParaViewParaView:: Unstructured HDF5 file reader will be developed in order efficiently to process Unstructured HDF5 file reader will be developed in order efficiently to process

decomposed data files of pilot applications and to achieve high parallel speed-decomposed data files of pilot applications and to achieve high parallel speed-up.up.

Adaptation of visualization e-Service Adaptation of visualization e-Service VizLitG VizLitG to BG-II user needs:to BG-II user needs: Visualization of interactively selected parts of remote datasets residing on SE,Visualization of interactively selected parts of remote datasets residing on SE, Enhanced interactivity including VTK widgets.Enhanced interactivity including VTK widgets.

Visualization tool for particles Visualization tool for particles VisPartDEMVisPartDEM including advanced including advanced functionality:functionality: Parallel visualization of large particle systems employed for DEM Parallel visualization of large particle systems employed for DEM

computations,computations, Visualization of initial defects and propagating cracks,Visualization of initial defects and propagating cracks,

Release details will be described in:Release details will be described in: DJRA1.4 DJRA1.4 „Second prototype „Second prototype […]”[…]” (PM18) (PM18)

MJRA1.4 Final version of services (PM24)MJRA1.4 Final version of services (PM24)

The Second BalticGrid-II All-Hands Meeting, Riga, 12-14 May, 2009 10

ConclusionsConclusions

The works are The works are proceeding smoothlyproceeding smoothly as planned as planned GGood cooperationood cooperation withwithinin activity activity All All activityactivity objectives fullfilled on time objectives fullfilled on time The first twoThe first two milestones achieved on time milestones achieved on time The The deliverables deliverables completed on timecompleted on time

First prototype delivered (!)First prototype delivered (!) Services prepared and deployedServices prepared and deployed Prototype evaluated by SA3Prototype evaluated by SA3

Effective cooperationEffective cooperation with other project activities with other project activities NA2 – support for educational activitiesNA2 – support for educational activities NA2 – support for disseminative activitiesNA2 – support for disseminative activities NA3, SA3 – support for the usersNA3, SA3 – support for the users

No technical problemsNo technical problems that may affect objectives identified that may affect objectives identified so far (!) so far (!)Plans for next periodPlans for next period MJRA1.3 - Preparation of second prototype (PM18)MJRA1.3 - Preparation of second prototype (PM18) MJRA1.4 – Providing final version of services (PM24)MJRA1.4 – Providing final version of services (PM24)

The Second BalticGrid-II All-Hands Meeting, Riga, 12-14 May, 2009BalticGrid-II Kick-off Meeting, 13-15.05.2008, Vilnius 11

JRA Internal MeetingJRA Internal Meeting

All people invloved in JRA activity works are invited All people invloved in JRA activity works are invited to participate to:to participate to:

JRA Internal MeetingJRA Internal Meeting

13:30 – 14:00 (lunch break)13:30 – 14:00 (lunch break)