Future UK e-Science Grid Middleware

Dr Steven Newhouse

London e-Science Centre

Department of Computing, Imperial College London

2

Contents

• Grid Middleware

• UK e-Science Core Programme I & II

• LeSC Activities

3

Status of the Grid

• Today: ‘early adoption’ phase - just like the Web in the early days

• Tomorrow: sophisticated combinations of services to locate information, applications to process it, and computer systems to run them

• Requirements: Infrastructure to support:– e-Science– Virtual Organisations– e-Commerce– e-Utilities

4

Exposing Resources as Services

Permissible SLA

COMPUTERESOURCES

SERVICE LEVEL AGREEMENT

B A

C

D

Defines:• What?• Who?• When?

SOFTWARERESOURCES

STORAGERESOURCES

5

Open Grid Services Architecture

• OGSA addresses architectural issues related to broadly interoperable Grid Services.

• OGSI based on the GSS provides mandatory features, such as service invocation, lifetime management, a service data interface, and security interfaces.

• GT3 implementation of OGSI & equivalent GT2 services

GT3GT3

JiniJini JxtaJxta

GT2GT2

OGSI

6

UK e-Science Core Programme

• From Tony Hey’s slides at EPSRC Pilot Project meeting (end of Jan 03)

• CP I: e-Science Centres & open calls

• CP II: Plans not promises as

dependent on funding– SR2002: £16M– DTI: £??M

Cambridge

Newcastle

Edinburgh

Oxford

Glasgow

Manchester

Cardiff

SouthamptonLondon

BelfastDL

RAL Hinxton

7

Core Programme 2: Overall Rationale

• Assist development of essential, well-engineered, generic, Grid middleware usable by both e-scientists and industry

• Provide necessary infrastructure support for UK e-Science Research Council projects

• Collaborate with the international e-Science and Grid communities

• Work with UK industry to develop industrial-strength Grid middleware

8

Key Activities

• UK e-Science Grid/Centres and e-Science Institute

• Grid Support Centre and Network Monitoring

• Core Middleware engineering

• National Data Curation Centre

• e-Science Exemplars/New Opportunities

• Outreach and International involvement

9

The e-Science Grid/Centres and the e-Science Institute

• Continuation of e-Science Centre’s & Institute– 2 year extension for infrastructure after review– Further development of UK e-Science Grid

• Collaborative Industrial Projects– Call for DTI collaborative industrial projects

targeted to key middleware areas

• Grid Support Centre & Network Monitoring

10

Core Grid Middleware Activity

• Need to develop open source, open standard compliant, Grid Middleware stack that will integrate and federate with industrial solutions

• Software Engineering focus as well as R&D– Aim is to produce robust, well-documented, re-usable

software that is maintainable and can evolve to embrace emerging Grid Service standards

• Link UK activities with Europe & US– Reduce duplication of effort

– Standards development & compliance testing

11

Possible Core Grid Middleware Themes

• Heterogeneous Database Integration• Security• Legal and regulatory• Accounting Systems for VOs• Collaborative Decision-making Networks• Enterprise Computing Systems• Outsourcing/e-Utilities• Real-time High End Computing• Enterprise Application Integration• Business Processes for VOs

Links to EPSRC CS Research?• Autonomic Computing• Semantic Grid• Rapid Customised Assembly of

Services• Trusted Ubiquitous Systems• ….

12

ICENI

The Iceni, under Queen Boudicca, united the tribes of South-East England in a revolt against the occupying Roman forces in AD60.

• IC e-Science Networked Infrastructure• Developed by LeSC Grid Middleware Group• Collect and provide relevant Grid meta-data• Use to define and develop higher-level services• Interaction with other frameworks: Web Services, Jxta etc.

13

ICENI Architecture

Resource Manager

Policy Manager

CR

SR

Identity Manager

Domain Manager

CR

SR

Gateway between private and public regions Public

Public Computational Community

SR CR

Public Computational Community

SR

Private

Administrative

Domain

SR

CR

Resource Broker

Application Design Tools

Component Design Tools

Application Mapper

Web ServicesGateway

Application

Portal

Private

Computational Resource

SoftwareResources

NetworkResources

StorageResources

JavaCoG

Globus

Resource Browser

RESOURCES POLICY

SERVICES USERS

14

Service Oriented Architecture

• ICENI interfaces for services & discovery– Platform neutral interfaces

• Resource: Abstraction for a capability• Policy: How & where the resource is exposed• Service: Route for user interaction with a resource

Jini Jxta OGSAOGSA

ICENI Services

Users & Clients

PolicyIntegration &InteroperabilityLayer Portal

15

User Interaction

• API to discover & interact with services

• Exploit Netbeans Application Framework

16

Grid Economic Services Architecture(GGF-WG)

OGSA Grid ServiceService InterfaceService Data

Service InterfaceService Data

OGSA ChargeableGrid

Service

Grid EconomicService Interface

RecordResource

Usage

OGSAResource

UsageService

ContractNegotiation

EconomicService

Data

ContractVerification

ServiceCharging

OGSA GridBankingService

GridUser/Actor

17

How it might work…

User

ContainerFactory

ContainerFactory

Request a price for users (…)to run jobs over 16 processorsfor the next 2 hours usingauctioning.

30s lifetimeto completeauction

Request use of software libraryFor the next 2 hours. AcceptFlat rate fee of £2/hour.

18

What’s next?

• Ontologies– For Scientific Software

– For ICENI Services

– For resources

• Fuzzy Service Matching• Malleable & Ductile Scientific Components• Hard deadline scheduling for network & calculation• Computational Markets

19

Acknowledgements

• Director: Professor John Darlington• Technical Director: Dr Steven Newhouse• Research Staff:

– Anthony Mayer, Nathalie Furmento– Stephen McGough, James Stanton– Yong Xie, William Lee– Marko Krznaric, Murtaza Gulamali– Asif Saleem, Laurie Young, Gary Kong

• Support Staff:– Keith Sephton, Oliver Jevons, Sue Brookes

• Contact:– http://www.lesc.ic.ac.uk/– e-mail: lesc@ic.ac.uk