UK Role in Open Grid Services ArchitectureTowards an Architectural Road Map

Malcolm AtkinsonDirector of NeSC

18th April 2002

Outline

Background — What is OGSA?The Confluence of Web Services & Grid

Presented already by Ian Foster

The UK Architectural Task Force

Why Engage with OGSA

What should the UK do

Web Services Grid Technology

Grid Services

UK ATF

Malcolm Atkinson Jon Crowcroft

David De Roure Vijay Dialani

Andrew Herbert Ian Leslie

Ken Moody Steven Newhouse

Tony Storey

…………… Plus consultations

UK Role in Open Grid Services Architecture, Version 0.6 11th March 2002

www.nesc.ac.uk

teams

ATF

Why Change?

Fire fighting safetyEruption, Flood & Pollution ResponseDiagnosis & Treatment PlanningWhole population health monitoringEpidemic Detection & ManagementUnderstanding Cells & OrgansIn Flight problem managementOceans, Climate, Ecosystems, …

Ambition Data ChallengeDeluge of Data

•More, Faster Digital Streams

•Heterogeneous evolving models

•Uncertainty about data quality

Finding the Nuggets

Reason to Trust the Answer

Software ChallengeComposing Software

•Encapsulating understanding•Multiple technologies•Heterogeneous evolving models •Uncertainty about component quality

Solving a ProblemReason to Trust the AnswerAn Answer in Time

Dependability ChallengeGeographic Distribution

•scientists, resources & instruments•Diverse: Organisations & Countries•Mobile: equipment, people & phenomena•Uncertainty about communication quality

Sustaining the Computation•Problem Detection & Recovery, Security, …

Reason to Trust System DependabilityAffordable

Do it often

Run it for everyone

Do it for everything

Do it quickly

Keep it runningPay for it

Change it often

Why Change?

Fire fighting safetyEruption, Flood & Pollution ResponseDiagnosis & Treatment PlanningWhole population health monitoringEpidemic Detection & ManagementUnderstanding Cells & OrgansIn Flight problem managementOceans, Climate, Ecosystems, …

Ambition Data ChallengeDeluge of Data

•More, Faster Digital Streams

•Heterogeneous evolving models

•Uncertainty about data quality

Finding the Nuggets

Reason to Trust the Answer

Software ChallengeComposing Software

•Encapsulating understanding•Multiple technologies•Heterogeneous evolving models •Uncertainty about component quality

Solving a ProblemReason to Trust the AnswerAn Answer in Time

Dependability ChallengeGeographic Distribution

•scientists, resources & instruments•Diverse: Organisations & Countries•Mobile: equipment, people & phenomena•Uncertainty about communication quality

Sustaining the Computation•Problem Detection & Recovery, Security, …

Reason to Trust System DependabilityAffordable

Best of Both WorldsDescription Driven Dynamic Integration (WS)Automated Generation of Code (WS)Security (Grid & WS)Resource Discovery (WS & Grid)High-level Platform (WS & Grid)Tools (WS)Distribution & Heterogeneity (WS & Grid)…

Why Change?

Fire fighting safetyEruption, Flood & Pollution ResponseDiagnosis & Treatment PlanningWhole population health monitoringEpidemic Detection & ManagementUnderstanding Cells & OrgansIn Flight problem managementOceans, Climate, Ecosystems, …

Ambition Data ChallengeDeluge of Data

•More, Faster Digital Streams

•Heterogeneous evolving models

•Uncertainty about data quality

Finding the Nuggets

Reason to Trust the Answer

Software ChallengeComposing Software

•Encapsulating understanding•Multiple technologies•Heterogeneous evolving models •Uncertainty about component quality

Solving a ProblemReason to Trust the AnswerAn Answer in Time

Dependability ChallengeGeographic Distribution

•scientists, resources & instruments•Diverse: Organisations & Countries•Mobile: equipment, people & phenomena•Uncertainty about communication quality

Sustaining the Computation•Problem Detection & Recovery, Security, …

Reason to Trust System DependabilityAffordable

Dominant Data: Common NeedsMetadata & DiscoveryGrid Data Management (Giggle)Grid FTPDatabases & Transactions (WS)Distributed Data MiningInformation ManagementKnowledge Management

Why Change?

Fire fighting safetyEruption, Flood & Pollution ResponseDiagnosis & Treatment PlanningWhole population health monitoringEpidemic Detection & ManagementUnderstanding Cells & OrgansIn Flight problem managementOceans, Climate, Ecosystems, …

Ambition Data ChallengeDeluge of Data

•More, Faster Digital Streams

•Heterogeneous evolving models

•Uncertainty about data quality

Finding the Nuggets

Reason to Trust the Answer

Software ChallengeComposing Software

•Encapsulating understanding•Multiple technologies•Heterogeneous evolving models •Uncertainty about component quality

Solving a ProblemReason to Trust the AnswerAn Answer in Time

Dependability ChallengeGeographic Distribution

•scientists, resources & instruments•Diverse: Organisations & Countries•Mobile: equipment, people & phenomena•Uncertainty about communication quality

Sustaining the Computation•Problem Detection & Recovery, Security, …

Reason to Trust System DependabilityAffordable

Common Issues

New OpportunityGrid Protocols & ServicesSOAP multiple mappingsGrid Monitoring & ManagementSecurity (WS & Grid)…

UK Focus: Data Knowledge

The Picture from Space

Phase 1: Foundations & PlanningGGF Collaboration on OGSA Design & PrototypingRequirements, Education & Consultation Common InfrastructureBaseline DB Access & IntegrationValidation & TestingBaseline Logging Infrastructure

Phase 2: Automation & InformationRefining & Exploiting Description LanguagesData Information Semantic GridAdvanced DB IntegrationScheduling for Data Intensive ComputationComputational Grid Economies

Trustable ServicesPerformance EngineeringDependable EngineeringDesign for TestabilityEngineering for ChangeManagement & Ops SupportPrivacy, Ethics & Legal

Project Transitions

Now Q2 Q3 Q4 Q1 Q2 Q3 Q42002 2003

GT3

GT2Demo at GGFSpecification & Motivation

EarlyAdopters

Testers

Building OGSA Capability

Now Q2 Q3 Q4 Q1 Q2 Q3 Q42002 2003

Demo at GGFSpecification & Motivation

GT3

GT2

EarlyAdopters

Testers

www.epcc.ed.ac.uk~neilc/gsiws/

GSI + WS

Alpha GT3 Beta GT3 Production GT3

Requirements & Consultation

Architecture Road Map & Advisory Documents

Early DB Integrationcomponents

Review

New Core M/W Projects

Advanced Integration Components

Semantic GridComponents

Grid economy infrastructure

The First Steps

Best available platform from industry & Globus

Demo., Design & Review

Beta release to selected projects

Logging & Monitoring

Semantics of WS Description Languages

Advanced Information Handling

Pilot Project & Community Consultation

Web Services & GSI & Axis Trials of Web Services & GSI & Axis

Infrastructure: GS APIs, Types & Primitives

Grid DB Access Services

Requirements & Standards

Trials: Grid DB Access Services

www.epcc.ed.ac.uk~neilc/gsiws/

What does it mean?

More DescriptionWhat it doesHow it deliversSecurityCoordination…

More SupportLate dynamic bindingContext adaptationTools & AutomationVisualisationsAutonomic infrastructure…

Increased Flexibility

Industrial ForcesSupported technologyPolitical forceImmovable force?Standards…

Extensive FamiliesType systems & SchemaComposable ServicesStandards requirement…

ChangesThe way we shareThe way we think

Higher-level Discourse

?