Open Grid Services Architecture: Framework for commercial ...

9
Open Grid Services Architecture: Open Grid Services Architecture: Framework for commercial grids Framework for commercial grids Jeff Nick, IBM Fellow Jeff Nick, IBM Fellow Director, Advanced Systems Architecture Director, Advanced Systems Architecture [email protected] [email protected] 6.17.02 6.17.02 Customers B2B Connections Branches PvC Extranet Internet intranet PvC Caching, Traffic Mgmt Caching, Traffic Mgmt Caching, Traffic Mgmt Tier-1 Servers Presentation Logic Tier-2 Servers Business Logic WAS CTS Tier-1 Clients Tier-3 Servers Data Logic Workflow Enterprise Datacenter Caching, Traffic Mgmt Enterprise e-Business transformation:Inside view De-composition of monolithic systems Re-integration of distributed compute resources 1-2 OGSA Japan.prz

Transcript of Open Grid Services Architecture: Framework for commercial ...

Page 1: Open Grid Services Architecture: Framework for commercial ...

Open Grid Services Architecture:Open Grid Services Architecture:

Framework for commercial gridsFramework for commercial grids

Jeff Nick, IBM FellowJeff Nick, IBM FellowDirector, Advanced Systems ArchitectureDirector, Advanced Systems [email protected]@us.ibm.com6.17.026.17.02

Customers

B2B Connections

Branches

PvC

Extranet

Internet

intranet

PvC

Caching,Traffic Mgmt

Caching,Traffic Mgmt

Caching,Traffic Mgmt

Tier-1 ServersPresentation Logic

Tier-2 ServersBusiness Logic

WASCTS

Tier-1 Clients

Tier-3 ServersData Logic

Workflow

Enterprise Datacenter

Caching,Traffic Mgmt

Enterprise e-Business transformation:Inside view

De-composition of monolithic systemsRe-integration of distributed compute resources

1-2 OGSA Japan.prz

Page 2: Open Grid Services Architecture: Framework for commercial ...

QoS delivered through Vertical IntegrationQoS delivered through Vertical Integration

Physical Resource ManagementConnectivity Management

SecurityAvailability and Serviceability Management

ApacheWeb

OLTPDB2

Domino Domino J2EE

Logical Process and Resource Management

Workload and Performance Management

Clustering Services

Systems Management and Automation

Database

Traditional System Model

hundreds of distributed servers... ...Islands of computing resource...End to End QoS is fractured

SAP on AIX

CICS/390

DB2 DatabaseServers

Web Application

ServersSun Solaris

Baan on HP/UX

Lotus Domino on NT Server

Physical Resource ManagementConnectivity Management

SecurityAvailability and Serviceability Management

ApacheWeb

OLTPDB2

Domino Domino J2EE

Logical Process and Resource Management

Workload and Performance Management

Clustering Services

Systems Management and Automation

Database

Physical Resource ManagementConnectivity Management

SecurityAvailability and Serviceability Management

ApacheWeb

OLTPDB2

Domino Domino J2EE

Logical Process and Resource Management

Workload and Performance Management

Clustering Services

Systems Management and Automation

Database

Physical Resource ManagementConnectivity Management

SecurityAvailability and Serviceability Management

ApacheWeb

OLTPDB2

Domino Domino J2EE

Logical Process and Resource Management

Workload and Performance Management

Clustering Services

Systems Management and Automation

Database

Physical Resource ManagementConnectivity Management

SecurityAvailability and Serviceability Management

ApacheWeb

OLTPDB2

Domino Domino J2EE

Logical Process and Resource Management

Workload and Performance Management

Clustering Services

Systems Management and Automation

Database

Physical Resource ManagementConnectivity Management

SecurityAvailability and Serviceability Management

ApacheWeb

OLTPDB2

Domino Domino J2EE

Logical Process and Resource Management

Workload and Performance Management

Clustering Services

Systems Management and Automation

Database

Physical Resource ManagementConnectivity Management

SecurityAvailability and Serviceability Management

ApacheWeb

OLTPDB2

Domino Domino J2EE

Logical Process and Resource Management

Workload and Performance Management

Clustering Services

Systems Management and Automation

Database

Physical Resource ManagementConnectivity Management

SecurityAvailability and Serviceability Management

ApacheWeb

OLTPDB2

Domino Domino J2EE

Logical Process and Resource Management

Workload and Performance Management

Clustering Services

Systems Management and Automation

DatabasePhysical Resource Management

Connectivity Management

SecurityAvailability and Serviceability Management

ApacheWeb

OLTPDB2

Domino Domino J2EE

Logical Process and Resource Management

Workload and Performance Management

Clustering Services

Systems Management and Automation

Database

Physical Resource ManagementConnectivity Management

SecurityAvailability and Serviceability Management

ApacheWeb

OLTPDB2

Domino Domino J2EE

Logical Process and Resource Management

Workload and Performance Management

Clustering Services

Systems Management and Automation

Database

Oracle DBServers

Web portal Edge Servers

Linux

Physical Resource ManagementConnectivity Management

SecurityAvailability and Serviceability Management

ApacheWeb

OLTPDB2

Domino Domino J2EE

Logical Process and Resource Management

Workload and Performance Management

Clustering Services

Systems Management and Automation

Database

BusinessIntelligenceon AIX

Enterprise Infrastructure Turmoil Enterprise Infrastructure Turmoil

3-4 OGSA Japan.prz

Page 3: Open Grid Services Architecture: Framework for commercial ...

Needed: cross-platform system Infrastructure

Horizontal QoS Integration across Distributed Systems

AIX OS390 OS400 Linux NT

Ho

st I

nteg

rati

on

Lay

er

Dis

trib

ute

d S

ervi

ces

Lay

er

Sys

tem

s M

anag

emen

t L

ayer

Automation

Availability and Serviceability Management Distributed Security/Directory

Logical Resource Management Clustering Services

Connectivity ManagementPhysical Resource Management

Workload and Performance Management

Database / Content Mgmt / Data Distribution

Systems Management

OS400 Solaris

Distributed Resource Management across heterogeneous platforms Seamless QoS deliveryCommon Base for Autonomic Management SolutionsCommon infrastructure building blocks to avoid "stovepipe solution towers"Open and Published InterfacesIndustry-standard integration technologies

web services, soap, xml...

Seamless integration with existing IT resources

Open Grid Services Architecture Open Grid Services Architecture ObjectivesObjectives

5-6 OGSA Japan.prz

Page 4: Open Grid Services Architecture: Framework for commercial ...

OGSA infrastructure focus areasOGSA infrastructure focus areas

NT Linux AIX OS/400 Solaris zOS

ApplicationsResource discovery and management Common Resource instrumentationProfile based policies Metadata mapping on repositoriesAuthenticationAccess ControlCredentials DelegationContexts and context propogationPerformance Management Event notificationCluster ServicesLogging, Trace, Debug

OGSA infrastructure

Autonomic Management Solutions

Services model Services model

Interface

Bindings

Service implementationExecution Container

Separate interface from access and implementation

Adaptation layer

Native platform function

Local/Remote Transparency

WSDL

7-8 OGSA Japan.prz

Page 5: Open Grid Services Architecture: Framework for commercial ...

OGSA Service ModelOGSA Service ModelWeb services are not OGSA services!All OGSA services adhere to specified service interfaces and behaviors (some required and some optional)

Factory, registry, discovery, lifecycle, query service data, notification, reliable invocation

A robust abstract services component model, where resources are rendered as services and are composableReliable and secure preservation of distributed stateSupports dynamic late-binding and creation of distributed resource groups

Grid computing links servers, clients and storage from across the Internet to form virtual server and storage pools which may be dynamically allocated.

Today's Grid software is focused on physical hardware allocation for high performance computing and collaboration, but will evolve to support an e-utility environment for most workload types.

The potential is to extend Grid middleware to seamlessly integrate distributed compute resources with existing IT infrastructures for Commercial Grids.

Grid Middleware

Virtual Clusters, Storage and Resources

Distributed Physical

Clusters and Storage

Grid computing initatives will drive standards and software which will enable robust resource sharing and collaboration over the Internet.

The GridThe Grid

9-10 OGSA Japan.prz

Page 6: Open Grid Services Architecture: Framework for commercial ...

A Common Problem: A Common Problem: Distributed ComputingDistributed ComputingWeb services, eLiza and Grid efforts try to solve similar problems in different realms:

Defining an open distributed computing platform.Assuring interoperability.Dealing with heterogeneous platforms, protocols and applications.

GRID is currently focused on Scientific &Technical Computing across organizational boundaries

Distributed Resource Sharing is the key

Web Services initial focus on application integration eLiza focused on commercial IT system infrastructures:

Here, sharing resources is not the issue: Managing them is!Sharing function is not the issue: Building solutions on top is!

Commercial Grids via OGSACommercial Grids via OGSA

Enterprise A

Enterprise B

Native Platform Resource Management Integration

Common Resource Management Services Local/Remote Transparency

GoldGrid

BrownGrid Red

Grid

"Differences are fundamentally ones of organizational "Differences are fundamentally ones of organizational configuration, isolation and policy control, not configuration, isolation and policy control, not architectural"architectural"

11-12 OGSA Japan.prz

Page 7: Open Grid Services Architecture: Framework for commercial ...

Grid EvolutionGrid Evolution

Service Grid: supported by xSPs

Partner Grid: across multiple organizations

Scope of Sharing

Enterprise Grid: internal integration

TI, Toshiba, GM, Monsanto, � c

GM, DoD HPC, NASA IPG, UK Grid, � c

Grid: Transparent, secure and coordinated computing resource sharing across sites - a "cluster of clusters"

Adoption over time

S&TC Grid

OGSA Common QoS FunctionsOGSA Common QoS Functions

Interface

BindingsBindings

Implementation

Database Abstraction ServicesDistributed Cluster Services

Domain Management Services

Distributed Log Services

Distributed Trace Services

Distributed Security Services

Policy and Repository Services

...

Resource Instrumentation Services

13-14 OGSA Japan.prz

Page 8: Open Grid Services Architecture: Framework for commercial ...

zSeries pSeries iSeries z,p,i,xSeries xSeries

WebServices run-time

Open Grid Services ArchitectureOpen Grid Services Architecture

New classes of applications enabled Common GUI

IBM Platforms QoS Enablers/Optimizers

S&TC eCommerce xSP etc...

eServer Foundation

eLiza Autonomic Functions & Management MiddlewareeLiza Autonomic Functions & Management Middleware

End-Users and Admin Staff End-Users and Admin Staff

Storagez/OS WindowsLinuxAIX OS/400

http://www.globus.org/research/papers/ogsa.pdf

Architecture Framework

Solaris&

HP/UX

LinuxWindows

Sun & HP

DellCompaq

...

CiscoNortel

...

Network Storage

Veritas...

OSA

Globus/IBM Platform/AvakiEntropia/Microsoft/Universities/Research/...

OGSA Market Presence- Ad Hoc Standard- GGF open standard

IETF ...... W3C ...WS-I... GGF....

...Accelerate delivery through partners

Work with standards bodies todefine the distributed services needed...

Path to Open CollaborationPath to Open Collaboration

15-16 OGSA Japan.prz

Page 9: Open Grid Services Architecture: Framework for commercial ...

Abstract resource models,dynamic discovery and access

Security and Policy

RAS , Failover, Data Replication

Robust runtime environmentManagement of Iifecycle and distributed

state

VALUE-ADD

what one needs to build

what one wants to build

OGSA value propositionOGSA value proposition

Grid Computing and OGSAGrid Computing and OGSAStorageStorage ApplicationsApplications

ProcessingProcessing Operating SystemOperating System

One virtual, distributed computing platform,One virtual, distributed computing platform,'limitless' global resources'limitless' global resources

DataData

I/OI/O

17-18 OGSA Japan.prz