Software Infrastructure of China National Grid Li Zha, Wei Li, Haiyan Yu, Zhiwei Xu Institute of...

15
Software Infrastructure of China National Grid Li Zha, Wei Li, Haiyan Yu, Zhiwei Xu Institute of Computing Technology, Chinese Academ y of Sciences Xianghui Xie, Jiangnan Institute of Computing Nong Xiao, National University of Defense Technol ogy www.cngrid.org UK eScience AHM, China Work shop

Transcript of Software Infrastructure of China National Grid Li Zha, Wei Li, Haiyan Yu, Zhiwei Xu Institute of...

Page 1: Software Infrastructure of China National Grid Li Zha, Wei Li, Haiyan Yu, Zhiwei Xu Institute of Computing Technology, Chinese Academy of Sciences Xianghui.

Software Infrastructureof China National Grid

Li Zha, Wei Li, Haiyan Yu, Zhiwei XuInstitute of Computing Technology, Chinese Academy of Sciences

Xianghui Xie, Jiangnan Institute of ComputingNong Xiao, National University of Defense Technology

www.cngrid.org

UK eScience AHM, China Workshop

Page 2: Software Infrastructure of China National Grid Li Zha, Wei Li, Haiyan Yu, Zhiwei Xu Institute of Computing Technology, Chinese Academy of Sciences Xianghui.

CNGrid Software

Distributed Resources and Services

App Scope of CNGrid Software

ScienceResearch

Manufacturing Resources and Environment

Services Sector

CS Research

Page 3: Software Infrastructure of China National Grid Li Zha, Wei Li, Haiyan Yu, Zhiwei Xu Institute of Computing Technology, Chinese Academy of Sciences Xianghui.

Design Issues

• Design FOR grid applications Efficiency Ease of use

• Add/delete/modify resources• Add/delete/modify contexts and policies• Develop applications• Use applications (e.g., single system image, seamlessness)

• Utilize (not replicate) the work by the grid community• Key issues

Virtualization EVP model VO Agora Runtime support Grip Programming GSML

Page 4: Software Infrastructure of China National Grid Li Zha, Wei Li, Haiyan Yu, Zhiwei Xu Institute of Computing Technology, Chinese Academy of Sciences Xianghui.

Vega Grid Layers

GR

Custom ClientClient

Grid

Internet

GSML PageWeb Portal

Grip1 Grip2 Grip3 Grip4

Grid Operating System( GOS)

Beijing Node

GSGR

Shanghai Node

GSGR

Xi’an Node

GS

Server PhysicalResource

GR Grid Router GS Grid Switch

Agora 1 Agora 2

MapperComposer

Composing Mapping

OGSA

HPC andServers

EffectiveResource

VirtualResource

Page 5: Software Infrastructure of China National Grid Li Zha, Wei Li, Haiyan Yu, Zhiwei Xu Institute of Computing Technology, Chinese Academy of Sciences Xianghui.

CNGrid Software V2.0

CNGrid Hosting Env.

CoreLevel

Services

Grip Container

Grip Container Service

Servlet Based Scalable Grid Portal Engine

Grid Apps

Core Libs Core Service APIs, Core Exception Handling, Authentication and Authorization

Java J2SE, J2EE

Tomcat(Apache)

WebSphere(IBM)

WebLogic(BEA) .NET

(Microsoft)

GT4(Globus)

System and Application Service APIs, System Exception Handling, AC Handling

Batch Service Workflow Service etc.

User Libs

SystemLevel

Services

App Level Services

Build-in Utility Collection Extended UtilitiesGrid Portal

Application Logic by Web Pages

BioInfo Service

OMII(e-Science)

User CustomizedApplications

GSMLBrowser

/Composer

ExtendedSystem Services

Information(MetaX) Services

MetaDBService

MetaSysService

MetaFile Service

etc.

CA&Certificates

Mgmt. Service

Base Services

Dymaic Deploy Service

SystemMonitoring

Service

Logging& Auditing Service

File ServiceDatabase Service

Messaging Service

Router ServiceService Router

Agora Service Set

Agora Authorization Authority Service

Agora Service

Agora User Mgmt. Service

Agora Resource Mgmt. Service

App

lica

tion

L

ayer

Sys

tem

Lay

erC

ore

Lay

er

Page 6: Software Infrastructure of China National Grid Li Zha, Wei Li, Haiyan Yu, Zhiwei Xu Institute of Computing Technology, Chinese Academy of Sciences Xianghui.

Virtualization: The EVP Model

Agora1 Agora2

...

AgoraL

...V1,2,3

Service Container1 Service Container2 Service ContainerN

...

EffectiveAddress Space

Virtual Address Space

Phsical Address Space

Vm-2,m-1,m

E1 E2,3

P1, 2, 3 P4, 5, 6 Pn-1, n

El-2,l-1,l

Router1 RouterM

Service address naming schemes in CNGrid software 2.0 are as follow:Physical: http://host_name_or_ip:port_number/suffixVirtual: vres://router_id:service_idEffective: eres://agora_name:effective_service_name

Page 7: Software Infrastructure of China National Grid Li Zha, Wei Li, Haiyan Yu, Zhiwei Xu Institute of Computing Technology, Chinese Academy of Sciences Xianghui.

Grip:the mainruntime

constructand its

fiveinterface

calls

Authenticationcreate create

close close

Grip Service Agora Service System or Application Level Services

GOS APIs(Client Side)

RouterService

① Subject Authentication Permission Authentication AC Handling

User Profile, Proxy

bindEffective Addr

Virtual Addr, Token

bind

gripHandle

invokeVirtual Addr

Physical Addr

invoke

Operation name, ParametersProxy, Token

Result

rIndex

Result Cachingcrtl

cachedResult

result

succ

ServiceLocating

crtl(getResult)

Page 8: Software Infrastructure of China National Grid Li Zha, Wei Li, Haiyan Yu, Zhiwei Xu Institute of Computing Technology, Chinese Academy of Sciences Xianghui.

Security via Agora

Browser uCert

Grid Portal Engine

use uid/pass load proxy cert into grip

Grip Container Service

Agora Service

u_pu_pu_p

PhysicalService

u_puTK

u_puTK

u_puTK

u_puTK

UserMgmt.

Service

ResourceMgmt.

ServiceAA

Service

uTK

Grid ApplicationuCert

uCert

user cert

u_pproxy certuTK

PhysicalService

PhysicalService

PhysicalService

Grid Portal

CAu_p

upload the proxy cert to Agora

u_p

authorization token

Page 10: Software Infrastructure of China National Grid Li Zha, Wei Li, Haiyan Yu, Zhiwei Xu Institute of Computing Technology, Chinese Academy of Sciences Xianghui.

Application Services in CNGrid

Page 11: Software Infrastructure of China National Grid Li Zha, Wei Li, Haiyan Yu, Zhiwei Xu Institute of Computing Technology, Chinese Academy of Sciences Xianghui.

Example: Blast

Page 12: Software Infrastructure of China National Grid Li Zha, Wei Li, Haiyan Yu, Zhiwei Xu Institute of Computing Technology, Chinese Academy of Sciences Xianghui.

Example: FLD3D

Page 13: Software Infrastructure of China National Grid Li Zha, Wei Li, Haiyan Yu, Zhiwei Xu Institute of Computing Technology, Chinese Academy of Sciences Xianghui.

Coordination of Genome Sequencing Projects

Page 14: Software Infrastructure of China National Grid Li Zha, Wei Li, Haiyan Yu, Zhiwei Xu Institute of Computing Technology, Chinese Academy of Sciences Xianghui.

Usage statistics:

>2 million sessions, from 80 countries

Page 15: Software Infrastructure of China National Grid Li Zha, Wei Li, Haiyan Yu, Zhiwei Xu Institute of Computing Technology, Chinese Academy of Sciences Xianghui.

Computer Innovation 6016国际计算机创新大会

• Beijing, November 30-December 3, 2005• Celebrating the 60th anniversary of computer• Contents

Technology, Education, and Impact Invited Talks; Roundtables on IT Trends, Education Technical Conferences

• HPC-Asia 2005, GCC 2005, NPC 2005 Public Activities, Exhibitions Sino-UK grid workshop, Grid education workshop

• www.ict.ac.cn/ci6016

• Google: CI6016