OptiPuterand AIST

Tomohiro Kudoh

Grid Technology Research Center (GTRC), National Institute of

Advanced Industrial Science and Technology (AIST)

Who we are

• AIST (National Institute of Advanced Industrial Science and Technologies) is Japan's largest public research organization with more than 50 research units and 2,500 researchers.

• GTRC (Grid Technology Research Center) is a research unit of AIST, established in 2002. GTRC has more than 50 researchers.

• GTRC/AIST is a new partner of OptiPuter– Became a affiliate member this year

       

  

Grid Technology Research Center

3

GridMPI™

ED grid Software Architecture

Local Site Data

Local Site Data

E- Defense daq

Data AcquisitionHDTV image

E- Defense daq

Data AcquisitionHDTV image

ED pop @MikiCollaborationTelepresenceLocal Data Tools

ED pop @MikiCollaborationTelepresenceLocal Data Tools

Client ToolsWeb BrowserChef (EN)Simulation portal

Client ToolsWeb BrowserChef (EN)Simulation portal

Remote Researcher

E-Defense Facility

ED grid central

Facility SiteED pop @XX

Local Data ToolsComputing resources

ED pop @XXLocal Data ToolsComputing resources

Local Site Data

Local Site Data

Data AcquisitionData Acquisition

Simulation program

Simulation program

Sensor GridSensor Grid

ED pop @YYComputing resources

ED pop @YYComputing resources

IT service Site

AuthenticationAuthorizationData Repository

Coming Soon: (NEESit)Simulation/ Analysis & Visualization tools

AuthenticationAuthorizationData Repository

Coming Soon: (NEESit)Simulation/ Analysis & Visualization tools Data Cache

RepositoryData CacheRepository

GridAuthCA

Data Integration/FederationCommon formatPOP interoperabilitySimulation portal

EDlite/GT4

EDlite/GT4

EDlite/GT4

EDlite/GT4

NEW!!NEW!!

E-Defense Grid

Geo Grid Web service platform

Geo Grid Web service platform

AIST Geo Grid

GEONGEONInteroperable

ASTERMODIS

L1A

Geometric correction

DEM

East/SouthEast ASIA15m resolution

Possible collaboration

Application Simulation

Geo Grid Portal (GEON base)

Geo Grid Portal (GEON base) GEON PortalGEON Portal

Interoperable

AISTCA

GEONCA

Cross Trust

Inter-exchangeable Data FormatDistributed Data Storage

Visualizationservice

Tiled Wall DisplayApplication

•Have own DEM data of E/SE Asia at 15m resolution•Have common architecture so that

•Share data•Share Application

•Have own CA at each site to allow multi CA in future•Tele visualization on Tiled Display and its user I/F•More insight: (future)

•Exchange raw data between US/JP

AIST GEO Grid Grid ASPグリッド技術を用いてユーティリティサービスを実現する次世代IT基盤のフレームワークを開発するプロジェクト。経済産業省によるビジネスグリッドコンピューティングプロジェクトの一環として実施中。

■GridASPの技術的特徴

一般ユーザ

SP

AP

RP

ユーザ情報やデータの秘匿•匿名IDによるRPへのユーザ情報隠蔽•SPに対するユーザデータの暗号化

三種類のプロバイダによる連携•アプリケーションの自動配備•リソースに関する情報サービス

Users SP RP

Real ID AnonymousID

Real World Anonymous World

(1)Authentication (2) Trusted SP

Data Data DataData(3) Encryption (5) Decryption(4) Transfer

Shared key cryptosystemsecret key secret key

AP RPSP

Application Pool

Management node(Deployment Engine)

Resource nodeResource nodeResource node

Cluster

AppApp App.

Info.

App

ApplicationDB

DeploymentManager

App

AppApp

DeploymentDescription

App.Info.

DeploymentDescription

(5) Transfer

DeploymentDescription

(6) Installation

(2) RequestInstallation

(3) Searches DBs

(7) Register

(1) Upload

(4) Notice& Confirm

ResourceDB

Application Manager System Manager

Ex. Smith Ex. user12

Ex. Structures of candidate molecules

Ex. cd $userdir/app/rpm –r app.rpm ….

Users SP RP

Real ID AnonymousID

Real World Anonymous World

(1)Authentication (2) Trusted SP

Data DataData DataDataData(3) Encryption (5) Decryption(4) Transfer

Shared key cryptosystemsecret key secret key

AP RPSP

Application Pool

Management node(Deployment Engine)

Resource nodeResource nodeResource node

Cluster

AppApp App.

Info.

App

ApplicationDB

DeploymentManager

App

AppApp

DeploymentDescription

App.Info.

DeploymentDescription

(5) Transfer

DeploymentDescription

(6) Installation

(2) RequestInstallation

(3) Searches DBs

(7) Register

(1) Upload

(4) Notice& Confirm

ResourceDB

Application Manager System Manager

Ex. Smith Ex. user12

Ex. Structures of candidate molecules

Ex. cd $userdir/app/rpm –r app.rpm ….

図中の説明は日本語化

一般ユーザ GridASP

テクニカルアプリケーション実行サービス

一般ユーザ GridASP

テクニカルアプリケーション実行サービス

三つの組織の連携によるASPの実現

・SP (Service Provider)・AP (Application Provider)・RP (Resource Provider)

① Promoting Grid technology with real application experiments ② Developing Grid middle wares

③ International collaboration and standardization activities

Gfram 1.1.1 (5/17)Ninf-G 2.3 (12/21)Grid MPI 0.2 (11/07)

Some of main research themes at GTRC/AISTSome of main research themes at GTRC/AIST

What we (will) do (in terms of OptiPuter)

• Data-Intensive research and collaboration– Tiled display system and SAGE– AIST GEO Grid and GEON

• Optical network infrastructure– G-lambda project

Tiled Display at AIST

A tiled display system which uses the SAGE environment

AIST GEO Grid

GTRC and Institute of Geology and Geoinformation of AIST will collaborate with GEON project at UCSD

Geo Grid Web service platform

Geo Grid Web service platform

AIST Geo Grid

GEONGEONInteroperable

ASTERMODIS

L1A

Geometric correction

DEM

East/SouthEast ASIA15m resolution

Application Simulation

Geo Grid Portal (GEON base)

Geo Grid Portal (GEON base) GEON PortalGEON Portal

Interoperable

AISTCA

GEONCA

Cross Trust

Inter-exchangeable Data FormatDistributed Data Storage

Visualizationservice

Tiled Wall DisplayApplication

Optical network + Grid • OptiPuter is a textbook case

– We have a lot to learn from OptiPuter– In Japan, situation is a little bit different from that of US

• Joint project of network and computer science research is not common

• Network carriers have strong will and ability to create new services

– We are trying to find a way to realize lambda path service in cooperation with network carriers

• G- lambda project– Define an interface between users and GMPLS network

carriers– Advance co-reservation of computing and network reso

urces– Collaborative project of AIST, KDDI lab., NTT, NICT– Demo at RICE station, from 1:30pm

8

Overview of G-lambda project• To make lambda path service available for everyone

– Lambda path service should be a “commercial service”• Well defined standard interface between users and network operators is

required• Isolate detailed network control from users

• To realize inter-carrier service– A standard lambda path control protocol should be used

– One of the most viable protocols for lambda path control and management

• To realize stable and high quality service on Grid at low cost– Dynamic provisioning of stable wide-BW network

GNS-WSI: Grid Network Service / Web Services Interface

GMPLS (Generalized Multi-Protocol Label Switching)

Simultaneous advance reservation of both computing and lambda path resources

9

Demonstration Overview

① User requests service via GUI, specifying the required number of computers and thenetwork bandwidth needed

Grid Resource Scheduler (GRS)

Computing Resource Manager(CRM)

Network Resource Management System (NRM)

②The computing resourcesand GMPLS network resourcesare reserved as the result of

interworking between the GRS and NRM using GNS-WSI(Grid Network Service /Web Services Interface)

GNS-WSI

1 10

5

1Gbps0.

5Gbp

s

GUI

1 10

5

1Gbps0.

5Gbp

s

GUI

AISTAISTTsukubaTsukuba

JGN JGN ⅡⅡ Osaka Osaka Research CenterResearch Center

AISTAISTAkihabaraAkihabaraJGN Ⅱ

Gigabit Ether ( X n streams)

Cluster

GMPLS Router

Optical Cross-Connect

JGN IIJGN IIFukuokaFukuoka

JGN IIJGN IIKanazawaKanazawa

KDDIKDDI Labs.Labs.KamifukuokaKamifukuoka

AISTAISTTsukubaTsukuba

JGN JGN ⅡⅡ Osaka Osaka Research CenterResearch Center

AISTAISTAkihabaraAkihabaraJGN Ⅱ

Gigabit Ether ( X n streams)

Cluster

GMPLS Router

Optical Cross-Connect

JGN IIJGN IIFukuokaFukuoka

JGN IIJGN IIKanazawaKanazawa

KDDIKDDI Labs.Labs.KamifukuokaKamifukuoka

③ A molecular dynamics simulation is executed using the reserved computers and lambda paths. Ninf-G2 and GlobusToolkit 2 (GT2) are used at each cluster.

WS-RFWS-RF

GT4GT4

Web Services I/F

GMPLSGMPLS

10

Request computers and bandwidth

Required # of CPULocation can bespecified (optional)

Required path andbandwidth

A total of 37 CPUs at 4 locations and star shaped paths are requested

Duration of reservation

Deadline ofjob completion

11

Advance reservation status

CPUs reservation status Paths reservation status

# of CPU

The pathTKB-KMF

Reservation status of TKB cluster

time

Current time

12

Current CPU and paths

Paths are displayed based on the information from GMPLS routers

Summary

• AIST is a novice partner of OptiPuter• We have a lot of possible collaboration r

esearch themes– Tiled display– Geo science research– Lambda path services– Transport protocol…

• We are looking forward to future collaborations with OptiPuter partners.

14

Live demo of G-lambda

JA101

1:30pm-3:00pm at RICE station

Thank you!