Jon Lau Assistant Headarchive.apan.net/meetings/busan03/materials/ws/escience/NATIONA… · –...

Post on 26-Sep-2020

1 views 0 download

Transcript of Jon Lau Assistant Headarchive.apan.net/meetings/busan03/materials/ws/escience/NATIONA… · –...

NATIONAL GRIDNATIONAL GRIDSINGAPORESINGAPORE

Jon LauAssistant Head

ContentContent

• Development in Grid Activities in Singapore

• Singapore’s National Grid• Pilot Platform• Virtualization of Technical Computing

Resource• Promotional Activities• International Interactions

Development in Grid Development in Grid Activities in Singapore Activities in Singapore

Overview of Grid ActivitiesOverview of Grid Activities

– Nanyang Technological University (NTU)– National University of Singapore (NUS)– Institute of High Performance Computing

(IHPC)– Genome Institute of Singapore (GIS)– Bioinformatics Institute (BII)

• Maximize academic/research computing resources utilization.• Enable sharing of specialized and scarce hardware & software

resources.• Enable sharing of data in BioInformatics & other research works.• Facilitate collaboration.

• Linux clusters at NUS, NTU & IHPC connected to form a Grid testbed

• Globus Toolkit installed on all clusters• Packages: Condor, PBS, Sun Grid Engine

Earlier Grid Earlier Grid TestbedsTestbeds

[Courtesy of Tan Chee Chiang, NUS]

NanyangNanyang Technological UniversityTechnological University

• Research Focus– Middleware development (with IHPC)– Application development

• Projects– MEG Data Visualisation (CyberMedia Center, Osaka Univ.)– Integration of SIBBS into Globus– Meta-scheduling, inter-operability, ...

• Collaborators– IHPC, BioMedGrid, ApGrid

• HPC Resources– PC Cluster with Cluster software– 0.5 teraflops HP (Compaq) Cluster– AP Science & Technology Centre (with Sun Microsystems)

[Courtesy of A/P Francis Lee, NTU]

National University of SingaporeNational University of Singapore

• Research Focus– Middleware & Grid Programming

• Projects– ALICE (a Java-based Lightweight Grid)

• Collaborators– Centre for Remote Imaging, Sensing & Processing (CRISP),

Bioinformatics Institute, Nanyang Polytechnic (School of Life Sciences)

• Start-up: Atsuma Technology (www.atsuma.com)• HPC Resources:

– HP Alpha servers (GS320 and ES40), SGI server (Origin2000), Linux cluster, & SGI/HP/Sun workstations

[Courtesy of A/P Teo Yong Meng, NUS]

Institute of Institute of High Performance ComputingHigh Performance Computing

• Research Focus– Middleware development (with NTU)

• Directory service, execution management services

• Projects– Infrastructure implementation (KISTI (Korea))– Grid Enabled Computational Electro Magnetics (British

Aerospace, Cardiff University, Swansea University & HP)– Environment to support simulations (such as CFD, CME, CEE,

MEMS)

• HPC Resources– IBM p690 Regatta, 17 & 13 CPU PIII Beowulf clusters

[Courtesy of Dr. Kurichi Kumar, IHPC]

Genome Institute of SingaporeGenome Institute of SingaporeGrid ProjectsGrid Projects

• SNPs– Building an integrated SNPs database which takes information

from several SNPs databases & then aligns the information to a common genome sequence. The resulting information helps to identify SNPs which overlap & could be more significant for using as markers & building of primers.

• Protein-Protein Interactions Database (PPDB)– Building a system to help predict protein-protein interactions by

integrating many tools & data from several sources. We use information from domain fusion, text-mining, experimental databases, & phylogenetic profiling to construct putative protein-protein interaction networks.

[Courtesy of Heidi Dowst, GIS]

Bioinformatics InstituteBioinformatics Institute• Research Focus

– Bioinformatics, grid software

• Projects– High Throughput Blast with National Cancer Centre– Analysis Pipeline of Zebrafish Genome with GIS– Annotation of Fugu Genome with IMCB & Sanger Center (UK)– Analysis of Arrhythmia– High Throughput Mass Spec Analysis with GIS– Bacterial Comparative Genomics with DMRI– Grid version of Clustlw– Cellware

• HPC Resources– Itanium cluster, Alpha, 64-CPU Pentium 3

[Courtesy of Larry Ang]

SingaporeSingapore’’ssNational GridNational Grid

National GridNational Grid

The NG is a national effort to:• Develop a Cyberinfrastructure for

science and engineering research and education; and

• Promote the use of Grid Computing for research, academia, commerce and industry

NG NG OrganisationOrganisation ChartChartMTI

(A*STAR, EDB, JTC, RICs)

MTI(A*STAR, EDB,

JTC, RICs)

MINDEF(DSTA, DSO,

defence contractors)

MINDEF(DSTA, DSO,

defence contractors)

MITA(IDA, MDA)

MITA(IDA, MDA)

MOH(Hospitals)

MOH(Hospitals)

MOE(Schools)MOE

(Schools)IHLs

(NUS, NTU & Polys)

IHLs(NUS, NTU &

Polys)

National Grid Steering Committee (NGSC)Chairman: Mr Peter Ho, PS (Defence)

National Grid Steering Committee (NGSC)Chairman: Mr Peter Ho, PS (Defence)

Network WG

Security WG

Middleware WG

Applications WG

Governance/Policy WG

Physical Sciences

VGC

National Grid Operations Centre

(NGOC)

National GridOffice(NGO)

National GridOffice(NGO)Facilitates &

coordinates activities

National Grid Competency

Centre (NGCC)Life Sciences

VGC….

NG OfficeNG Office

• Started:– Jan 2003 with 2½ persons

• Functions:– Secretariat to NG Steering Committee– Facilitate & co-ordinate activities of Working

Groups & Virtual Grid Communities– Develop NG Master Plan

– Act as a catalyst to achieve the NG goal

National GridNational GridPilot PlatformPilot Platform

(NGPP)(NGPP)

Pilot Platform for Grid ComputingPilot Platform for Grid Computing

“Conservative” approach to demonstrate the feasibility of grid computing:

• Use existing facilities as much as possible• Co-funding by stakeholders• Performance indicators for review• Dovetails with a strategic research program on

collaborative large-scale computing

NG Pilot PlatformNG Pilot Platform

Itanium 2LinuxSMA

Sun FireIntel Pentium 4

SolarisLinux

NTU

Intel Xeon ClusterLinuxNUS

Intel Xeon ClusterItanium

Sun

LinuxItaniumSolaris

One-North(BII & GIS)

IBM RegattaAIXIHPC

PlatformOSEntity

NG Pilot PlatformNG Pilot Platform

• Connecting up– Institute for Higher Performance Computing

(IHPC)– One-North which has Bioinformatics Institute

(BII) and Genome Institute – National University of Singapore (NUS)– Nanyang Technological University (NTU)– Singapore-MIT Alliance (SMA)

NG Pilot PlatformNG Pilot Platform

• Co-funding from stakeholders – Agency for Science, Technology and

Research (A*STAR)– Defense Science Technology Authority

(DSTA)– Economic Development Board (EDB)– Infocomm Development Authority (IDA)– National University of Singapore (NUS)– Nanyang Technological University (NTU)– Singapore-MIT Alliance (SMA)

NG Pilot PlatformNG Pilot Platform

• Support from Vendors– CISCO– DELL– Hewlett Packard– IBM– Intel– Singapore Computer Systems– StarHub– Sun Microsystems

Thematic Strategic Research Thematic Strategic Research Programme (TSRP) onProgramme (TSRP) on

““GRID GRID Computing Computing -- Network, Platform, Network, Platform, Middleware and ApplicationsMiddleware and Applications

• A thematic approach for funding of Strategic Research Programmes by the Science & Engineering Research Council under A*STAR

• Fund Grid R&D projects which include research on Grid Enabling technologies (i.e. network, security, middleware, & tools).

Virtualization/Sharing/Aggregation Virtualization/Sharing/Aggregation ofof

Technical Computing Resource Technical Computing Resource on theon the

National Grid Pilot PlatformNational Grid Pilot Platform

Survey onSurvey onScientific Computing Hardware ExpenditureScientific Computing Hardware Expenditure

Survey:• Survey among IHLs and RICs for the past 5 years

(1998 – 2002).• Survey of hardware bought. It does not include

cost of maintenance, manpower costs and software costs.

Assumptions:• Based on 40% savings when utilization is

increased by virtualizing resources.

Survey onSurvey onScientific Computing Hardware ExpenditureScientific Computing Hardware Expenditure

S$40m

1997 1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008

Year

Cos

t

Projected Expenditure on HPCWithout Grid Infrastructure

Projected Expenditure on HPCWith Grid Infrastructure

Survey onSurvey onScientific Computing Hardware ExpenditureScientific Computing Hardware Expenditure

Findings:• Hardware replacements occurs in a 4 year cycle.• Savings of between 20% - 30% over next 5 years.• The amounts indicated are probably less than actual expenditure

as it is impossible to capture every items purchased.More savings expected:• Bandwidth costs goes down.• Additional savings from software aggregation and savings in

manpower and maintenance costs.Other benefits:• Better results via collaboration.• Ability to handle massively computational jobs.• Attract investments in Life Sciences.

Promotional ActivitiesPromotional Activities

Organized by :

Supported by :

Sponsored by :

Physical Sciences VGC SymposiumPhysical Sciences VGC Symposium

• Co-organised by NUS, NTU, IHPC and NG Office

• 10 papers submitted

• More than 100 participants

Grid Competition for IHL studentsGrid Competition for IHL students

International InteractionsInternational Interactions

International InteractionsInternational InteractionsKorea/JapanKorea/Japan

• A*STAR led delegation visited Korea and Japan from 12 – 15 May 2003– Korea: KISTI, Seoul University, Yonsei University,

Ministry of Information & Communication (MIC) and IBM & HP.

– Japan: IBM Tokyo Research Lab, GTRC-AIST, NTT Data Corp, METI.

International InteractionsInternational InteractionsUK eUK e--ScienceScience

• A*STAR and National Grid visited UK e-Science Centresin July 2003.

• Singapore Tissue Network collaboration with Oxford University.

• NTU collaboration with University of Southhampton and other e-Science centres.

• IHPC collaboration with BEA, Cardiff University, HP Lab Bristol, University of Wales, Swansea, Welsh e-Science Centre (GECEM).

• IHPC collaboration with Rolls Royce.• A delegation from Singapore will be attending “all-

hands” meeting at Nottingham, UK in September 2003.

International InteractionsInternational InteractionsUSA USA TeraGridTeraGrid

• An NGSC delegation will be visiting USA TeraGrid sites in September 2003– Argonne National Laboratory (ANL)– National Center for Supercomputing

Applications (NCSA)– National Science Foundation (NSF)– San Diego Supercomputing Centre (SDSC)

Modest beginning

Milestones of NGMilestones of NG

Sep 02

Visit to Japan and Korea

Jan 03

NG Office(2-1/2 staff)Formed

NG O submitted proposal on TSRP

for Grid Computing

NG O organized 1st

Physical Sciences VGC Symposium

Jul 03

NG SCFormed

PP business Plan approved

Aug 03 Sep 03 Oct 03June 03

To award PP contracts

UK e-ScienceTrip

Workshop on TSRP for Grid

ComputingTo

Launch PP

Apr 03 May 03

Consulting, buy-ins, promotion

Accelerating developments

UK e-Science‘all-hands’

Visit to USATeraGrid

The Way AheadThe Way Ahead

• International Collaborations/MOUs• Strengthening of NG Pilot Platform• Improve middleware, and the provision

of Grid operation/support services• Encourage Virtual Grid Communities

AcknowledgementsAcknowledgements• A/P Francis Lee (ebslee@ntu.edu.sg), School of Computer

Engineering, NTU• A/P Teo Yong Meng (teoym@comp.nus.edu.sg), Computer

Science Department, NUS• A/P Tan Tin Wee (tinwee@bic.nus.edu.sg), Bioinformatics Centre,

Dept. of Biochemistry, NUS• Tan Chee Chiang (ccetancc@nus.edu.sg), Computer Centre, NUS• Dr. Kurichi Kumar (kkumar@ihpc.a-star.edu.sg), Institute of High

Performance Computing• Heidi Dowst (gishd@nus.edu.sg), Genome Institute of Singapore• Larry Ang (larry@bii.a-star.edu.sg), Bioinformatics Institute

The EndThe End

For more information, contact:

National Grid Office21 Heng Mui Keng Terrace

Singapore 119613

http://www.ngp.org.sg