© Copyright 2003 The Australian Nimrod Testbed Slavisa Garic (DSTC) Colin Enticott (DSTC)...
-
Upload
jaden-hood -
Category
Documents
-
view
213 -
download
0
Transcript of © Copyright 2003 The Australian Nimrod Testbed Slavisa Garic (DSTC) Colin Enticott (DSTC)...
© Copyright 2003
The Australian Nimrod The Australian Nimrod TestbedTestbed
Slavisa Garic (DSTC)Slavisa Garic (DSTC)Colin Enticott (DSTC)Colin Enticott (DSTC)
Supervisor:Supervisor:David Abramson (Monash)David Abramson (Monash)
Utilising GrangeNetUtilising GrangeNet
Speaker: Colin EnticottSpeaker: Colin Enticott
© Copyright 2003
IndexIndex
DSTC/GrangeNetDSTC/GrangeNet ProjectsProjects ANT/Enhancement of Nimrod/G V2.0 ANT/Enhancement of Nimrod/G V2.0
for GrangeNetfor GrangeNet• The Nimrod PortalThe Nimrod Portal
Pragma 4Pragma 4• Resources and resultsResources and results
© Copyright 2003
DDistributed istributed SSystems ystems TTechnology echnology CCentreentre The DSTC is a National IT Research and The DSTC is a National IT Research and
Development Centre focussing on the Development Centre focussing on the needs of the Government, Defence, needs of the Government, Defence, Health, Finance, Telecommunications and Health, Finance, Telecommunications and Education Sectors.Education Sectors.
© Copyright 2003
GrangeNetGrangeNet
GrGrid id aand nd nnext ext gegeneration neration NetNetworkwork Develop and operate a multi-gigabit Develop and operate a multi-gigabit
networknetwork Support grid and advanced Support grid and advanced
communications servicescommunications services 3 year program3 year program GrangeNet is 'open' to participation of GrangeNet is 'open' to participation of
organisationsorganisations
© Copyright 2003
InitialInitial GrangeNet LocationsGrangeNet LocationsBrisbaneMegapop
SydneyMegapop
CanberraMegapop
MelbourneMegapop
DSTCQPSF
Uni of Queensland
Boeing HQ
UTSDSTC@UTS
ANUAPAC
AARNet
Uni of Melbourne
VPACI-cubed
RMIT
AC3@ATPeBioinformatics
CRCSIT
CSIROBoM
SCCNUSA link
Dual 155M STM-1 link
2.5G PoS link
1 GbE link
Monash UniDSTC@MU
QUTQMI
GriffithU
UniSydUNSWCSIRO
IVECSAPACTPAC
© Copyright 2003
IndexIndex
DSTC/GrangeNetDSTC/GrangeNet ProjectsProjects ANT/Enhancement of Nimrod/G V2.0 ANT/Enhancement of Nimrod/G V2.0
for GrangeNetfor GrangeNet• The Nimrod PortalThe Nimrod Portal
Pragma 4Pragma 4• Resources and resultsResources and results
© Copyright 2003
NimrodNimrod
A A hunterhunter for computational resources for computational resources on the gridon the grid
Designed to assist parametric problemsDesigned to assist parametric problems Launching platformLaunching platform Performs file copying, execution and Performs file copying, execution and
maintains parameter setsmaintains parameter sets
© Copyright 2003
NimrodNimrod
Prof. David AbramsonProf. David Abramson Rok SosicRok Sosic Jon GiddyJon Giddy Slavisa GaricSlavisa Garic
© Copyright 2003
Parametric ExecutionParametric Execution
Study the Study the behaviourbehaviour of some of the of some of the output variables against a range of output variables against a range of different input scenarios.different input scenarios.
Computations are uncoupled (file Computations are uncoupled (file transfer)transfer)
Allows real time analysis for many Allows real time analysis for many applicationsapplications
More realistic simulationsMore realistic simulations
© Copyright 2003
Dr Dinelli MatherMonash University &MacFarlane Burnett
Public Health Policy
Genetic Algorithms
Dr Shane Dunn,AMRL, DSTO
Network Simulation
Mahbub Hasan, Monash University
Case Studies ...Case Studies ...
Dr Kate Smith,Monash University
Neural Network Optimization
Cattle Tick
© Copyright 2003
Dr Dinelli MatherMonash University &MacFarlane Burnett
Public Health Policy
Genetic Algorithms
Dr Shane Dunn,AMRL, DSTO
Network Simulation
Mahbub Hasan, Monash University
Case Studies ...Case Studies ...
Dr Kate Smith,Monash University
Neural Network Optimization
Cattle Tick
Case Studies ...Case Studies ...
Financial Services
Rendering Movies
CAD SimulationParallel MP3 Encoder
© Copyright 2003
Dr Dinelli MatherMonash University &MacFarlane Burnett
Public Health Policy
Genetic Algorithms
Dr Shane Dunn,AMRL, DSTO
Network Simulation
Mahbub Hasan, Monash University
Case Studies ...Case Studies ...
Dr Kate Smith,Monash University
Neural Network Optimization
Cattle Tick
Case Studies ...Case Studies ...
Financial Services
Rendering Movies
CAD SimulationParallel MP3 Encoder
Case Studies ...Case Studies ...
Health Standards
Lew KotlerAustralian Radiation Protection and Nuclear Safety Agency
Factory Simulation
John Betts, Monash University
Simulated AnnealingOptimization
Marcus Randall,Bond University
Ad-hoc Wireless
© Copyright 2003
Nimrod case studiesNimrod case studies
Particles ejecting from a supernovaParticles ejecting from a supernova Kuiper belt simulationsKuiper belt simulations Chemical docking. 100000Chemical docking. 10000022's of 's of
combinationscombinations GAMESSGAMESS
© Copyright 2003
parameter A1 float range from 1 to 4 step 0.1;parameter A2 float range from -1 to 0 step 0.1;parameter B1 float range from 0.5 to 2 step 0.1;parameter B2 float range from 0 to 1 step 0.1;
task main copy cart_eth.inp.sub node:. copy spher_eth.inp.sub node:. copy cart_rad.inp.sub node:. copy spher_rad.inp.sub node:. copy pragma4.$OS node:pragma4 copy pragma4.dat node:. substitute cart_eth.inp.sub cart_eth.A1=$A1.A2=$A2.B1=$B1.B2=$B2.inp substitute spher_eth.inp.sub spher_eth.A1=$A1.A2=$A2.B1=$B1.B2=$B2.inp substitute cart_rad.inp.sub cart_rad.A1=$A1.A2=$A2.B1=$B1.B2=$B2.inp substitute spher_rad.inp.sub spher_rad.A1=$A1.A2=$A2.B1=$B1.B2=$B2.inp node:execute $HOME/bin/cleanrungms cart_eth.A1=$A1.A2=$A2.B1=$B1.B2=$B2 > cart_eth.out node:execute $HOME/bin/cleanrungms spher_eth.A1=$A1.A2=$A2.B1=$B1.B2=$B2 > spher_eth.out node:execute $HOME/bin/cleanrungms cart_rad.A1=$A1.A2=$A2.B1=$B1.B2=$B2 > cart_rad.out node:execute $HOME/bin/cleanrungms spher_rad.A1=$A1.A2=$A2.B1=$B1.B2=$B2 > spher_rad.out node:execute ./pragma4 > pragma4.out
node:execute /bin/tar cvf results.A1=$A1.A2=$A2.B1=$B1.B2=$B2.tar cart_eth.out spher_eth.out cart_rad.out spher_rad.out pragma4.out node:execute /bin/gzip results.A1=$A1.A2=$A2.B1=$B1.B2=$B2.tar copy node:results.A1=$A1.A2=$A2.B1=$B1.B2=$B2.tar.gz results/results.A1=$A1.A2=$A2.B1=$B1.B2=$B2.tar.gzendtask
How does a user develop an How does a user develop an application using application using NimrodNimrod??
Job 1 Job 2 Job 3
Job 4 Job 5 Job 6
Job 7 Job 8 Job 9
Job 10 Job 11 Job 12
Job 13 Job 14 Job 15
Job 16 Job 17 Job 18
Description of ParametersPLAN FILE
© Copyright 2003
Nimrod/G 2.0 ArchitectureNimrod/G 2.0 ArchitectureNimrod/G Client Rsrc. SchedulerNimrod/G Client
Grid Information Server(s)
RM & TS
RM: Local Resource Manager, TS: Trade Server
G
L
Legion enabled node. CCondor enabled node.
Nimrod/G GUI
Enfuzion API +
Database
Level 3
Level 2
Level 1
GeneratorCreator
Run File
Plan File
Job SchedulerAgent Scheduler
DB Server
Agent
Globus Actuator Condor ActuatorLegion Actuator
Globus enabled node
RM & TS
RM & TS
AgentAgent
Grid Middleware
© Copyright 2003
Nimrod/ONimrod/O
Performs optimisationsPerforms optimisations Uses Nimrod or EnFuzionUses Nimrod or EnFuzion Simplex, Gradient Decent, B.G.F.S., Simplex, Gradient Decent, B.G.F.S.,
Genetic algorithms, …Genetic algorithms, …
Prof. David AbramsonProf. David Abramson Andrew LewisAndrew Lewis Tom PeachyTom Peachy
© Copyright 2003
Nimrod DependenciesNimrod Dependencies
One job cannot start until its One job cannot start until its dependency jobs have completeddependency jobs have completed
David AbramsonDavid Abramson Shahaan AyyubShahaan Ayyub
© Copyright 2003
Active SheetsActive Sheets
© Copyright 2003
Active SheetsActive Sheets
Prof. David AbramsonProf. David Abramson Paul RoePaul Roe Gavin CheukGavin Cheuk
© Copyright 2003
GriddLeSGriddLeS Legacy Applications are ComponentsLegacy Applications are Components
• Cannot necessarily modify themCannot necessarily modify them GriddLeSGriddLeS
• SSpecification of the interconnections between pecification of the interconnections between componentscomponents
• IInterfaces for discovering resources and mapping the nterfaces for discovering resources and mapping the computations to themcomputations to them
• LoLocate data files in the grid and connect the cate data files in the grid and connect the applications to them; applications to them;
• SSchedule computations on the underlying platforms chedule computations on the underlying platforms and making sure the network bandwidth is available and making sure the network bandwidth is available and and
• MMonitor the progress of the grid computation and onitor the progress of the grid computation and reassign work to other parts of the Grid as necessary.reassign work to other parts of the Grid as necessary.
© Copyright 2003
Standard ImplementationStandard Implementation
GASS
Real time data
Data Fusion
General Circulation model
Regional weather model
Photo-chemical pollution model Particle dispersion model
TopographyDatabase
TopographyDatabase
VegetationDatabase
VegetationDatabase
Emissions Inventory
Emissions Inventory
MPIMPI
MPI
GASS/GridFTP/GRC
MPI
MPI
Bushfire model GASS
© Copyright 2003
GriddLeSGriddLeS
Prof. David AbramsonProf. David Abramson Jagan KommineniJagan Kommineni
© Copyright 2003
IndexIndex
DSTC/GrangeNetDSTC/GrangeNet
ProjectsProjects ANT/Enhancement of Nimrod/G V2.0 ANT/Enhancement of Nimrod/G V2.0
for GrangeNetfor GrangeNet• The Nimrod PortalThe Nimrod Portal
Pragma 4Pragma 4• Resources and resultsResources and results
© Copyright 2003
ANTANT
Australian Australian NimrodNimrod Testbed Testbed A DSTC project for GrangeNetA DSTC project for GrangeNet Lead by Prof. David AbramsonLead by Prof. David Abramson
© Copyright 2003
parameter A1 float range from 1 to 4 step 0.1;parameter A2 float range from -1 to 0 step 0.1;parameter B1 float range from 0.5 to 2 step 0.1;parameter B2 float range from 0 to 1 step 0.1;
task main copy cart_eth.inp.sub node:. copy spher_eth.inp.sub node:. copy cart_rad.inp.sub node:. copy spher_rad.inp.sub node:. copy pragma4.$OS node:pragma4 copy pragma4.dat node:. substitute cart_eth.inp.sub cart_eth.A1=$A1.A2=$A2.B1=$B1.B2=$B2.inp substitute spher_eth.inp.sub spher_eth.A1=$A1.A2=$A2.B1=$B1.B2=$B2.inp substitute cart_rad.inp.sub cart_rad.A1=$A1.A2=$A2.B1=$B1.B2=$B2.inp substitute spher_rad.inp.sub spher_rad.A1=$A1.A2=$A2.B1=$B1.B2=$B2.inp node:execute $HOME/bin/cleanrungms cart_eth.A1=$A1.A2=$A2.B1=$B1.B2=$B2 > cart_eth.out node:execute $HOME/bin/cleanrungms spher_eth.A1=$A1.A2=$A2.B1=$B1.B2=$B2 > spher_eth.out node:execute $HOME/bin/cleanrungms cart_rad.A1=$A1.A2=$A2.B1=$B1.B2=$B2 > cart_rad.out node:execute $HOME/bin/cleanrungms spher_rad.A1=$A1.A2=$A2.B1=$B1.B2=$B2 > spher_rad.out node:execute ./pragma4 > pragma4.out
node:execute /bin/tar cvf results.A1=$A1.A2=$A2.B1=$B1.B2=$B2.tar cart_eth.out spher_eth.out cart_rad.out spher_rad.out pragma4.out node:execute /bin/gzip results.A1=$A1.A2=$A2.B1=$B1.B2=$B2.tar copy node:results.A1=$A1.A2=$A2.B1=$B1.B2=$B2.tar.gz results/results.A1=$A1.A2=$A2.B1=$B1.B2=$B2.tar.gzendtask
How does a user develop an How does a user develop an application using application using NimrodNimrod??
Job 1 Job 2 Job 3
Job 4 Job 5 Job 6
Job 7 Job 8 Job 9
Job 10 Job 11 Job 12
Job 13 Job 14 Job 15
Job 16 Job 17 Job 18
Description of ParametersPLAN FILE
NimrodNimrodPortalPortal
© Copyright 2003
Nimrod PortalNimrod Portal
The portal allows a quick and The portal allows a quick and powerful display of powerful display of experiments.experiments.
The status of each experiment The status of each experiment can be seen in a glance:can be seen in a glance:
Useable via any web browser Useable via any web browser that supports secure that supports secure connections. Shell access not connections. Shell access not required but is also available.required but is also available.
All experiment information on All experiment information on the experiment summary the experiment summary page: page:
© Copyright 2003
Nimrod PortalNimrod Portal
© Copyright 2003
Nimrod PortalNimrod Portal
© Copyright 2003
Nimrod PortalNimrod Portal
© Copyright 2003
Plan file editorPlan file editor
© Copyright 2003
Nimrod PortalNimrod Portal
© Copyright 2003
IndexIndex
DSTC/GrangeNetDSTC/GrangeNet
ProjectsProjects
ANT/Enhancement of Nimrod/G V2.0 ANT/Enhancement of Nimrod/G V2.0 for GrangeNetfor GrangeNet
The Nimrod PortalThe Nimrod Portal Pragma 4Pragma 4
• Resources and resultsResources and results
© Copyright 2003
Pragma 4Pragma 4
Held on the 5Held on the 5thth and 6 and 6thth June June Parameter Scan of an Effective Group Parameter Scan of an Effective Group
Difference Pseudopotential Using Difference Pseudopotential Using Grid ComputingGrid Computing
An experiment by Kim Baldridge and An experiment by Kim Baldridge and Wibke Sudholt at the University of Wibke Sudholt at the University of California, San DiegoCalifornia, San Diego
Using GAMESSUsing GAMESS
© Copyright 2003
Experiment ResourcesExperiment ResourcesMachine Name
Queue Manager
Processors Availa
ble
OS & Architecture
Location
hathor.csse.monash.edu.au PBS 24 Linux x86 Melbourne
brecca-2.vpac.org PBS 30 Linux x86 Melbourne
koume.hpcc.jp Grid Engine 4 Linux x86 Japan
ume.hpcc.jp Grid Engine 64 Linux x86 Japan
amata1.cpe.ku.ac.th SQMS 15 Linux x86 Thailand
erikson.ucsd.edu PBS 74 Linux x86 San Diego
slic00.sdsc.edu PBS 148 Linux x86 San Diego
hpc420.hpcc.jp PBS 14 Solaris Sparc Japan
tardis.eng.monash.edu.au NQE 1 Cray SV1 Melbourne
sn9280.cray.co.jp NQE 1 Cray SV1 Japan
venus.gridcenter.or.kr PBS 64 Linux x86 Korea
jupiter.gridcenter.or.kr PBS 16 Linux x86 Korea
apbs.rocksclusters.org PBS 12 Linux x86 San Diego
chemcca40.ucsd.edu PBS 36 Linux x86 San Diego
© Copyright 2003
World map 5:54amWorld map 5:54am
© Copyright 2003
World map 10:35amWorld map 10:35am
© Copyright 2003
0
10
20
30
40
50
60
Experiment time
# o
f C
PU
s
ume.hpcc.jp
slic00.sdsc.edu
koume.hpcc.jp
hathor.csse.monash.edu.au
erikson.ucsd.edu
chemcca40.ucsd.edu
brecca-2.vpac.org
apbs.rocksclusters.org
Number of CPUsNumber of CPUs
© Copyright 2003
Nimrod ViewerNimrod Viewer
© Copyright 2003
© Copyright 2003
© Copyright 2003
ResultsResults
4D input4D input 1D output1D output
© Copyright 2003
© Copyright 2003
Nimrod/O: Local minimasNimrod/O: Local minimas
© Copyright 2003
Super Computing 2003Super Computing 2003
PhoenixPhoenix On nowOn now
© Copyright 2003
New Experiment ResourcesNew Experiment Resources
Machine NameQueue Manager
Processors Availa
ble
OS & Architecture
Location
lc0.apac.edu.au PBS 152 Linux x86 Canberra
bouscat.cs.cf.ac.uk Fork 2 Linux x86 U.K.
bg02n100e00.hpc.cmc.osaka-u.ac.jp PBS 156 Linux x86 Japan
altix16.hpcu.uq.edu.au PBS 16 Linux ia64 Brisbane
globus.is.titech.ac.jp PBS 512 Linux x86 Japan
sputnik.earth.monash.edu.au PBS 16 Linux x86 Melbourne
cmsdgrid.uohyd.ernet.in Fork 1 Linux x86 India
nazgul.qpsf.edu.au SGE 7 Linux x86 Brisbane
wesc9-comsc.grid.cf.ac.uk Condor 64 IRIX MIPS U.K.
grid011.cs.usm.my PBS Linux Malaysia
horizon.sdsc.edu SP3 San Diego
hypnos.engin.umich.edu 254 Michigan
© Copyright 2003
Questions?Questions?