The UK eScience Grid (and other real Grids) Mark Hayes NIEeS Summer School 2003.
-
Upload
sylvia-russell -
Category
Documents
-
view
216 -
download
0
Transcript of The UK eScience Grid (and other real Grids) Mark Hayes NIEeS Summer School 2003.
![Page 1: The UK eScience Grid (and other real Grids) Mark Hayes NIEeS Summer School 2003.](https://reader034.fdocuments.us/reader034/viewer/2022051416/56649f1c5503460f94c333f0/html5/thumbnails/1.jpg)
The UK eScience Grid(and other real Grids)
Mark Hayes
NIEeS Summer School 2003
![Page 2: The UK eScience Grid (and other real Grids) Mark Hayes NIEeS Summer School 2003.](https://reader034.fdocuments.us/reader034/viewer/2022051416/56649f1c5503460f94c333f0/html5/thumbnails/2.jpg)
The Grid in the UK
Pilot projects in particle physics,astronomy, medicine, bioinformatics,environmental sciences...
Contributing to internationalGrid software development efforts
10 regional “eScience Centres”
![Page 3: The UK eScience Grid (and other real Grids) Mark Hayes NIEeS Summer School 2003.](https://reader034.fdocuments.us/reader034/viewer/2022051416/56649f1c5503460f94c333f0/html5/thumbnails/3.jpg)
Some UK Grid resources
• Daresbury - loki - 64 proc Alpha cluster• Manchester - green - 512 proc SGI Origin 3800• Imperial - saturn - large SMP Sun• Southampton - iridis - 400 proc.Intel Linux cluster• Rutherford Appleton Lab - hrothgar - 32 proc Intel Linux• Cambridge - herschel - 32 proc Intel Linux cluster • ...• coming soon: 4x >64 CPU JISC clusters, HPC(X)
![Page 4: The UK eScience Grid (and other real Grids) Mark Hayes NIEeS Summer School 2003.](https://reader034.fdocuments.us/reader034/viewer/2022051416/56649f1c5503460f94c333f0/html5/thumbnails/4.jpg)
Applications on the UK Grid
Ion diffusion through radiation damaged crystal structures (Mark Calleja, Earth Sciences, Cambridge)
• Monte Carlo simulation lots of independent runs• small input & output • more CPU -> higher temperatures, better stats• access to ~100 CPUs on the UK Grid• Condor-G client tool for farming out jobs
![Page 5: The UK eScience Grid (and other real Grids) Mark Hayes NIEeS Summer School 2003.](https://reader034.fdocuments.us/reader034/viewer/2022051416/56649f1c5503460f94c333f0/html5/thumbnails/5.jpg)
Applications on the UK Grid
GEODISE - Grid Enabled Optimisation & Design Search for Engineering(Simon Cox, Andy Keane, Hakki Eres, Southampton)
• Genetic algorithm to find the bestdesign for satellite truss beams
• Java plugins to MATLAB for remotejob submission to the Grid
• Used CPU at Belfast, Cambridge, RAL,London, Oxford & Southampton
![Page 6: The UK eScience Grid (and other real Grids) Mark Hayes NIEeS Summer School 2003.](https://reader034.fdocuments.us/reader034/viewer/2022051416/56649f1c5503460f94c333f0/html5/thumbnails/6.jpg)
Applications on the UK Grid
Reality Grid (Stephen Pickles, Robin Pinning - Manchester)
• Fluid dynamics of complex mixtures, e.goil, water and solid particles (mud)
• Used CPU at London, Cambridge
• Remote visualisation using SGIOnyx in Manchester (from a laptop in Sheffield)
• Computational steering
![Page 7: The UK eScience Grid (and other real Grids) Mark Hayes NIEeS Summer School 2003.](https://reader034.fdocuments.us/reader034/viewer/2022051416/56649f1c5503460f94c333f0/html5/thumbnails/7.jpg)
Applications on the UK Grid
GENIE - Grid Enabled Integrated Earth system model(Steven Newhouse, Murtaza Gulamali - Imperial)
• Ocean-atmosphere modelling
• How does moisture transport from the atmosphere effect ocean circulation?
• ~1000 independent 4000year runs (3 days real time!) on ~200 CPUs
• Flocked condor pools at London & Southampton
• Coupled modelling
![Page 8: The UK eScience Grid (and other real Grids) Mark Hayes NIEeS Summer School 2003.](https://reader034.fdocuments.us/reader034/viewer/2022051416/56649f1c5503460f94c333f0/html5/thumbnails/8.jpg)
Two years to get this far...
July 2001 - Regional eScience Centres funded
October 2001 - First meeting of the Grid Engineering Taskforce(biweekly meetings using Access Grid)
August 2002 - ‘Level 1’ Grid operational (simple job submission possible between sites)
April 2003 - ‘Level 2’ Grid + applications(security, monitoring, accounting)
July 2003 - ‘Level 3’ Grid: more users, more robust
![Page 9: The UK eScience Grid (and other real Grids) Mark Hayes NIEeS Summer School 2003.](https://reader034.fdocuments.us/reader034/viewer/2022051416/56649f1c5503460f94c333f0/html5/thumbnails/9.jpg)
The European DataGrid
• Tiered structure: Tier0=CERN
• Lots of their own Grid software
•Applications: particle physics, earth observation, bioinformatics
http://www.eu-datagrid.org/
![Page 10: The UK eScience Grid (and other real Grids) Mark Hayes NIEeS Summer School 2003.](https://reader034.fdocuments.us/reader034/viewer/2022051416/56649f1c5503460f94c333f0/html5/thumbnails/10.jpg)
NASA Information PowerGrid
• First “production quality” Grid
• Linking NASA & academic
supercomputing sites at 10 sites
• Applications: computational fluid
dynamics, meteorological data mining, Grid benchmarking
http://www.ipg.nasa.gov/
![Page 11: The UK eScience Grid (and other real Grids) Mark Hayes NIEeS Summer School 2003.](https://reader034.fdocuments.us/reader034/viewer/2022051416/56649f1c5503460f94c333f0/html5/thumbnails/11.jpg)
TeraGrid
• Linking supercomputers
through a high-speed network
• 4x 10GBps between SDSC, Caltech, Argonne & NCSA
• Call for proposals out for applications & users
http://www.teragrid.org/
![Page 12: The UK eScience Grid (and other real Grids) Mark Hayes NIEeS Summer School 2003.](https://reader034.fdocuments.us/reader034/viewer/2022051416/56649f1c5503460f94c333f0/html5/thumbnails/12.jpg)
Asia-Pacific Grid
• No central source of funding
• Informal, bottom-up approach
• Lots of experiments on benchmarking & bio apps.
http://www.apgrid.org/
![Page 13: The UK eScience Grid (and other real Grids) Mark Hayes NIEeS Summer School 2003.](https://reader034.fdocuments.us/reader034/viewer/2022051416/56649f1c5503460f94c333f0/html5/thumbnails/13.jpg)
What does it take to build a Grid?
• Resources - CPU, network, storage• People - sysadmins, application developers, Grid experts• Grid Middleware - Globus, Condor, Unicore…• Security - so you want to use my computer?• Maintenance - ongoing monitoring, upgrades… and co-ordination of this between multiple sites• Applications and users!
![Page 14: The UK eScience Grid (and other real Grids) Mark Hayes NIEeS Summer School 2003.](https://reader034.fdocuments.us/reader034/viewer/2022051416/56649f1c5503460f94c333f0/html5/thumbnails/14.jpg)
How you can get involved...
• NIEeS
• National eScience Centre (Edinburgh) http://www.nesc.ac.uk/
• NERC PhD studentships • Your local eScience Centre
• Adopt an application!
![Page 15: The UK eScience Grid (and other real Grids) Mark Hayes NIEeS Summer School 2003.](https://reader034.fdocuments.us/reader034/viewer/2022051416/56649f1c5503460f94c333f0/html5/thumbnails/15.jpg)
Questions?