Supercomputers 2Supercomputers 2
Prof. Sin-Min LeeProf. Sin-Min Lee
Department of Computer Department of Computer ScienceScience
Cluster ComputersCluster Computers
Clusters on the Rise
Using clusters of small machines to build a supercomputer is not a new concept.
Another of the world's top machines, housed at the Lawrence Livermore National Laboratory, was constructed from 2,304 Xeon processors. The machine was build by Utah-based Linux Networx.
Clustering technology has meant that traditional big-iron leaders like Cray (Nasdaq: CRAY) and IBM have new competition from makers of smaller machines. Dell (Nasdaq: DELL) , among other companies, has sold high-powered computing clusters to research institutions.
Cluster ComputersCluster Computers
Each computer in a cluster is a Each computer in a cluster is a complete computer by itselfcomplete computer by itself CPUCPU MemoryMemory DiskDisk etcetc
Computers communicate with each Computers communicate with each other via some interconnection bus other via some interconnection bus
Cluster ComputersCluster Computers
Typically used where one computer Typically used where one computer does not have enough capacity to do does not have enough capacity to do the expected workthe expected work Large ServersLarge Servers
Cheaper than building one GIANT Cheaper than building one GIANT computercomputer
Although not new, supercomputing clustering technology still is impressive. It works by farming out chunks of data to individual machines, adding that clustering works better for some types of computing problems than others.
For example, a cluster would not be ideal to compete against IBM's Deep Blue supercomputer in a chess match; in this case, all the data must be available to one processor at the same moment -- the machine operates much in the same way as the human brain handles tasks.
However, a cluster would be ideal for the processing of seismic data for oil exploration, because that computing job can be divided into many smaller tasks.
Cluster ComputersCluster Computers
Need to break up work among the Need to break up work among the computers in the clustercomputers in the cluster
Example: Microsoft.com Search EngineExample: Microsoft.com Search Engine 6 computers running SQL Server6 computers running SQL Server
Each has a copy of the MS Knowledge BaseEach has a copy of the MS Knowledge Base Search requests come to one computerSearch requests come to one computer
Sends request to one of the 6Sends request to one of the 6 Attempts to keep all 6 busyAttempts to keep all 6 busy
The Virginia Tech Mac supercomputer should be fully functional and in use by January 2004. It will be used for research into nanoscale electronics, quantum chemistry, computational chemistry, aerodynamics, molecular statics, computational acoustics and the molecular modeling of proteins.
Visual TourVisual Tour
Current Cray ProductsCurrent Cray Products
Cray X1 is the only Cray’s product with Cray X1 is the only Cray’s product with a unique vector CPUa unique vector CPU Competitors are: Fujitsu, NEC, HPCompetitors are: Fujitsu, NEC, HP
Cray XT3 and XD1 use AMD Opteron Cray XT3 and XD1 use AMD Opteron CPUs (series 100 and series 200 CPUs (series 100 and series 200 accordingly)accordingly)
You can find full product specifications You can find full product specifications as well as additional information on as well as additional information on current systems at www.cray.comcurrent systems at www.cray.com
Performance MeasurementsPerformance Measurements Performance is measured in teraflopsPerformance is measured in teraflops Linpack is a standard benchmarkLinpack is a standard benchmark Performance is also measured in memory Performance is also measured in memory
bandwidth & latency, disk performance, bandwidth & latency, disk performance, interconnects, internal IO, reliability, and interconnects, internal IO, reliability, and othersothers
For example:For example: My home system, Athlon 750, gives about 34 My home system, Athlon 750, gives about 34
megaflops (34*10^6 flops)megaflops (34*10^6 flops) Current mid-range supercomputers give about Current mid-range supercomputers give about
40 teraflops(40*10^12 flops) which is 1,176,470 40 teraflops(40*10^12 flops) which is 1,176,470 times fastertimes faster
Scalable Architecture in XT-Scalable Architecture in XT-33
Is Cray a good deal?Is Cray a good deal?
Typical Cost approximately $30 million and Typical Cost approximately $30 million and aboveabove
Useful lifetime – 6 yearsUseful lifetime – 6 years Most customers use supercomputers at 90% Most customers use supercomputers at 90%
- 98% load- 98% load Clustered supercomputers and machines Clustered supercomputers and machines
build around common desktop components build around common desktop components (AMD/Intel CPUs, memory chips, (AMD/Intel CPUs, memory chips, motherboards, and etc.) are significantly motherboards, and etc.) are significantly cheapercheaper
FutureFuture Cray’s “Red Storm” System in Sandia Cray’s “Red Storm” System in Sandia
National Laboratories is running on Linux OSNational Laboratories is running on Linux OS Current Cost $90 millionCurrent Cost $90 million Uses 11,648 AMD Opteron CPUsUses 11,648 AMD Opteron CPUs Current operational speed – 41.5 teraflopsCurrent operational speed – 41.5 teraflops Uses unique SeaStar chip, which passes Uses unique SeaStar chip, which passes
messages between thousands of CPUsmessages between thousands of CPUs Upgrades are scheduled to be completed by Upgrades are scheduled to be completed by
the end of 2005 using dual-core Opteronthe end of 2005 using dual-core Opteron Expected to reach 100 teraflops by the end Expected to reach 100 teraflops by the end
of 2005of 2005
Computers and Weather
forecasting
Weather forecasting
Menu
Weather forecasting
Explanation
Overview picture
Data collection
Sensors
Data logging
The Grid System
Weather station
Radiosonde
Satellites
Radar
Weather ships
Supercomputers
Parallel Processing
Software
Pressing Weather forecasting on any slide will bring you back to this menu
During the last two decades the Met Office hasused state-of-the-art supercomputersfor numerical weather prediction and morerecently, also for predictions of global climate.
Weather forecasting
This is a picture of a supercomputer
WeatherWeather forecasting forecasting
Weather forecasters are helped by several things. These include:-
The computer makes millions of calculations.
1. The computer’s advice2. Information from radar
3. Information from satellite pictures
The sums are called differential equations
Before the computer can do the calculations, data has to be collected first.
Weather forecasting
Collecting data on the weather is very important.
Without the data, the computer could not do the calculations that enable it tomake weather predictions.
The next slide shows where the data comes from.
It also shows where the forecasts are sent.
Always remember that the forecasters are highlytrained people and they use their judgementand expertise to make their forecastbased on the information the computergives them and the information from the radarand the satellite pictures.
Supercomputer
Radio-sonde
Weather shipand weather buoys
Satellites
Radar
Weather forecasting
Weatherstations
Forecaster
Supercomputer
Global forecast services
Aviation
ShippingNational and International
Forecast Services up to 7 days ahead.
Radio-sonde
Weather shipand weather buoys
Satellites
Radar
Weather forecasting
Weatherstations
Forecaster
Supercomputer
Global forecast services
Aviation
ShippingNational and International
Forecast Services up to 7 days ahead.
Radio-sonde
Weather shipand weather buoys
Satellites
Radar
Weather forecasting
Weatherstations
Weather forecasting
Data is collected continuously for the computer from the following:-
1. Weather stations2. Automated weather
stations 3. Satellites 4. Radar 5. Radiosondes 6. Weather ships 7. Mini-radiosondes 8. Radar 9. Aeroplanes10. Drifting buoys
Weather forecasting
The data measurements are made by sensors
A sensor is a transducer which responds to some physical property such as pressure, temperature, rate of flow.
A transducer is an electronic component which converts energy from one form to another.
We want the transducers to send signals to the computer in the Met. Office.
1. Temperature .. Air, surface and subsurface temp.
2. Atmospheric Pressure
3. Wind speed
4. Wind direction
5. Humidity
6. Rainfall
Weather forecasting
7. Sunshine
The measurements needed include:-
Weather forecasting
These are some of the sensors used to collect data.
Weather forecasting
Data logging is the capture and storage of data for future use.
All the measurements from the sensors are stored because:-
So data logging is used in weather forecasting.
• The computer processes the data in batches
• People need to refer back to weather data for many reasons
Weather forecasting
The next slides explain more about data collection.
To jump to the details of the computers, click on the computer.
Mountain effects
Formation of clouds
Formation of rain and snow
FrictionRadiation from the
earth
Radiation from the atmosphere
Radiation from the sun
Evaporation and
heat exchange
The atmosphere is split up into a 3-D grid.Each land based grid is about 60km.
Sea
Weather forecasting
The vertical grid you just saw only had 5 levels.
The Met Office uses far more, some computer models work on 40 vertical levels.
Weather forecasting
For UK forecasts the horizontal grid is 15km.
For the global forecasts the horizontal grid is 60km
Sea
We need to measure pressure, temperature,
wind speed and wind directions as well as rainfall, cloud cover,etc in as many grid spaces as possible
Weather forecasting
Sea
Weather forecasting
Weather stations are used here.
A weather station sends signals back to the Met Office computer.
The instruments measure pressure, temperature and humidity.
Weather forecasting
Some weather stations are automated. These send their measurements back to the computerdirectly.
Picture thanks to Sparholt school who have a great web sitewww.hants.gov.uk/sparsholtschoolscentre
We need to measure pressure, temperature,
wind speed and wind directions as well as rainfall, cloud cover,etcRadiosonde
s are used up here.
20 km
Sea
Weather forecasting
A radiosonde sends signals backto the Met Office computer. They are attached to a balloon carrying instruments.
The instruments measure pressure, temperature and humidity.
By measuring the track of the radiosonde, the wind direction and speed can be calculated.
Weather forecasting
Photo courtesy of the British Atmospheric Data Centre
All over the world, radiosondes are released at midday and midnight UTC.
UTC = Universal Time Co-ordinated
Weather forecasting
UTC = Universal Time Co-ordinated
Hawaii 2 amAtlantic Daylight
9 am
Baghdad3 pm
West Australian Standard 7 pm
UTC is also known as GMTGreenwich Mean Time
Here are some of the times when the radiosondesare released to correspond with the ones in Britain at midday.
Weather forecasting
Sea
We need to measure pressure, temperature,
wind speed and wind directions as well as rainfall, cloud cover,etc
Minisondes are used
here.
5 km
Everest is 8.85 Kms high. So we have shown you a very high mountain!
Weather forecasting
A minisonde system takes measurements at 5Km above sea level.
Both radiosondes and minisondes use radio waves to transmit the data readings to the computers
Weather forecasting
Sea
We need to measure pressure, temperature,
wind speed and wind directions as well as rainfall, cloud cover,etc
Aeroplanes send
data too. 10 km
Weather forecasting
Sea
We need to measure pressure, temperature,
wind speed and wind directions as well as rainfall, cloud cover,etc
Satellites send
data too.
36,000km
Weather forecasting
The Geostationary satellites are 36,000 Km above earth.
There are two types of satellites.
• Geostationary. These stay in the same spot. They orbit the earth at exactly the same speed as the earth rotates. They are very high above earth - 36,000 km.5 geostationary satellites are enough to give
global coverage.
Weather forecasting
• Polar orbiting. These orbit the earth about 14 times a day. They orbit at 1000 km above the earth.
Weather forecasting
A Geostationary satellite stays in the same place with respect to
earth all the time
A Polar orbiting satellite moves above the earth’s surface
Weather forecasting
Picture courtesy of the European Organisation for the Exploitation of Meteorological Satellites and photo
courtesy of Dundee University.
The URL ( Uniform Resource Locator ) www.sat.dundee.ac.uk/tour.html will tell
you more about satellites if you are interested
Meteosat: a geostationary satellite. It sends microwave signals back to earth.
The satellite’s signals are received by antennae.
©Eumetsat 2003
This is a Polar Orbiting Satellite
Weather forecasting
The satellite can take readings across the entire earth during the course of one day.
Sea
Weather forecasting
Radar systems are used here.
Radar stands for radio detection and ranging. Radio waves are transmitted, when they hit a rain cloud they bounce
back to earth and measurements can be taken.
Weather forecasting
There is a network of radar systems covering Britain.
This is a radar
station.
The computer and the forecaster receive data from the radar systems.
Radar measurements let the forecaster and the computer know if the radar has seen rain clouds.
Sea
Weather forecasting
There are weather ships out to sea
There are also buoys taking weathermeasurements in the sea
This is a Weather ship.
Weather forecasting
Buoys are used at sea more than weather ships these days. They send their data automatically back to the computer.
Thanks to www.gdfcartophily.co.uk
Weather forecasting
The Meteorological Office uses supercomputers. These are the largest computers in the world.
There will be a new supercomputer in the Met Office’s new location at Exeter.
The Met Office has re-located (moved) to Exeter from Bracknell.Bracknell is near London. Exeter is in the South Westof England.
• Bracknell
• Exeter
Weather forecasting
We store Gigabytes (one thousand million bytes 109) of data on the Hard drives in our school.Supercomputers have stores for Terabytes of data.
A Terabyte isone million, million bytes, 1012 bytes.
A supercomputer is a very large computer, which works very, very fast. It is about 1000 times more powerful than a PC.
It also has an enormous store (memory).
Weather forecasting
A supercomputer is a very large computer, which works very, very fast. It is about 1000 times more powerful than a PC
The Met Office supercomputers areMassively Parallel Processor machines.
It usually has many processors working in parallel to achieve the fast processing time.
Massively Parallel Processor machines use Parallel processing
Parallel processing is the simultaneous use of several processors to perform a single job. A job may be split into a number of tasks eachof which may be processed by any availableprocessor.
Weather forecasting
Weather forecasting
Parallel processing splits jobs up and gives different processors tasks. These all have
to be brought together.
When a computer usesseveral processors in parallel
it is known asparallel processing.
Parallel processing is difficult to program
Weather forecasting
How does parallel processing work?.
287 14 21
1*7
A
2*7
B
4*7 3*7
C D
Let’s give four processors A, B, C, D a sum each
Weather forecasting
If processor A did all four sums it would take longer.
Parallel processing is very complicatedto program but it does make it faster to do loads and loads of sums.
Massively Parallel Processor machines.
MPP systems use a distributed hierarchy of memory. This just means that they have to have a system of accessing the memory available.
MPP systems rely on very high bandwidth communications to move data between memory and between different processors so that they are all kept busy during program execution.
Weather forecasting
ReferencesReferences http://research.microsoft.com/users/gbell/http://research.microsoft.com/users/gbell/
craytalk/sld066.htmcraytalk/sld066.htm http://inventors.about.com/library/inventors/http://inventors.about.com/library/inventors/
blsupercomputer.htmblsupercomputer.htm http://americanhistory.si.edu/csr/comphist/http://americanhistory.si.edu/csr/comphist/
cray.htmcray.htm http://web.mit.edu/invent/iow/cray.htmlhttp://web.mit.edu/invent/iow/cray.html www.top500.orgwww.top500.org http://www.spikynorman.dsl.pipex.com/http://www.spikynorman.dsl.pipex.com/
CrayWWWStuff/CrayWWWStuff/ http://news.zdnet.co.uk/hardware/emergingtech/http://news.zdnet.co.uk/hardware/emergingtech/
0,39020357,39162182,00.htm0,39020357,39162182,00.htm
Top Related