Convergence Lessons: Big Data and HPC - Post H2020...Convergence Lessons: Big Data and HPC...
Transcript of Convergence Lessons: Big Data and HPC - Post H2020...Convergence Lessons: Big Data and HPC...
![Page 1: Convergence Lessons: Big Data and HPC - Post H2020...Convergence Lessons: Big Data and HPC dan.reed@utah.edu Flammarion engraving Meetings Roadmap Meetings Questions Participants •](https://reader033.fdocuments.us/reader033/viewer/2022053000/5f046af97e708231d40dde70/html5/thumbnails/1.jpg)
Convergence Lessons: Big Data and HPC
www.hpcdan.org
![Page 2: Convergence Lessons: Big Data and HPC - Post H2020...Convergence Lessons: Big Data and HPC dan.reed@utah.edu Flammarion engraving Meetings Roadmap Meetings Questions Participants •](https://reader033.fdocuments.us/reader033/viewer/2022053000/5f046af97e708231d40dde70/html5/thumbnails/2.jpg)
Meetings Roadmap
Meetings Questions
Participants• The “usual suspects”
IoT/Edge, Big instruments Big dataAI, extreme computing, clouds
Missing participants• Deep learning community• New science demands• Infrastructure providersShifting landscape• Infrastructure capabilities• Science expectations
![Page 3: Convergence Lessons: Big Data and HPC - Post H2020...Convergence Lessons: Big Data and HPC dan.reed@utah.edu Flammarion engraving Meetings Roadmap Meetings Questions Participants •](https://reader033.fdocuments.us/reader033/viewer/2022053000/5f046af97e708231d40dde70/html5/thumbnails/3.jpg)
Success breeds complacency. Complacency breeds failure. Only the paranoid survive.
Andy Grove, Intel
![Page 4: Convergence Lessons: Big Data and HPC - Post H2020...Convergence Lessons: Big Data and HPC dan.reed@utah.edu Flammarion engraving Meetings Roadmap Meetings Questions Participants •](https://reader033.fdocuments.us/reader033/viewer/2022053000/5f046af97e708231d40dde70/html5/thumbnails/4.jpg)
The purpose of computing is insight, not numbers.
Richard Hamming
![Page 5: Convergence Lessons: Big Data and HPC - Post H2020...Convergence Lessons: Big Data and HPC dan.reed@utah.edu Flammarion engraving Meetings Roadmap Meetings Questions Participants •](https://reader033.fdocuments.us/reader033/viewer/2022053000/5f046af97e708231d40dde70/html5/thumbnails/5.jpg)
NCSA Cray X-MP (1985)$8,000,000 and 56 Kb/s NSFnet
800 megaflops (peak)(~$18M in 2018 dollars)
iPhone 8 (2018)
~$500M
Viability determined by
… and their ratios
![Page 6: Convergence Lessons: Big Data and HPC - Post H2020...Convergence Lessons: Big Data and HPC dan.reed@utah.edu Flammarion engraving Meetings Roadmap Meetings Questions Participants •](https://reader033.fdocuments.us/reader033/viewer/2022053000/5f046af97e708231d40dde70/html5/thumbnails/6.jpg)
What information consumes is rather obvious: it consumes the attention of its recipients. Hence a wealth of information creates a poverty of attention, and a need to allocate that attention efficiently among the overabundance of information sources that might consume it.
Herbert Simon
Dan Ariely (Duke)
![Page 7: Convergence Lessons: Big Data and HPC - Post H2020...Convergence Lessons: Big Data and HPC dan.reed@utah.edu Flammarion engraving Meetings Roadmap Meetings Questions Participants •](https://reader033.fdocuments.us/reader033/viewer/2022053000/5f046af97e708231d40dde70/html5/thumbnails/7.jpg)
$0$100$200$300$400$500$600$700$800$900
$1.000
![Page 8: Convergence Lessons: Big Data and HPC - Post H2020...Convergence Lessons: Big Data and HPC dan.reed@utah.edu Flammarion engraving Meetings Roadmap Meetings Questions Participants •](https://reader033.fdocuments.us/reader033/viewer/2022053000/5f046af97e708231d40dde70/html5/thumbnails/8.jpg)
![Page 9: Convergence Lessons: Big Data and HPC - Post H2020...Convergence Lessons: Big Data and HPC dan.reed@utah.edu Flammarion engraving Meetings Roadmap Meetings Questions Participants •](https://reader033.fdocuments.us/reader033/viewer/2022053000/5f046af97e708231d40dde70/html5/thumbnails/9.jpg)
HPC
Deep Learning
Edge & AI
![Page 10: Convergence Lessons: Big Data and HPC - Post H2020...Convergence Lessons: Big Data and HPC dan.reed@utah.edu Flammarion engraving Meetings Roadmap Meetings Questions Participants •](https://reader033.fdocuments.us/reader033/viewer/2022053000/5f046af97e708231d40dde70/html5/thumbnails/10.jpg)
Size Nano Micro Milli Server Fog Campus FacilityExample Adafruit
TrinketParticle.io
BoronArray ofThings Linux Box Co-located
Blades1000-node
clusterDatacenter& Exascale
Memory 0.5 KB 256 KB 8 GB 32 GB 256 GB 32 TB 16 PBNetwork BLE WiFi/LTE WiFi/LTE 1 GigE 10GigE 40GigE N*100GigE
Cost $5 $30 $600 $3K $50K $2M $1000M
Edge HPC/Cloud/InstrumentFog
Count x Complexity = ~Constant Stateful vs. Stateless
![Page 11: Convergence Lessons: Big Data and HPC - Post H2020...Convergence Lessons: Big Data and HPC dan.reed@utah.edu Flammarion engraving Meetings Roadmap Meetings Questions Participants •](https://reader033.fdocuments.us/reader033/viewer/2022053000/5f046af97e708231d40dde70/html5/thumbnails/11.jpg)
The very small (edge computing and sensors)The very large (clouds, exascale, and big data)
Technical implications
Economic implications
Cultural implications
See the whole board
![Page 12: Convergence Lessons: Big Data and HPC - Post H2020...Convergence Lessons: Big Data and HPC dan.reed@utah.edu Flammarion engraving Meetings Roadmap Meetings Questions Participants •](https://reader033.fdocuments.us/reader033/viewer/2022053000/5f046af97e708231d40dde70/html5/thumbnails/12.jpg)
Microsoft Quincy Data Center
![Page 13: Convergence Lessons: Big Data and HPC - Post H2020...Convergence Lessons: Big Data and HPC dan.reed@utah.edu Flammarion engraving Meetings Roadmap Meetings Questions Participants •](https://reader033.fdocuments.us/reader033/viewer/2022053000/5f046af97e708231d40dde70/html5/thumbnails/13.jpg)
13
Amazon Deep Lens
Movidius (Intel) Neural Compute Stick• Custom Vision Processing Unit (VPU) • TensorFlow and Caffe support
![Page 14: Convergence Lessons: Big Data and HPC - Post H2020...Convergence Lessons: Big Data and HPC dan.reed@utah.edu Flammarion engraving Meetings Roadmap Meetings Questions Participants •](https://reader033.fdocuments.us/reader033/viewer/2022053000/5f046af97e708231d40dde70/html5/thumbnails/14.jpg)
Differing cultures and tools
Adopting new infrastructure
Stream/batch model co-existence
Computing needs at the edge
![Page 15: Convergence Lessons: Big Data and HPC - Post H2020...Convergence Lessons: Big Data and HPC dan.reed@utah.edu Flammarion engraving Meetings Roadmap Meetings Questions Participants •](https://reader033.fdocuments.us/reader033/viewer/2022053000/5f046af97e708231d40dde70/html5/thumbnails/15.jpg)
It’s a buzzword and an approach …
Enabled by
Source: nVIDIA
![Page 16: Convergence Lessons: Big Data and HPC - Post H2020...Convergence Lessons: Big Data and HPC dan.reed@utah.edu Flammarion engraving Meetings Roadmap Meetings Questions Participants •](https://reader033.fdocuments.us/reader033/viewer/2022053000/5f046af97e708231d40dde70/html5/thumbnails/16.jpg)
ReducedModel
ComputationalModel
ReducedModel
SpiralGalaxy
![Page 18: Convergence Lessons: Big Data and HPC - Post H2020...Convergence Lessons: Big Data and HPC dan.reed@utah.edu Flammarion engraving Meetings Roadmap Meetings Questions Participants •](https://reader033.fdocuments.us/reader033/viewer/2022053000/5f046af97e708231d40dde70/html5/thumbnails/18.jpg)
Use10,000 ~$10 wireless sensors?
… and the data from them?
Kang, Kuhl, Bockholt, Rogers, and Reed, “A Cloud-Based Scientific Gateway for Internet of Things Data Analytics,” PEARC18, to appear
![Page 19: Convergence Lessons: Big Data and HPC - Post H2020...Convergence Lessons: Big Data and HPC dan.reed@utah.edu Flammarion engraving Meetings Roadmap Meetings Questions Participants •](https://reader033.fdocuments.us/reader033/viewer/2022053000/5f046af97e708231d40dde70/html5/thumbnails/19.jpg)
Edge/Edge HPC/Cloud/InstrumentFogStateful
Stateless
![Page 20: Convergence Lessons: Big Data and HPC - Post H2020...Convergence Lessons: Big Data and HPC dan.reed@utah.edu Flammarion engraving Meetings Roadmap Meetings Questions Participants •](https://reader033.fdocuments.us/reader033/viewer/2022053000/5f046af97e708231d40dde70/html5/thumbnails/20.jpg)
ExistingResources& Services
ContinuumAbstractModel &Runtime
Goal-orientedAnnotations
NotionalExample:
Science-drivenProblems
e.g.: “Predict urban response to rainfall, trigger intelligent reaction…”
trigger {flood_actuation, resident_warning} when {wx_prediction, sewer_model} implies
(traffic_capacity < 70%) or (home_flooding > 5%)
![Page 21: Convergence Lessons: Big Data and HPC - Post H2020...Convergence Lessons: Big Data and HPC dan.reed@utah.edu Flammarion engraving Meetings Roadmap Meetings Questions Participants •](https://reader033.fdocuments.us/reader033/viewer/2022053000/5f046af97e708231d40dde70/html5/thumbnails/21.jpg)
![Page 22: Convergence Lessons: Big Data and HPC - Post H2020...Convergence Lessons: Big Data and HPC dan.reed@utah.edu Flammarion engraving Meetings Roadmap Meetings Questions Participants •](https://reader033.fdocuments.us/reader033/viewer/2022053000/5f046af97e708231d40dde70/html5/thumbnails/22.jpg)
22
0
1000
2000
3000
4000
5000
6000
7000
8000
1903
1910
1917
1924
1931
1938
1945
1952
1959
1966
1973
Aircraft innovation shifted …• Capacity, range, safety• Yield management (ugh)• Avionics, fuel efficiency, composites… but it has never stoppedComputing and networking loci are also shifting
![Page 23: Convergence Lessons: Big Data and HPC - Post H2020...Convergence Lessons: Big Data and HPC dan.reed@utah.edu Flammarion engraving Meetings Roadmap Meetings Questions Participants •](https://reader033.fdocuments.us/reader033/viewer/2022053000/5f046af97e708231d40dde70/html5/thumbnails/23.jpg)
James Webb Space Telescope (JWST)
New Worlds New Horizons: A Midterm Assessment
If this sounds familiar, it should …
https://uiowa.edu/nsfcyberinfrastructure
JWST
August 2016