Introduction to P arallel Computing
description
Transcript of Introduction to P arallel Computing
![Page 1: Introduction to P arallel Computing](https://reader035.fdocuments.us/reader035/viewer/2022062222/56816385550346895dd46d94/html5/thumbnails/1.jpg)
Introduction to Parallel Computing
![Page 2: Introduction to P arallel Computing](https://reader035.fdocuments.us/reader035/viewer/2022062222/56816385550346895dd46d94/html5/thumbnails/2.jpg)
Serial Computing
![Page 3: Introduction to P arallel Computing](https://reader035.fdocuments.us/reader035/viewer/2022062222/56816385550346895dd46d94/html5/thumbnails/3.jpg)
Parallel Computing
![Page 4: Introduction to P arallel Computing](https://reader035.fdocuments.us/reader035/viewer/2022062222/56816385550346895dd46d94/html5/thumbnails/4.jpg)
![Page 5: Introduction to P arallel Computing](https://reader035.fdocuments.us/reader035/viewer/2022062222/56816385550346895dd46d94/html5/thumbnails/5.jpg)
![Page 6: Introduction to P arallel Computing](https://reader035.fdocuments.us/reader035/viewer/2022062222/56816385550346895dd46d94/html5/thumbnails/6.jpg)
Why Parallel Computing?
![Page 7: Introduction to P arallel Computing](https://reader035.fdocuments.us/reader035/viewer/2022062222/56816385550346895dd46d94/html5/thumbnails/7.jpg)
The Power Wall
![Page 8: Introduction to P arallel Computing](https://reader035.fdocuments.us/reader035/viewer/2022062222/56816385550346895dd46d94/html5/thumbnails/8.jpg)
The Single-Core Performance Wall
![Page 9: Introduction to P arallel Computing](https://reader035.fdocuments.us/reader035/viewer/2022062222/56816385550346895dd46d94/html5/thumbnails/9.jpg)
“The major processor manufacturers and architectures, from Intel and AMD to Sparc and PowerPC, have run out of room with most of their traditional approaches to boosting CPU performance. Instead of driving clock speeds and straight-line instruction throughput ever higher, they are instead turning en masse to hyperthreading and multicore architectures.”
The Free Lunch Is Over A Fundamental Turn Toward Concurrency in SoftwareBy Herb Sutter
![Page 10: Introduction to P arallel Computing](https://reader035.fdocuments.us/reader035/viewer/2022062222/56816385550346895dd46d94/html5/thumbnails/10.jpg)
The Future
![Page 11: Introduction to P arallel Computing](https://reader035.fdocuments.us/reader035/viewer/2022062222/56816385550346895dd46d94/html5/thumbnails/11.jpg)
Why Learn Parallel Computing?
• Entertainment Industry• Performance Challenge• Massive Data• Real-time Analytics• Algorithmic Opportunities
![Page 12: Introduction to P arallel Computing](https://reader035.fdocuments.us/reader035/viewer/2022062222/56816385550346895dd46d94/html5/thumbnails/12.jpg)
Entertainment Industry
![Page 13: Introduction to P arallel Computing](https://reader035.fdocuments.us/reader035/viewer/2022062222/56816385550346895dd46d94/html5/thumbnails/13.jpg)
Performance Challenge
Advanced research has moved beyond the capacity of a single computer for detailed multi-level simulations, data analysis, and large-scale computations.
Electron localization function in the cubic NaCl3 structure.
![Page 14: Introduction to P arallel Computing](https://reader035.fdocuments.us/reader035/viewer/2022062222/56816385550346895dd46d94/html5/thumbnails/14.jpg)
Massive Data
![Page 15: Introduction to P arallel Computing](https://reader035.fdocuments.us/reader035/viewer/2022062222/56816385550346895dd46d94/html5/thumbnails/15.jpg)
Real-time Analytics
![Page 16: Introduction to P arallel Computing](https://reader035.fdocuments.us/reader035/viewer/2022062222/56816385550346895dd46d94/html5/thumbnails/16.jpg)
Algorithmic Opportunities
Different molecular forces cause proteins to fold into unique, complex shapes. (Image courtesy of Justin MacCallum, Stony Brook University)
![Page 17: Introduction to P arallel Computing](https://reader035.fdocuments.us/reader035/viewer/2022062222/56816385550346895dd46d94/html5/thumbnails/17.jpg)
Examples of Parallel Computing
![Page 18: Introduction to P arallel Computing](https://reader035.fdocuments.us/reader035/viewer/2022062222/56816385550346895dd46d94/html5/thumbnails/18.jpg)
Summary
• The computers of today, and tomorrow, have tremendous processing power that require parallel programming to fully utilize.
• There are significant differences between sequential and parallel programming, that can be challenging.
• With early exposure to these differences, students are capable of achieving performance improvements with multicore programming.