The Free Lunch is Over
description
Transcript of The Free Lunch is Over
![Page 1: The Free Lunch is Over](https://reader034.fdocuments.us/reader034/viewer/2022042820/55cf992e550346d0339c0b92/html5/thumbnails/1.jpg)
The Free Lunch Is Over
![Page 2: The Free Lunch is Over](https://reader034.fdocuments.us/reader034/viewer/2022042820/55cf992e550346d0339c0b92/html5/thumbnails/2.jpg)
The Free Lunch Is OverA Fundamental Turn Toward Concurrency in Software
(By Herb Sutter)
![Page 4: The Free Lunch is Over](https://reader034.fdocuments.us/reader034/viewer/2022042820/55cf992e550346d0339c0b92/html5/thumbnails/4.jpg)
Agenda
• Moore's Law• Amdahl's law• Performance Factors• Free Lunch• Power Wall• Free Lunch is Over• Conclusion• Future• References
![Page 5: The Free Lunch is Over](https://reader034.fdocuments.us/reader034/viewer/2022042820/55cf992e550346d0339c0b92/html5/thumbnails/5.jpg)
Moors Law
![Page 6: The Free Lunch is Over](https://reader034.fdocuments.us/reader034/viewer/2022042820/55cf992e550346d0339c0b92/html5/thumbnails/6.jpg)
Moor’s Law
• Over the history of computing hardware, the number of transistors on integrated circuits doubles approximately every two years Transistor
Count
If the current trend continues to 2020, the number of
transistors would reach 32 billion.
![Page 7: The Free Lunch is Over](https://reader034.fdocuments.us/reader034/viewer/2022042820/55cf992e550346d0339c0b92/html5/thumbnails/7.jpg)
Amdahl's law
![Page 8: The Free Lunch is Over](https://reader034.fdocuments.us/reader034/viewer/2022042820/55cf992e550346d0339c0b92/html5/thumbnails/8.jpg)
Amdahl's law
The speedup of a program using multiple processors in parallel computing is limited by the sequential fraction of the program.
For example, if 95% of the program can be parallelized, the theoretical maximum speedup using parallel computing would
be 20× as shown in the diagram, no matter how many processors are used
![Page 9: The Free Lunch is Over](https://reader034.fdocuments.us/reader034/viewer/2022042820/55cf992e550346d0339c0b92/html5/thumbnails/9.jpg)
Performance Factors
![Page 10: The Free Lunch is Over](https://reader034.fdocuments.us/reader034/viewer/2022042820/55cf992e550346d0339c0b92/html5/thumbnails/10.jpg)
Performance Factors
Clock Speed
Execution Optimization
Cache
![Page 11: The Free Lunch is Over](https://reader034.fdocuments.us/reader034/viewer/2022042820/55cf992e550346d0339c0b92/html5/thumbnails/11.jpg)
Free Lunch
What Free Lunch Is Actually?
![Page 12: The Free Lunch is Over](https://reader034.fdocuments.us/reader034/viewer/2022042820/55cf992e550346d0339c0b92/html5/thumbnails/12.jpg)
Free Lunch
Programmers haven't really had to worry much about performance or concurrency because of Moore's Law
The traditional approach to application performance was to simply wait for the next generation of processor; most software developers did not need to invest in performance tuning, and enjoyed a “free lunch” from hardware improvements.
Why we did not see 4GHz processors in Market?
![Page 13: The Free Lunch is Over](https://reader034.fdocuments.us/reader034/viewer/2022042820/55cf992e550346d0339c0b92/html5/thumbnails/13.jpg)
Power Wall
![Page 14: The Free Lunch is Over](https://reader034.fdocuments.us/reader034/viewer/2022042820/55cf992e550346d0339c0b92/html5/thumbnails/14.jpg)
Power Wall
![Page 15: The Free Lunch is Over](https://reader034.fdocuments.us/reader034/viewer/2022042820/55cf992e550346d0339c0b92/html5/thumbnails/15.jpg)
![Page 16: The Free Lunch is Over](https://reader034.fdocuments.us/reader034/viewer/2022042820/55cf992e550346d0339c0b92/html5/thumbnails/16.jpg)
Power Wall
![Page 17: The Free Lunch is Over](https://reader034.fdocuments.us/reader034/viewer/2022042820/55cf992e550346d0339c0b92/html5/thumbnails/17.jpg)
Power Wall
This Free Lunch is Over Right Now…
![Page 18: The Free Lunch is Over](https://reader034.fdocuments.us/reader034/viewer/2022042820/55cf992e550346d0339c0b92/html5/thumbnails/18.jpg)
Free Lunch is Over
Your free lunch will soon be over. What can you do about it? What are you doing about it?
![Page 19: The Free Lunch is Over](https://reader034.fdocuments.us/reader034/viewer/2022042820/55cf992e550346d0339c0b92/html5/thumbnails/19.jpg)
The major processor manufacturers and architectures, from Intel and AMD to Sparc and PowerPC, have run out of room with most of their traditional approaches to boosting CPU performance. Instead of driving clock speeds and straight-line instruction throughput ever higher, they are instead turning toward hyper threading and multicore architectures
Chip designers are under so much pressure to deliver ever-faster CPUs that they’ll risk changing the meaning of your program, and possibly break it, in order to make it run faster
![Page 20: The Free Lunch is Over](https://reader034.fdocuments.us/reader034/viewer/2022042820/55cf992e550346d0339c0b92/html5/thumbnails/20.jpg)
Conclusion
![Page 21: The Free Lunch is Over](https://reader034.fdocuments.us/reader034/viewer/2022042820/55cf992e550346d0339c0b92/html5/thumbnails/21.jpg)
The free lunch is over Performance Free Lunch
Moore’s law has changedFuturists such as Ray Kurzweil, Bruce Sterling, and Vernor Vinge believe that the
exponential improvement described by Moore's law will ultimately lead to a technological singularity: a period where progress in technology occurs almost instantly.
Amdahl’s law demands shift in software concepts
Factors Hyper threading Multicore Cache
![Page 22: The Free Lunch is Over](https://reader034.fdocuments.us/reader034/viewer/2022042820/55cf992e550346d0339c0b92/html5/thumbnails/22.jpg)
Future
![Page 23: The Free Lunch is Over](https://reader034.fdocuments.us/reader034/viewer/2022042820/55cf992e550346d0339c0b92/html5/thumbnails/23.jpg)
![Page 24: The Free Lunch is Over](https://reader034.fdocuments.us/reader034/viewer/2022042820/55cf992e550346d0339c0b92/html5/thumbnails/24.jpg)
![Page 25: The Free Lunch is Over](https://reader034.fdocuments.us/reader034/viewer/2022042820/55cf992e550346d0339c0b92/html5/thumbnails/25.jpg)
![Page 26: The Free Lunch is Over](https://reader034.fdocuments.us/reader034/viewer/2022042820/55cf992e550346d0339c0b92/html5/thumbnails/26.jpg)
Now ball is in programmers court
![Page 27: The Free Lunch is Over](https://reader034.fdocuments.us/reader034/viewer/2022042820/55cf992e550346d0339c0b92/html5/thumbnails/27.jpg)
-> With multicore processors, programs written in sequential mode will no longer surf on the wave of this generation processors.
-> To surf in new wave, programs need to be well written parallel.
-> Programming language and system will increasingly be forced to deal well with concurrency.
-> Concurrency is the next major revolution in how we write software.
-> Applications will increasingly need to be concurrent if they want to fully exploit continuing exponential CPU throughput gains.
-> Efficiency and performance optimization will get more, not less, important.
![Page 28: The Free Lunch is Over](https://reader034.fdocuments.us/reader034/viewer/2022042820/55cf992e550346d0339c0b92/html5/thumbnails/28.jpg)
New Law
Only Parallel Applications Will Survive
![Page 29: The Free Lunch is Over](https://reader034.fdocuments.us/reader034/viewer/2022042820/55cf992e550346d0339c0b92/html5/thumbnails/29.jpg)
References
![Page 30: The Free Lunch is Over](https://reader034.fdocuments.us/reader034/viewer/2022042820/55cf992e550346d0339c0b92/html5/thumbnails/30.jpg)
References
The Free Lunch Is Over By Herb Sutter
A Fundamental Turn Toward Concurrency in Software
The Free Lunch Is Over By Ricardo Hermann , Thadeo Carmo
Developing Concurrent Software
Is the free lunch really over? Scalability in Many-core Systems By Michael Wrinn
The Price of Free LunchProgramming in Multicore Era
![Page 31: The Free Lunch is Over](https://reader034.fdocuments.us/reader034/viewer/2022042820/55cf992e550346d0339c0b92/html5/thumbnails/31.jpg)
Any Question?