Energy Efficient Web Server Cluster
description
Transcript of Energy Efficient Web Server Cluster
![Page 1: Energy Efficient Web Server Cluster](https://reader036.fdocuments.us/reader036/viewer/2022062517/56813a6c550346895da26539/html5/thumbnails/1.jpg)
Energy Efficient Web Server Cluster
Andrew Krioukov, Sara Alspaugh, Laura Keys, David Culler, Randy Katz
![Page 2: Energy Efficient Web Server Cluster](https://reader036.fdocuments.us/reader036/viewer/2022062517/56813a6c550346895da26539/html5/thumbnails/2.jpg)
Doublingin 5 years
(EPA Report on Server and Data Center Energy Efficiency, 2007)
$7.2 billion
Energy consumption in data centers
![Page 3: Energy Efficient Web Server Cluster](https://reader036.fdocuments.us/reader036/viewer/2022062517/56813a6c550346895da26539/html5/thumbnails/3.jpg)
Web Applications
Database / SAN
Database / SAN
Web AppWeb AppWeb ServerWeb ServerFrontend
/Load Balancer
Frontend /Load
Balancer Web ServerWeb ServerWeb ServerWeb Server Web AppWeb App
Web AppWeb AppWeb AppWeb App
ClientsClients
![Page 4: Energy Efficient Web Server Cluster](https://reader036.fdocuments.us/reader036/viewer/2022062517/56813a6c550346895da26539/html5/thumbnails/4.jpg)
Core i7
50% Idle Power
![Page 5: Energy Efficient Web Server Cluster](https://reader036.fdocuments.us/reader036/viewer/2022062517/56813a6c550346895da26539/html5/thumbnails/5.jpg)
Atom
80% Idle Power
![Page 6: Energy Efficient Web Server Cluster](https://reader036.fdocuments.us/reader036/viewer/2022062517/56813a6c550346895da26539/html5/thumbnails/6.jpg)
Server energy consumption
Idle
Sleep / Off
Active
![Page 7: Energy Efficient Web Server Cluster](https://reader036.fdocuments.us/reader036/viewer/2022062517/56813a6c550346895da26539/html5/thumbnails/7.jpg)
Server energy efficiency
Perc
ent E
ffici
ency
Energy Efficiency = Work / Energy
![Page 8: Energy Efficient Web Server Cluster](https://reader036.fdocuments.us/reader036/viewer/2022062517/56813a6c550346895da26539/html5/thumbnails/8.jpg)
Power Proportional Server
![Page 9: Energy Efficient Web Server Cluster](https://reader036.fdocuments.us/reader036/viewer/2022062517/56813a6c550346895da26539/html5/thumbnails/9.jpg)
Problem• Servers are energy efficient at high utilization• Typical server utilization is low– Google: average server utilization 30%
![Page 10: Energy Efficient Web Server Cluster](https://reader036.fdocuments.us/reader036/viewer/2022062517/56813a6c550346895da26539/html5/thumbnails/10.jpg)
Google CPU Utilization
The Case for Energy-Proportional ComputingLuiz Barroso, Urs Holzle 2007
5,000 servers at Google during a six-month period
![Page 11: Energy Efficient Web Server Cluster](https://reader036.fdocuments.us/reader036/viewer/2022062517/56813a6c550346895da26539/html5/thumbnails/11.jpg)
Solutions
• Make servers power proportional– Requires fixing hardware & software
• Make power proportional cluster– Run nodes at high utilization or “off”– Consolidate workload
![Page 12: Energy Efficient Web Server Cluster](https://reader036.fdocuments.us/reader036/viewer/2022062517/56813a6c550346895da26539/html5/thumbnails/12.jpg)
Web Servers
• Stateless• Short requests• Requests can be served by multiple machines• Large variation in load
![Page 13: Energy Efficient Web Server Cluster](https://reader036.fdocuments.us/reader036/viewer/2022062517/56813a6c550346895da26539/html5/thumbnails/13.jpg)
Web Server Load
ISP web server trace from Internet Traffic Archive
![Page 14: Energy Efficient Web Server Cluster](https://reader036.fdocuments.us/reader036/viewer/2022062517/56813a6c550346895da26539/html5/thumbnails/14.jpg)
Cluster Architecture
![Page 15: Energy Efficient Web Server Cluster](https://reader036.fdocuments.us/reader036/viewer/2022062517/56813a6c550346895da26539/html5/thumbnails/15.jpg)
Atom Nodes
• Intel Atom 330 with 945CG chipset• 1.6 GHz, 2 cores• CPU spec sheet TDP: 8W• Chipset spec sheet TDP: 22.2W
![Page 16: Energy Efficient Web Server Cluster](https://reader036.fdocuments.us/reader036/viewer/2022062517/56813a6c550346895da26539/html5/thumbnails/16.jpg)
Atom Nodes• Power states:– Active– Idle: CPU enters C-states– Sleep: Suspend to RAM– Off
Power (Watts) Time to Resume (seconds)
Active 22 – 24 W -
Idle 22.08 W 0 s
Sleep 1.6 W 2.5 s
Off 0 W 61 s
![Page 17: Energy Efficient Web Server Cluster](https://reader036.fdocuments.us/reader036/viewer/2022062517/56813a6c550346895da26539/html5/thumbnails/17.jpg)
Node Performance
Max request rate
![Page 18: Energy Efficient Web Server Cluster](https://reader036.fdocuments.us/reader036/viewer/2022062517/56813a6c550346895da26539/html5/thumbnails/18.jpg)
Scheduler Algorithm
• Keep awake desired_servers• Put servers to sleep after a timeout
![Page 19: Energy Efficient Web Server Cluster](https://reader036.fdocuments.us/reader036/viewer/2022062517/56813a6c550346895da26539/html5/thumbnails/19.jpg)
Evaluation• Httperf workload generator• Synthetic workload– Request files in Zipf distribution– Ramp request rate up and down
• Working on using real web server traces
![Page 20: Energy Efficient Web Server Cluster](https://reader036.fdocuments.us/reader036/viewer/2022062517/56813a6c550346895da26539/html5/thumbnails/20.jpg)
Throughput
![Page 21: Energy Efficient Web Server Cluster](https://reader036.fdocuments.us/reader036/viewer/2022062517/56813a6c550346895da26539/html5/thumbnails/21.jpg)
Energy Savings
Simple Load Balancer Power Aware Cluster Manager
![Page 22: Energy Efficient Web Server Cluster](https://reader036.fdocuments.us/reader036/viewer/2022062517/56813a6c550346895da26539/html5/thumbnails/22.jpg)
Load per Server
![Page 23: Energy Efficient Web Server Cluster](https://reader036.fdocuments.us/reader036/viewer/2022062517/56813a6c550346895da26539/html5/thumbnails/23.jpg)
Future Work
• Heterogeneous hardware– Small nodes for low utilization
• Adjust to changes in request types– Dynamic vs. static requests– Adjust max requests per server
![Page 24: Energy Efficient Web Server Cluster](https://reader036.fdocuments.us/reader036/viewer/2022062517/56813a6c550346895da26539/html5/thumbnails/24.jpg)
Questions
![Page 25: Energy Efficient Web Server Cluster](https://reader036.fdocuments.us/reader036/viewer/2022062517/56813a6c550346895da26539/html5/thumbnails/25.jpg)
Adjust to request types
![Page 26: Energy Efficient Web Server Cluster](https://reader036.fdocuments.us/reader036/viewer/2022062517/56813a6c550346895da26539/html5/thumbnails/26.jpg)
Power vs. server cost
In the data center, power and cooling costs more than the IT equipment it supportsChristian L. Belady, HP 2007
![Page 27: Energy Efficient Web Server Cluster](https://reader036.fdocuments.us/reader036/viewer/2022062517/56813a6c550346895da26539/html5/thumbnails/27.jpg)
Saving Energy
• Turn off unused resources– Use lower states
• Improve power in states
Active
Idle
Sleep
Power
Off