Power Management of Online Data Intensive Services Meisner et al.
-
Upload
myles-higgins -
Category
Documents
-
view
222 -
download
5
Transcript of Power Management of Online Data Intensive Services Meisner et al.
![Page 1: Power Management of Online Data Intensive Services Meisner et al.](https://reader035.fdocuments.us/reader035/viewer/2022062407/56649dbb5503460f94aac836/html5/thumbnails/1.jpg)
Power Management of Online Data Intensive Services
Meisner et al
![Page 2: Power Management of Online Data Intensive Services Meisner et al.](https://reader035.fdocuments.us/reader035/viewer/2022062407/56649dbb5503460f94aac836/html5/thumbnails/2.jpg)
Characteristics of OLDI
2 04/19/23
• Large search, online advertising, machine learning
• User queries that must interact with lots of data
• Responsiveness is important (as opposed to Map-Reduce)
• Sub-seconds responsiveness
• Diurnal variations do not lead to energy-proportionality
• Systems rarely completely idle
• Power management is challenging with the latency
sensitivity and scale
• Energy proportionality means energy proportional to load
![Page 3: Power Management of Online Data Intensive Services Meisner et al.](https://reader035.fdocuments.us/reader035/viewer/2022062407/56649dbb5503460f94aac836/html5/thumbnails/3.jpg)
Objectives
3 04/19/23
• OLDI energy proportionality with Proc, Mem and Disk
• Production web-search workload at cluster-wide scale
• Fine-grain characterization
• Identify Power-saving opportunities
• Identify challenges in power management
• Develop and validate a perf model that evaluates
impact of proc and mem low power modes
• Production google server – 1000 server cluster level
• Idle low power modes versus active low power modes
![Page 4: Power Management of Online Data Intensive Services Meisner et al.](https://reader035.fdocuments.us/reader035/viewer/2022062407/56649dbb5503460f94aac836/html5/thumbnails/4.jpg)
Power Down Modes - Example
Modes control clock frequency, VDD, or both– Active mode: maximum power consumption
• Full clock frequency at max VDD
– Doze mode: ~10X power reduction from active mode• Core clock stopped
– Nap mode: ~ 50% power reduction from doze mode
• VDD reduced, PLL & bus snooping stopped
– Sleep mode: ~10X power reduction from nap mode
• All clocks stopped, core VDD shut-off
Issues and Tradeoffs– Determining appropriate modes and appropriate controls
– Trading-off power reduction to wake-up time
[Ref: S. Gary, D&T’94]
![Page 5: Power Management of Online Data Intensive Services Meisner et al.](https://reader035.fdocuments.us/reader035/viewer/2022062407/56649dbb5503460f94aac836/html5/thumbnails/5.jpg)
Clock Gating, Data Gating
Primary objective: minimize feff
Clock gating
– Reduces / inhibits unnecessary clocking
• Registers need not be clocked if data input hasn’t changed
Data gating
– Prevents nets from toggling when results won’t be used
• Reduces wasted operations
![Page 6: Power Management of Online Data Intensive Services Meisner et al.](https://reader035.fdocuments.us/reader035/viewer/2022062407/56649dbb5503460f94aac836/html5/thumbnails/6.jpg)
Clock Gating
Local Gating Global Gating
clkqn
qd doutdin
en
clk
clkqn
qd doutdin
en
clk
FSM
Execution
Unit
Memory
Controlclk
enM
enE
enF
Power is reduced by two mechanisms–Clock net toggles less frequently, reducing feff
–Registers’ internal clock buffering switches less often
![Page 7: Power Management of Online Data Intensive Services Meisner et al.](https://reader035.fdocuments.us/reader035/viewer/2022062407/56649dbb5503460f94aac836/html5/thumbnails/7.jpg)
Power Gating (also called Core Parking) Objective
– Reduce leakage currents by inserting a switch transistor (usually high VTH) into the logic stack (usually low VTH)
• Switch transistors change the bias points (VSB) of the logic transistors
Most effective for systems with standby operational modes
– 1 to 3 orders of magnitude leakage reduction possible
– But switches add many complications
Virtual
Ground
sleep
Vdd
Logic
Cell
Switch
Cell
Vdd
Logic
Cell
![Page 8: Power Management of Online Data Intensive Services Meisner et al.](https://reader035.fdocuments.us/reader035/viewer/2022062407/56649dbb5503460f94aac836/html5/thumbnails/8.jpg)
C States and P states ACPI = Advanced Config and Power Interface
•Idle low power states = C-states
•C6 = power gating
•Active low power staes = P-states
![Page 9: Power Management of Online Data Intensive Services Meisner et al.](https://reader035.fdocuments.us/reader035/viewer/2022062407/56649dbb5503460f94aac836/html5/thumbnails/9.jpg)
Linux DVFS governors (On-demand, ladder etc)
Linux On-demand frequency Governor pseudocode
(Util = Time_active /(Time_active + Time_idle)
1 # d e f i n e u p _ t h r e s h o l d 0 . 9 0
2 f o r ( e a c h s a m p l i n g i n t e r v a l ) {
3 i f ( u t i l i z a t i o n > u p _ t h r e s h o l d )
4 f r e q = m a x _ f r e q ;
5 e l s e
6 f r e q = n e x t _ l o w e r _ f r e q ;
7 }9 04/19/23
![Page 10: Power Management of Online Data Intensive Services Meisner et al.](https://reader035.fdocuments.us/reader035/viewer/2022062407/56649dbb5503460f94aac836/html5/thumbnails/10.jpg)
Past observations
10 04/19/23
• Lightly loaded servers –
• good energy proportionality by idle low power modes
• Technique works well if average utilization low
• Energy proportionality at cluster level possible by
• VM migration and selective power-down of servers
• Servers and OLDI services are different
• OLDI rarely completely idle
![Page 11: Power Management of Online Data Intensive Services Meisner et al.](https://reader035.fdocuments.us/reader035/viewer/2022062407/56649dbb5503460f94aac836/html5/thumbnails/11.jpg)
11
Core-Level Activity Prediction, Bircher&John2011
E-Learning Productivity Video Creation 3DPredictive
(PPPP)
Reactive
(Vista)
Predictive
(PPPP)
Reactive
(Vista)
Predictive
(PPPP)
Reactive
(Vista)
Predictive
(PPPP)
Reactive
(Vista)Active Frequency
(GHz)1.72 1.56 1.47 1.34 1.65 1.51 1.92 1.77
Idle Frequency (GHz)
1.01 1.24 0.94 1.07 1.01 1.20 1.07 1.32
Vista reactive p-state algorithm often over or under provisions core frequency.
Our predictive p-state selection algorithm reduces core power consumption by 5.4% and increases performance by 3.8%
SYSMARK
Lloyd Bircher and Lizy K. John, Core-Level Activity Prediction for Multi-Core Power Management, IEEE Journal on Emerging and Selected Topics in Circuits and Systems
(JETCAS), September 2011, pp. 218-227.
![Page 12: Power Management of Online Data Intensive Services Meisner et al.](https://reader035.fdocuments.us/reader035/viewer/2022062407/56649dbb5503460f94aac836/html5/thumbnails/12.jpg)
Conclusions
12 04/19/23
• CPU active low-power modes good but not sufficient
• for energy-proportionality
• CPU idle low-power modes good at core level, but not enough
• for shared caches and on-chip memory controllers
• Ample underutilization in memory and so opportunity in memory
• with active low-power modes
• Power-Nap (useful for data-center workloads) ineffective for OLDI
• Energy-proportionality for OLDI with acceptable query latency
• only with full-system active low-power modes
![Page 13: Power Management of Online Data Intensive Services Meisner et al.](https://reader035.fdocuments.us/reader035/viewer/2022062407/56649dbb5503460f94aac836/html5/thumbnails/13.jpg)
13 04/19/23
![Page 14: Power Management of Online Data Intensive Services Meisner et al.](https://reader035.fdocuments.us/reader035/viewer/2022062407/56649dbb5503460f94aac836/html5/thumbnails/14.jpg)
14 04/19/23
![Page 15: Power Management of Online Data Intensive Services Meisner et al.](https://reader035.fdocuments.us/reader035/viewer/2022062407/56649dbb5503460f94aac836/html5/thumbnails/15.jpg)
15 04/19/23
![Page 16: Power Management of Online Data Intensive Services Meisner et al.](https://reader035.fdocuments.us/reader035/viewer/2022062407/56649dbb5503460f94aac836/html5/thumbnails/16.jpg)
16 04/19/23
![Page 17: Power Management of Online Data Intensive Services Meisner et al.](https://reader035.fdocuments.us/reader035/viewer/2022062407/56649dbb5503460f94aac836/html5/thumbnails/17.jpg)
17 04/19/23
![Page 18: Power Management of Online Data Intensive Services Meisner et al.](https://reader035.fdocuments.us/reader035/viewer/2022062407/56649dbb5503460f94aac836/html5/thumbnails/18.jpg)
18 04/19/23
Activity Graph – fraction of time a component spends at or below
Given Utilization (U) for a time L or greater
![Page 19: Power Management of Online Data Intensive Services Meisner et al.](https://reader035.fdocuments.us/reader035/viewer/2022062407/56649dbb5503460f94aac836/html5/thumbnails/19.jpg)
19 04/19/23
![Page 20: Power Management of Online Data Intensive Services Meisner et al.](https://reader035.fdocuments.us/reader035/viewer/2022062407/56649dbb5503460f94aac836/html5/thumbnails/20.jpg)
20 04/19/23
![Page 21: Power Management of Online Data Intensive Services Meisner et al.](https://reader035.fdocuments.us/reader035/viewer/2022062407/56649dbb5503460f94aac836/html5/thumbnails/21.jpg)
21 04/19/23
![Page 22: Power Management of Online Data Intensive Services Meisner et al.](https://reader035.fdocuments.us/reader035/viewer/2022062407/56649dbb5503460f94aac836/html5/thumbnails/22.jpg)
Leaf Node Performance Model
22 04/19/23
• L_query = L_service + L_wait
• L_service
• Modeling L_wait
• G/G/k queue
• Arbitrary inter-arrival and service time distributions
• Average throughput
• Average service rate
• K servers
• Average load
![Page 23: Power Management of Online Data Intensive Services Meisner et al.](https://reader035.fdocuments.us/reader035/viewer/2022062407/56649dbb5503460f94aac836/html5/thumbnails/23.jpg)
23 04/19/23
![Page 24: Power Management of Online Data Intensive Services Meisner et al.](https://reader035.fdocuments.us/reader035/viewer/2022062407/56649dbb5503460f94aac836/html5/thumbnails/24.jpg)
24 04/19/23
![Page 25: Power Management of Online Data Intensive Services Meisner et al.](https://reader035.fdocuments.us/reader035/viewer/2022062407/56649dbb5503460f94aac836/html5/thumbnails/25.jpg)
25 04/19/23
![Page 26: Power Management of Online Data Intensive Services Meisner et al.](https://reader035.fdocuments.us/reader035/viewer/2022062407/56649dbb5503460f94aac836/html5/thumbnails/26.jpg)
26 04/19/23
![Page 27: Power Management of Online Data Intensive Services Meisner et al.](https://reader035.fdocuments.us/reader035/viewer/2022062407/56649dbb5503460f94aac836/html5/thumbnails/27.jpg)
27 04/19/23
![Page 28: Power Management of Online Data Intensive Services Meisner et al.](https://reader035.fdocuments.us/reader035/viewer/2022062407/56649dbb5503460f94aac836/html5/thumbnails/28.jpg)
28 04/19/23
Scaling – uses active low power modes
Core – uses idle low power modes
PowerNap – System-idle low power modes
![Page 29: Power Management of Online Data Intensive Services Meisner et al.](https://reader035.fdocuments.us/reader035/viewer/2022062407/56649dbb5503460f94aac836/html5/thumbnails/29.jpg)
Question
29 04/19/23
• Authors say OLDI needs a new kind of power management
utilizing active low power modes. Why do they say new?
DVFS already uses those, right?
• They say DVFS will be less significant in future, why?
• Why do they argue for full-system active low power modes?
• What is the significance of the tail in the distribution?
• 95th percentile is 2.4X mean
![Page 30: Power Management of Online Data Intensive Services Meisner et al.](https://reader035.fdocuments.us/reader035/viewer/2022062407/56649dbb5503460f94aac836/html5/thumbnails/30.jpg)
QUEUING THEORY BASICS
30 04/19/23
![Page 31: Power Management of Online Data Intensive Services Meisner et al.](https://reader035.fdocuments.us/reader035/viewer/2022062407/56649dbb5503460f94aac836/html5/thumbnails/31.jpg)
31 04/19/23
![Page 32: Power Management of Online Data Intensive Services Meisner et al.](https://reader035.fdocuments.us/reader035/viewer/2022062407/56649dbb5503460f94aac836/html5/thumbnails/32.jpg)
32 04/19/23
KENDALL’s NOTATION
![Page 33: Power Management of Online Data Intensive Services Meisner et al.](https://reader035.fdocuments.us/reader035/viewer/2022062407/56649dbb5503460f94aac836/html5/thumbnails/33.jpg)
33 04/19/23
![Page 34: Power Management of Online Data Intensive Services Meisner et al.](https://reader035.fdocuments.us/reader035/viewer/2022062407/56649dbb5503460f94aac836/html5/thumbnails/34.jpg)
34 04/19/23
![Page 35: Power Management of Online Data Intensive Services Meisner et al.](https://reader035.fdocuments.us/reader035/viewer/2022062407/56649dbb5503460f94aac836/html5/thumbnails/35.jpg)
35 04/19/23
![Page 36: Power Management of Online Data Intensive Services Meisner et al.](https://reader035.fdocuments.us/reader035/viewer/2022062407/56649dbb5503460f94aac836/html5/thumbnails/36.jpg)
36 04/19/23
![Page 37: Power Management of Online Data Intensive Services Meisner et al.](https://reader035.fdocuments.us/reader035/viewer/2022062407/56649dbb5503460f94aac836/html5/thumbnails/37.jpg)
37 04/19/23
![Page 38: Power Management of Online Data Intensive Services Meisner et al.](https://reader035.fdocuments.us/reader035/viewer/2022062407/56649dbb5503460f94aac836/html5/thumbnails/38.jpg)
38 04/19/23
![Page 39: Power Management of Online Data Intensive Services Meisner et al.](https://reader035.fdocuments.us/reader035/viewer/2022062407/56649dbb5503460f94aac836/html5/thumbnails/39.jpg)
39 04/19/23
![Page 40: Power Management of Online Data Intensive Services Meisner et al.](https://reader035.fdocuments.us/reader035/viewer/2022062407/56649dbb5503460f94aac836/html5/thumbnails/40.jpg)
40 04/19/23
![Page 41: Power Management of Online Data Intensive Services Meisner et al.](https://reader035.fdocuments.us/reader035/viewer/2022062407/56649dbb5503460f94aac836/html5/thumbnails/41.jpg)
41 04/19/23