Enhancing Energy Efficiency of Database Applications Using...
Transcript of Enhancing Energy Efficiency of Database Applications Using...
![Page 1: Enhancing Energy Efficiency of Database Applications Using ...resources.mpi-inf.mpg.de/departments/d5/teaching/ss11/eedb/talks/Felix...Seminar Energy-Efficient Databases 29.06.2011](https://reader030.fdocuments.us/reader030/viewer/2022041217/5e062af527763d5d6546ed27/html5/thumbnails/1.jpg)
Seminar Energy-Efficient Databases29.06.2011
Enhancing Energy Efficiency of
Database Applications Using SSDs
Felix Martin Schuhknecht
![Page 2: Enhancing Energy Efficiency of Database Applications Using ...resources.mpi-inf.mpg.de/departments/d5/teaching/ss11/eedb/talks/Felix...Seminar Energy-Efficient Databases 29.06.2011](https://reader030.fdocuments.us/reader030/viewer/2022041217/5e062af527763d5d6546ed27/html5/thumbnails/2.jpg)
Motivation
Energy-Efficiency Seminar 29.06.2011 Felix Martin Schuhknecht 2 / 37
vs.
![Page 3: Enhancing Energy Efficiency of Database Applications Using ...resources.mpi-inf.mpg.de/departments/d5/teaching/ss11/eedb/talks/Felix...Seminar Energy-Efficient Databases 29.06.2011](https://reader030.fdocuments.us/reader030/viewer/2022041217/5e062af527763d5d6546ed27/html5/thumbnails/3.jpg)
Motivation
3
Why Solid State Disks (SSDs) ?
Energy-Efficiency Seminar 29.06.2011 Felix Martin Schuhknecht / 37
![Page 4: Enhancing Energy Efficiency of Database Applications Using ...resources.mpi-inf.mpg.de/departments/d5/teaching/ss11/eedb/talks/Felix...Seminar Energy-Efficient Databases 29.06.2011](https://reader030.fdocuments.us/reader030/viewer/2022041217/5e062af527763d5d6546ed27/html5/thumbnails/4.jpg)
Motivation
3
Why Solid State Disks (SSDs) ?
Positive:• High Perfomance• Low Power Consumption
Energy-Efficiency Seminar 29.06.2011 Felix Martin Schuhknecht / 37
![Page 5: Enhancing Energy Efficiency of Database Applications Using ...resources.mpi-inf.mpg.de/departments/d5/teaching/ss11/eedb/talks/Felix...Seminar Energy-Efficient Databases 29.06.2011](https://reader030.fdocuments.us/reader030/viewer/2022041217/5e062af527763d5d6546ed27/html5/thumbnails/5.jpg)
Motivation
3
Why Solid State Disks (SSDs) ?
Positive:• High Perfomance• Low Power Consumption
Negative:• Small Capacity• Very Expensive
Energy-Efficiency Seminar 29.06.2011 Felix Martin Schuhknecht / 37
![Page 6: Enhancing Energy Efficiency of Database Applications Using ...resources.mpi-inf.mpg.de/departments/d5/teaching/ss11/eedb/talks/Felix...Seminar Energy-Efficient Databases 29.06.2011](https://reader030.fdocuments.us/reader030/viewer/2022041217/5e062af527763d5d6546ed27/html5/thumbnails/6.jpg)
Motivation
3
Why Solid State Disks (SSDs) ?
Positive:• High Perfomance• Low Power Consumption
Negative:• Small Capacity• Very Expensive
Energy-Efficiency Seminar 29.06.2011 Felix Martin Schuhknecht / 37
![Page 7: Enhancing Energy Efficiency of Database Applications Using ...resources.mpi-inf.mpg.de/departments/d5/teaching/ss11/eedb/talks/Felix...Seminar Energy-Efficient Databases 29.06.2011](https://reader030.fdocuments.us/reader030/viewer/2022041217/5e062af527763d5d6546ed27/html5/thumbnails/7.jpg)
Motivation
3
Why Solid State Disks (SSDs) ?
Positive:• High Perfomance• Low Power Consumption
Negative:• Small Capacity• Very Expensive
Energy-Efficiency Seminar 29.06.2011 Felix Martin Schuhknecht / 37
![Page 8: Enhancing Energy Efficiency of Database Applications Using ...resources.mpi-inf.mpg.de/departments/d5/teaching/ss11/eedb/talks/Felix...Seminar Energy-Efficient Databases 29.06.2011](https://reader030.fdocuments.us/reader030/viewer/2022041217/5e062af527763d5d6546ed27/html5/thumbnails/8.jpg)
Motivation
3
Why Solid State Disks (SSDs) ?
Positive:• High Perfomance• Low Power Consumption
Negative:• Small Capacity• Very Expensive
Really?
Energy-Efficiency Seminar 29.06.2011 Felix Martin Schuhknecht / 37
![Page 9: Enhancing Energy Efficiency of Database Applications Using ...resources.mpi-inf.mpg.de/departments/d5/teaching/ss11/eedb/talks/Felix...Seminar Energy-Efficient Databases 29.06.2011](https://reader030.fdocuments.us/reader030/viewer/2022041217/5e062af527763d5d6546ed27/html5/thumbnails/9.jpg)
Architecture: Flash versus Disk
4
HDD SSD
Cache YES NO
Limited Write Endurance
NO YES
Block Size SMALL LARGE
Energy-Efficiency Seminar 29.06.2011 Felix Martin Schuhknecht / 37
![Page 10: Enhancing Energy Efficiency of Database Applications Using ...resources.mpi-inf.mpg.de/departments/d5/teaching/ss11/eedb/talks/Felix...Seminar Energy-Efficient Databases 29.06.2011](https://reader030.fdocuments.us/reader030/viewer/2022041217/5e062af527763d5d6546ed27/html5/thumbnails/10.jpg)
Architecture: Flash versus Disk
5
Block Size:
4 - 64 KB
Block
HDD
16 - 256 KB
Block
SSD
divided in fixed-size pages
Energy-Efficiency Seminar 29.06.2011 Felix Martin Schuhknecht / 37
![Page 11: Enhancing Energy Efficiency of Database Applications Using ...resources.mpi-inf.mpg.de/departments/d5/teaching/ss11/eedb/talks/Felix...Seminar Energy-Efficient Databases 29.06.2011](https://reader030.fdocuments.us/reader030/viewer/2022041217/5e062af527763d5d6546ed27/html5/thumbnails/11.jpg)
Architecture: Flash versus Disk
6
Problem: Page UpdatesBlock
1101 1001 1110 1100 1001 1011 1000 1011
1101
update page
Energy-Efficiency Seminar 29.06.2011 Felix Martin Schuhknecht / 37
![Page 12: Enhancing Energy Efficiency of Database Applications Using ...resources.mpi-inf.mpg.de/departments/d5/teaching/ss11/eedb/talks/Felix...Seminar Energy-Efficient Databases 29.06.2011](https://reader030.fdocuments.us/reader030/viewer/2022041217/5e062af527763d5d6546ed27/html5/thumbnails/12.jpg)
Architecture: Flash versus Disk
6
Problem: Page UpdatesBlock
1101 1001 1110 1100 1001 1011 1000 1011
1101
update page
Only transitions from 1 to 0 possible!
Energy-Efficiency Seminar 29.06.2011 Felix Martin Schuhknecht / 37
![Page 13: Enhancing Energy Efficiency of Database Applications Using ...resources.mpi-inf.mpg.de/departments/d5/teaching/ss11/eedb/talks/Felix...Seminar Energy-Efficient Databases 29.06.2011](https://reader030.fdocuments.us/reader030/viewer/2022041217/5e062af527763d5d6546ed27/html5/thumbnails/13.jpg)
Architecture: Flash versus Disk
7
Problem: Page Updates
1101 1001 1110 1100 1001 1011 1000 1011
1101
Block 1
Energy-Efficiency Seminar 29.06.2011 Felix Martin Schuhknecht / 37
![Page 14: Enhancing Energy Efficiency of Database Applications Using ...resources.mpi-inf.mpg.de/departments/d5/teaching/ss11/eedb/talks/Felix...Seminar Energy-Efficient Databases 29.06.2011](https://reader030.fdocuments.us/reader030/viewer/2022041217/5e062af527763d5d6546ed27/html5/thumbnails/14.jpg)
Architecture: Flash versus Disk
7
Problem: Page Updates
1101 1001 1110 1100 1001 1011 1000 1011
1101
Block 1
1111 1111 1111 1111 1111 1111 1111 1111
Block 2
Energy-Efficiency Seminar 29.06.2011 Felix Martin Schuhknecht / 37
![Page 15: Enhancing Energy Efficiency of Database Applications Using ...resources.mpi-inf.mpg.de/departments/d5/teaching/ss11/eedb/talks/Felix...Seminar Energy-Efficient Databases 29.06.2011](https://reader030.fdocuments.us/reader030/viewer/2022041217/5e062af527763d5d6546ed27/html5/thumbnails/15.jpg)
Architecture: Flash versus Disk
7
Problem: Page Updates
1101 1001 1110 1100 1001 1011 1000 1011
1101
Block 1
1111 1111 1111 1111 1111 1111 1111 1111
Block 2
Energy-Efficiency Seminar 29.06.2011 Felix Martin Schuhknecht / 37
![Page 16: Enhancing Energy Efficiency of Database Applications Using ...resources.mpi-inf.mpg.de/departments/d5/teaching/ss11/eedb/talks/Felix...Seminar Energy-Efficient Databases 29.06.2011](https://reader030.fdocuments.us/reader030/viewer/2022041217/5e062af527763d5d6546ed27/html5/thumbnails/16.jpg)
Architecture: Flash versus Disk
7
Problem: Page Updates
1101 1001 1110 1100 1001 1011 1000 1011
1101
Block 1
1101 1001 1110 1100 1101 1011 1000 1011
Block 2
Energy-Efficiency Seminar 29.06.2011 Felix Martin Schuhknecht / 37
![Page 17: Enhancing Energy Efficiency of Database Applications Using ...resources.mpi-inf.mpg.de/departments/d5/teaching/ss11/eedb/talks/Felix...Seminar Energy-Efficient Databases 29.06.2011](https://reader030.fdocuments.us/reader030/viewer/2022041217/5e062af527763d5d6546ed27/html5/thumbnails/17.jpg)
Architecture: Flash versus Disk
8
Problem: Write Endurance
Number of allowed erase cycles > 1.000.000 today
Energy-Efficiency Seminar 29.06.2011 Felix Martin Schuhknecht / 37
![Page 18: Enhancing Energy Efficiency of Database Applications Using ...resources.mpi-inf.mpg.de/departments/d5/teaching/ss11/eedb/talks/Felix...Seminar Energy-Efficient Databases 29.06.2011](https://reader030.fdocuments.us/reader030/viewer/2022041217/5e062af527763d5d6546ed27/html5/thumbnails/18.jpg)
Architecture: Flash versus Disk
8
Problem: Write Endurance
Number of allowed erase cycles > 1.000.000 today
Energy-Efficiency Seminar 29.06.2011 Felix Martin Schuhknecht / 37
![Page 19: Enhancing Energy Efficiency of Database Applications Using ...resources.mpi-inf.mpg.de/departments/d5/teaching/ss11/eedb/talks/Felix...Seminar Energy-Efficient Databases 29.06.2011](https://reader030.fdocuments.us/reader030/viewer/2022041217/5e062af527763d5d6546ed27/html5/thumbnails/19.jpg)
Architecture: Flash versus Disk
8
Problem: Write Endurance
Number of allowed erase cycles > 1.000.000 today
Uniform Block Distribution needed!
Energy-Efficiency Seminar 29.06.2011 Felix Martin Schuhknecht / 37
![Page 20: Enhancing Energy Efficiency of Database Applications Using ...resources.mpi-inf.mpg.de/departments/d5/teaching/ss11/eedb/talks/Felix...Seminar Energy-Efficient Databases 29.06.2011](https://reader030.fdocuments.us/reader030/viewer/2022041217/5e062af527763d5d6546ed27/html5/thumbnails/20.jpg)
Architecture: Flash versus Disk
8
Problem: Write Endurance
Number of allowed erase cycles > 1.000.000 today
Uniform Block Distribution needed!
Flash Translation Layer (FTL)
Energy-Efficiency Seminar 29.06.2011 Felix Martin Schuhknecht / 37
![Page 21: Enhancing Energy Efficiency of Database Applications Using ...resources.mpi-inf.mpg.de/departments/d5/teaching/ss11/eedb/talks/Felix...Seminar Energy-Efficient Databases 29.06.2011](https://reader030.fdocuments.us/reader030/viewer/2022041217/5e062af527763d5d6546ed27/html5/thumbnails/21.jpg)
Architecture: Flash versus Disk
9
Flash Translation Layer Wear Leveling
Guarded Secrets!
Energy-Efficiency Seminar 29.06.2011 Felix Martin Schuhknecht / 37
![Page 22: Enhancing Energy Efficiency of Database Applications Using ...resources.mpi-inf.mpg.de/departments/d5/teaching/ss11/eedb/talks/Felix...Seminar Energy-Efficient Databases 29.06.2011](https://reader030.fdocuments.us/reader030/viewer/2022041217/5e062af527763d5d6546ed27/html5/thumbnails/22.jpg)
Architecture: Flash versus Disk
9
Flash Translation Layer Wear Leveling
Guarded Secrets!
Problem: Hard to predict SSD Performance
Energy-Efficiency Seminar 29.06.2011 Felix Martin Schuhknecht / 37
![Page 23: Enhancing Energy Efficiency of Database Applications Using ...resources.mpi-inf.mpg.de/departments/d5/teaching/ss11/eedb/talks/Felix...Seminar Energy-Efficient Databases 29.06.2011](https://reader030.fdocuments.us/reader030/viewer/2022041217/5e062af527763d5d6546ed27/html5/thumbnails/23.jpg)
Setup: Access Pattern
10
Random Access:
Random Sorted Access:
Block 1 Block 2 Block 3 Block 4 Block 5
Block 1 Block 2 Block 3 Block 4 Block 5
Sequential Access:Block 1 Block 2 Block 3 Block 4 Block 5
Energy-Efficiency Seminar 29.06.2011 Felix Martin Schuhknecht / 37
![Page 24: Enhancing Energy Efficiency of Database Applications Using ...resources.mpi-inf.mpg.de/departments/d5/teaching/ss11/eedb/talks/Felix...Seminar Energy-Efficient Databases 29.06.2011](https://reader030.fdocuments.us/reader030/viewer/2022041217/5e062af527763d5d6546ed27/html5/thumbnails/24.jpg)
Setup: Access Pattern
10
Random Access:
Random Sorted Access:
Block 1 Block 2 Block 3 Block 4 Block 5
Block 1 Block 2 Block 3 Block 4 Block 5
Sequential Access:Block 1 Block 2 Block 3 Block 4 Block 5
Energy-Efficiency Seminar 29.06.2011 Felix Martin Schuhknecht / 37
![Page 25: Enhancing Energy Efficiency of Database Applications Using ...resources.mpi-inf.mpg.de/departments/d5/teaching/ss11/eedb/talks/Felix...Seminar Energy-Efficient Databases 29.06.2011](https://reader030.fdocuments.us/reader030/viewer/2022041217/5e062af527763d5d6546ed27/html5/thumbnails/25.jpg)
Setup: Access Pattern
10
Random Access:
Random Sorted Access:
Block 1 Block 2 Block 3 Block 4 Block 5
Block 1 Block 2 Block 3 Block 4 Block 5
Sequential Access:Block 1 Block 2 Block 3 Block 4 Block 5
Energy-Efficiency Seminar 29.06.2011 Felix Martin Schuhknecht / 37
![Page 26: Enhancing Energy Efficiency of Database Applications Using ...resources.mpi-inf.mpg.de/departments/d5/teaching/ss11/eedb/talks/Felix...Seminar Energy-Efficient Databases 29.06.2011](https://reader030.fdocuments.us/reader030/viewer/2022041217/5e062af527763d5d6546ed27/html5/thumbnails/26.jpg)
Setup: Access Pattern
10
Random Access:
Random Sorted Access:
Block 1 Block 2 Block 3 Block 4 Block 5
Block 1 Block 2 Block 3 Block 4 Block 5
Sequential Access:Block 1 Block 2 Block 3 Block 4 Block 5
Energy-Efficiency Seminar 29.06.2011 Felix Martin Schuhknecht / 37
![Page 27: Enhancing Energy Efficiency of Database Applications Using ...resources.mpi-inf.mpg.de/departments/d5/teaching/ss11/eedb/talks/Felix...Seminar Energy-Efficient Databases 29.06.2011](https://reader030.fdocuments.us/reader030/viewer/2022041217/5e062af527763d5d6546ed27/html5/thumbnails/27.jpg)
Access Time: Flash versus Disk
11
HDD:
td(b) ≈ tSIO + tsavg + trev / 2 + b / Fd
Energy-Efficiency Seminar 29.06.2011 Felix Martin Schuhknecht
tsavg Average Seek Time
trev Rotational Delay
F Transfer Rate
tSIO CPU Overhead
/ 37
![Page 28: Enhancing Energy Efficiency of Database Applications Using ...resources.mpi-inf.mpg.de/departments/d5/teaching/ss11/eedb/talks/Felix...Seminar Energy-Efficient Databases 29.06.2011](https://reader030.fdocuments.us/reader030/viewer/2022041217/5e062af527763d5d6546ed27/html5/thumbnails/28.jpg)
Access Time: Flash versus Disk
11
HDD:
td(b) ≈ tSIO + tsavg + trev / 2 + b / Fd
SSD:tf(b) ≈ tSIO + b / Ff
Energy-Efficiency Seminar 29.06.2011 Felix Martin Schuhknecht
tsavg Average Seek Time
trev Rotational Delay
F Transfer Rate
tSIO CPU Overhead
/ 37
![Page 29: Enhancing Energy Efficiency of Database Applications Using ...resources.mpi-inf.mpg.de/departments/d5/teaching/ss11/eedb/talks/Felix...Seminar Energy-Efficient Databases 29.06.2011](https://reader030.fdocuments.us/reader030/viewer/2022041217/5e062af527763d5d6546ed27/html5/thumbnails/29.jpg)
HDDs under Test
12Energy-Efficiency Seminar 29.06.2011 Felix Martin Schuhknecht
Device Type Name Idle Power Watt
Price $ / GB Capacity Rotation
Speed
Maxtor IDE HDD1 7.1 0.7 80 GB 7200 rpm
WD SATA HDD2 4.5 1 150 GB 10000 rpm
Fujitsu SAS HDD3 12.8 1.2 147 GB 15000 rpm
/ 37
![Page 30: Enhancing Energy Efficiency of Database Applications Using ...resources.mpi-inf.mpg.de/departments/d5/teaching/ss11/eedb/talks/Felix...Seminar Energy-Efficient Databases 29.06.2011](https://reader030.fdocuments.us/reader030/viewer/2022041217/5e062af527763d5d6546ed27/html5/thumbnails/30.jpg)
SSDs under Test
13Energy-Efficiency Seminar 29.06.2011 Felix Martin Schuhknecht
Device Type Name Idle Power Watt
Price $ / GB Capacity Rotation
Speed
SuperTalent SSD1 no info 4.3 32 GB -
Mtron SSD2 1.4 17.6 32 GB -
Intel SSD3 0.1 2.9 160 GB -
/ 37
![Page 31: Enhancing Energy Efficiency of Database Applications Using ...resources.mpi-inf.mpg.de/departments/d5/teaching/ss11/eedb/talks/Felix...Seminar Energy-Efficient Databases 29.06.2011](https://reader030.fdocuments.us/reader030/viewer/2022041217/5e062af527763d5d6546ed27/html5/thumbnails/31.jpg)
Energy Cost: Flash versus Disk
14
HDD % of file read
Energy-Efficiency Seminar 29.06.2011 Felix Martin Schuhknecht / 37
![Page 32: Enhancing Energy Efficiency of Database Applications Using ...resources.mpi-inf.mpg.de/departments/d5/teaching/ss11/eedb/talks/Felix...Seminar Energy-Efficient Databases 29.06.2011](https://reader030.fdocuments.us/reader030/viewer/2022041217/5e062af527763d5d6546ed27/html5/thumbnails/32.jpg)
Energy Cost: Flash versus Disk
14
HDD
SSD
% of file read
Energy-Efficiency Seminar 29.06.2011 Felix Martin Schuhknecht / 37
![Page 33: Enhancing Energy Efficiency of Database Applications Using ...resources.mpi-inf.mpg.de/departments/d5/teaching/ss11/eedb/talks/Felix...Seminar Energy-Efficient Databases 29.06.2011](https://reader030.fdocuments.us/reader030/viewer/2022041217/5e062af527763d5d6546ed27/html5/thumbnails/33.jpg)
Random vs. Sequential Access
15
Rule of Thumb (for HDDs):
If > 2% of file accessed → Read complete file!
Energy-Efficiency Seminar 29.06.2011 Felix Martin Schuhknecht / 37
![Page 34: Enhancing Energy Efficiency of Database Applications Using ...resources.mpi-inf.mpg.de/departments/d5/teaching/ss11/eedb/talks/Felix...Seminar Energy-Efficient Databases 29.06.2011](https://reader030.fdocuments.us/reader030/viewer/2022041217/5e062af527763d5d6546ed27/html5/thumbnails/34.jpg)
Random vs. Sequentiell Access
16
Timein
sec
% of file read
Energy-Efficiency Seminar 29.06.2011 Felix Martin Schuhknecht / 37
![Page 35: Enhancing Energy Efficiency of Database Applications Using ...resources.mpi-inf.mpg.de/departments/d5/teaching/ss11/eedb/talks/Felix...Seminar Energy-Efficient Databases 29.06.2011](https://reader030.fdocuments.us/reader030/viewer/2022041217/5e062af527763d5d6546ed27/html5/thumbnails/35.jpg)
Random vs. Sequentiell Access
16
Timein
sec
% of file read
✗
Energy-Efficiency Seminar 29.06.2011 Felix Martin Schuhknecht / 37
![Page 36: Enhancing Energy Efficiency of Database Applications Using ...resources.mpi-inf.mpg.de/departments/d5/teaching/ss11/eedb/talks/Felix...Seminar Energy-Efficient Databases 29.06.2011](https://reader030.fdocuments.us/reader030/viewer/2022041217/5e062af527763d5d6546ed27/html5/thumbnails/36.jpg)
Random vs. Sequentiell Access
16
Timein
sec
% of file read
✗
Energy-Efficiency Seminar 29.06.2011 Felix Martin Schuhknecht / 37
![Page 37: Enhancing Energy Efficiency of Database Applications Using ...resources.mpi-inf.mpg.de/departments/d5/teaching/ss11/eedb/talks/Felix...Seminar Energy-Efficient Databases 29.06.2011](https://reader030.fdocuments.us/reader030/viewer/2022041217/5e062af527763d5d6546ed27/html5/thumbnails/37.jpg)
Random vs. Sequentiell Access
16
Timein
sec
% of file read
✗✗
Energy-Efficiency Seminar 29.06.2011 Felix Martin Schuhknecht / 37
![Page 38: Enhancing Energy Efficiency of Database Applications Using ...resources.mpi-inf.mpg.de/departments/d5/teaching/ss11/eedb/talks/Felix...Seminar Energy-Efficient Databases 29.06.2011](https://reader030.fdocuments.us/reader030/viewer/2022041217/5e062af527763d5d6546ed27/html5/thumbnails/38.jpg)
Random vs. Sequentiell Access
17
Rule of Thumb: Read complete file ...
... if > 2% of file accessed.HDD:
SSD: ... if > 83% of file accessed.
Energy-Efficiency Seminar 29.06.2011 Felix Martin Schuhknecht / 37
![Page 39: Enhancing Energy Efficiency of Database Applications Using ...resources.mpi-inf.mpg.de/departments/d5/teaching/ss11/eedb/talks/Felix...Seminar Energy-Efficient Databases 29.06.2011](https://reader030.fdocuments.us/reader030/viewer/2022041217/5e062af527763d5d6546ed27/html5/thumbnails/39.jpg)
Experiment: Power Consumption
18Energy-Efficiency Seminar 29.06.2011 Felix Martin Schuhknecht / 37
![Page 40: Enhancing Energy Efficiency of Database Applications Using ...resources.mpi-inf.mpg.de/departments/d5/teaching/ss11/eedb/talks/Felix...Seminar Energy-Efficient Databases 29.06.2011](https://reader030.fdocuments.us/reader030/viewer/2022041217/5e062af527763d5d6546ed27/html5/thumbnails/40.jpg)
Experiment: Power Consumption
18Energy-Efficiency Seminar 29.06.2011 Felix Martin Schuhknecht / 37
![Page 41: Enhancing Energy Efficiency of Database Applications Using ...resources.mpi-inf.mpg.de/departments/d5/teaching/ss11/eedb/talks/Felix...Seminar Energy-Efficient Databases 29.06.2011](https://reader030.fdocuments.us/reader030/viewer/2022041217/5e062af527763d5d6546ed27/html5/thumbnails/41.jpg)
Experiment: Power Consumption
18
• HDDs consume more power in all cases.
Energy-Efficiency Seminar 29.06.2011 Felix Martin Schuhknecht / 37
![Page 42: Enhancing Energy Efficiency of Database Applications Using ...resources.mpi-inf.mpg.de/departments/d5/teaching/ss11/eedb/talks/Felix...Seminar Energy-Efficient Databases 29.06.2011](https://reader030.fdocuments.us/reader030/viewer/2022041217/5e062af527763d5d6546ed27/html5/thumbnails/42.jpg)
Experiment: Power Consumption
18
• HDDs consume more power in all cases.
• Constant consumption for SSDs
Energy-Efficiency Seminar 29.06.2011 Felix Martin Schuhknecht / 37
![Page 43: Enhancing Energy Efficiency of Database Applications Using ...resources.mpi-inf.mpg.de/departments/d5/teaching/ss11/eedb/talks/Felix...Seminar Energy-Efficient Databases 29.06.2011](https://reader030.fdocuments.us/reader030/viewer/2022041217/5e062af527763d5d6546ed27/html5/thumbnails/43.jpg)
Experiment: Power Consumption
18
• HDDs consume more power in all cases.
• Constant consumption for SSDs
• Read/Write has marginal impact
Energy-Efficiency Seminar 29.06.2011 Felix Martin Schuhknecht / 37
![Page 44: Enhancing Energy Efficiency of Database Applications Using ...resources.mpi-inf.mpg.de/departments/d5/teaching/ss11/eedb/talks/Felix...Seminar Energy-Efficient Databases 29.06.2011](https://reader030.fdocuments.us/reader030/viewer/2022041217/5e062af527763d5d6546ed27/html5/thumbnails/44.jpg)
Experiment: Performance
19Energy-Efficiency Seminar 29.06.2011 Felix Martin Schuhknecht / 37
![Page 45: Enhancing Energy Efficiency of Database Applications Using ...resources.mpi-inf.mpg.de/departments/d5/teaching/ss11/eedb/talks/Felix...Seminar Energy-Efficient Databases 29.06.2011](https://reader030.fdocuments.us/reader030/viewer/2022041217/5e062af527763d5d6546ed27/html5/thumbnails/45.jpg)
Experiment: Performance
19Energy-Efficiency Seminar 29.06.2011 Felix Martin Schuhknecht / 37
![Page 46: Enhancing Energy Efficiency of Database Applications Using ...resources.mpi-inf.mpg.de/departments/d5/teaching/ss11/eedb/talks/Felix...Seminar Energy-Efficient Databases 29.06.2011](https://reader030.fdocuments.us/reader030/viewer/2022041217/5e062af527763d5d6546ed27/html5/thumbnails/46.jpg)
Experiment: Performance
19
• Sequential performance comparable.
Energy-Efficiency Seminar 29.06.2011 Felix Martin Schuhknecht / 37
![Page 47: Enhancing Energy Efficiency of Database Applications Using ...resources.mpi-inf.mpg.de/departments/d5/teaching/ss11/eedb/talks/Felix...Seminar Energy-Efficient Databases 29.06.2011](https://reader030.fdocuments.us/reader030/viewer/2022041217/5e062af527763d5d6546ed27/html5/thumbnails/47.jpg)
Experiment: Performance
19
• Sequential performance comparable.
• Random read is worst case for HDDs.
Energy-Efficiency Seminar 29.06.2011 Felix Martin Schuhknecht / 37
![Page 48: Enhancing Energy Efficiency of Database Applications Using ...resources.mpi-inf.mpg.de/departments/d5/teaching/ss11/eedb/talks/Felix...Seminar Energy-Efficient Databases 29.06.2011](https://reader030.fdocuments.us/reader030/viewer/2022041217/5e062af527763d5d6546ed27/html5/thumbnails/48.jpg)
Experiment: Performance
19
• Sequential performance comparable.
• Random read is worst case for HDDs.
• Sorting decreases this problem.
Energy-Efficiency Seminar 29.06.2011 Felix Martin Schuhknecht / 37
![Page 49: Enhancing Energy Efficiency of Database Applications Using ...resources.mpi-inf.mpg.de/departments/d5/teaching/ss11/eedb/talks/Felix...Seminar Energy-Efficient Databases 29.06.2011](https://reader030.fdocuments.us/reader030/viewer/2022041217/5e062af527763d5d6546ed27/html5/thumbnails/49.jpg)
Experiment: Performance
20Energy-Efficiency Seminar 29.06.2011 Felix Martin Schuhknecht / 37
![Page 50: Enhancing Energy Efficiency of Database Applications Using ...resources.mpi-inf.mpg.de/departments/d5/teaching/ss11/eedb/talks/Felix...Seminar Energy-Efficient Databases 29.06.2011](https://reader030.fdocuments.us/reader030/viewer/2022041217/5e062af527763d5d6546ed27/html5/thumbnails/50.jpg)
Experiment: Performance
20Energy-Efficiency Seminar 29.06.2011 Felix Martin Schuhknecht / 37
![Page 51: Enhancing Energy Efficiency of Database Applications Using ...resources.mpi-inf.mpg.de/departments/d5/teaching/ss11/eedb/talks/Felix...Seminar Energy-Efficient Databases 29.06.2011](https://reader030.fdocuments.us/reader030/viewer/2022041217/5e062af527763d5d6546ed27/html5/thumbnails/51.jpg)
Experiment: Performance
20
• Sequential performance comparable.
Energy-Efficiency Seminar 29.06.2011 Felix Martin Schuhknecht / 37
![Page 52: Enhancing Energy Efficiency of Database Applications Using ...resources.mpi-inf.mpg.de/departments/d5/teaching/ss11/eedb/talks/Felix...Seminar Energy-Efficient Databases 29.06.2011](https://reader030.fdocuments.us/reader030/viewer/2022041217/5e062af527763d5d6546ed27/html5/thumbnails/52.jpg)
Experiment: Performance
20
• Sequential performance comparable.
• Random write problem for all, except of SSD3.
Energy-Efficiency Seminar 29.06.2011 Felix Martin Schuhknecht / 37
![Page 53: Enhancing Energy Efficiency of Database Applications Using ...resources.mpi-inf.mpg.de/departments/d5/teaching/ss11/eedb/talks/Felix...Seminar Energy-Efficient Databases 29.06.2011](https://reader030.fdocuments.us/reader030/viewer/2022041217/5e062af527763d5d6546ed27/html5/thumbnails/53.jpg)
Experiment: Performance
20
• Sequential performance comparable.
• Random write problem for all, except of SSD3.
• Sorting decreases this problem.
Energy-Efficiency Seminar 29.06.2011 Felix Martin Schuhknecht / 37
![Page 54: Enhancing Energy Efficiency of Database Applications Using ...resources.mpi-inf.mpg.de/departments/d5/teaching/ss11/eedb/talks/Felix...Seminar Energy-Efficient Databases 29.06.2011](https://reader030.fdocuments.us/reader030/viewer/2022041217/5e062af527763d5d6546ed27/html5/thumbnails/54.jpg)
Experiment: Energy Efficiency
21
Read Write
SSDs superior in ALL situations.
SSDs superior inMOST situations.
Energy-Efficiency Seminar 29.06.2011 Felix Martin Schuhknecht / 37
![Page 55: Enhancing Energy Efficiency of Database Applications Using ...resources.mpi-inf.mpg.de/departments/d5/teaching/ss11/eedb/talks/Felix...Seminar Energy-Efficient Databases 29.06.2011](https://reader030.fdocuments.us/reader030/viewer/2022041217/5e062af527763d5d6546ed27/html5/thumbnails/55.jpg)
Drive Diversity
22
Main factors for performance and power consumption:
Energy-Efficiency Seminar 29.06.2011 Felix Martin Schuhknecht / 37
![Page 56: Enhancing Energy Efficiency of Database Applications Using ...resources.mpi-inf.mpg.de/departments/d5/teaching/ss11/eedb/talks/Felix...Seminar Energy-Efficient Databases 29.06.2011](https://reader030.fdocuments.us/reader030/viewer/2022041217/5e062af527763d5d6546ed27/html5/thumbnails/56.jpg)
Drive Diversity
22
Main factors for performance and power consumption:
Rotation Speed
Capacity
Energy-Efficiency Seminar 29.06.2011 Felix Martin Schuhknecht / 37
![Page 57: Enhancing Energy Efficiency of Database Applications Using ...resources.mpi-inf.mpg.de/departments/d5/teaching/ss11/eedb/talks/Felix...Seminar Energy-Efficient Databases 29.06.2011](https://reader030.fdocuments.us/reader030/viewer/2022041217/5e062af527763d5d6546ed27/html5/thumbnails/57.jpg)
Drive Diversity
22
Main factors for performance and power consumption:
Rotation Speed
Capacity
FTL
Unknown,proprietaryfirmware
Energy-Efficiency Seminar 29.06.2011 Felix Martin Schuhknecht / 37
![Page 58: Enhancing Energy Efficiency of Database Applications Using ...resources.mpi-inf.mpg.de/departments/d5/teaching/ss11/eedb/talks/Felix...Seminar Energy-Efficient Databases 29.06.2011](https://reader030.fdocuments.us/reader030/viewer/2022041217/5e062af527763d5d6546ed27/html5/thumbnails/58.jpg)
Drive Diversity
22
Main factors for performance and power consumption:
Rotation Speed
Capacity
FTL
Unknown,proprietaryfirmware
Hardware vs. Software Specification
Energy-Efficiency Seminar 29.06.2011 Felix Martin Schuhknecht / 37
![Page 59: Enhancing Energy Efficiency of Database Applications Using ...resources.mpi-inf.mpg.de/departments/d5/teaching/ss11/eedb/talks/Felix...Seminar Energy-Efficient Databases 29.06.2011](https://reader030.fdocuments.us/reader030/viewer/2022041217/5e062af527763d5d6546ed27/html5/thumbnails/59.jpg)
Flash inside of a DBMS
23
Till now: Direct I/O Modepure file reading / writing
Energy-Efficiency Seminar 29.06.2011 Felix Martin Schuhknecht / 37
![Page 60: Enhancing Energy Efficiency of Database Applications Using ...resources.mpi-inf.mpg.de/departments/d5/teaching/ss11/eedb/talks/Felix...Seminar Energy-Efficient Databases 29.06.2011](https://reader030.fdocuments.us/reader030/viewer/2022041217/5e062af527763d5d6546ed27/html5/thumbnails/60.jpg)
Flash inside of a DBMS
23
Till now: Direct I/O Modepure file reading / writing
Next step: Integrate SSDs into DBMS
index structures
query types
buffers / caches
physical layout
Energy-Efficiency Seminar 29.06.2011 Felix Martin Schuhknecht / 37
![Page 61: Enhancing Energy Efficiency of Database Applications Using ...resources.mpi-inf.mpg.de/departments/d5/teaching/ss11/eedb/talks/Felix...Seminar Energy-Efficient Databases 29.06.2011](https://reader030.fdocuments.us/reader030/viewer/2022041217/5e062af527763d5d6546ed27/html5/thumbnails/61.jpg)
XTC DBMS
24
XML DBMS: Stores tree-structured data
Energy-Efficiency Seminar 29.06.2011 Felix Martin Schuhknecht / 37
![Page 62: Enhancing Energy Efficiency of Database Applications Using ...resources.mpi-inf.mpg.de/departments/d5/teaching/ss11/eedb/talks/Felix...Seminar Energy-Efficient Databases 29.06.2011](https://reader030.fdocuments.us/reader030/viewer/2022041217/5e062af527763d5d6546ed27/html5/thumbnails/62.jpg)
1 bib
1.3 publication
1.3.3 book 1.3.5 book
year1.3.3.1
id1.3.3.3
type1.3.3.5
title1.3.3.7
20031.3.3.1.3
11.3.3.3.3
author1.3.3.9
...
Science1.3.3.5.3
DBMS1.3.3.7.3
Gehrke1.3.3.9.3
author1.3.3.11
Ramakrishnan1.3.3.11.3
XTC DBMS
24
XML DBMS: Stores tree-structured data
Energy-Efficiency Seminar 29.06.2011 Felix Martin Schuhknecht / 37
![Page 63: Enhancing Energy Efficiency of Database Applications Using ...resources.mpi-inf.mpg.de/departments/d5/teaching/ss11/eedb/talks/Felix...Seminar Energy-Efficient Databases 29.06.2011](https://reader030.fdocuments.us/reader030/viewer/2022041217/5e062af527763d5d6546ed27/html5/thumbnails/63.jpg)
1 bib
1.3 publication
1.3.3 book 1.3.5 book
year1.3.3.1
id1.3.3.3
type1.3.3.5
title1.3.3.7
20031.3.3.1.3
11.3.3.3.3
author1.3.3.9
...
Science1.3.3.5.3
DBMS1.3.3.7.3
Gehrke1.3.3.9.3
author1.3.3.11
Ramakrishnan1.3.3.11.3
XTC DBMS
24
XML DBMS: Stores tree-structured data
SPLID(Stable Path Labeling IDentifier)
1.3.3 book
Energy-Efficiency Seminar 29.06.2011 Felix Martin Schuhknecht / 37
![Page 64: Enhancing Energy Efficiency of Database Applications Using ...resources.mpi-inf.mpg.de/departments/d5/teaching/ss11/eedb/talks/Felix...Seminar Energy-Efficient Databases 29.06.2011](https://reader030.fdocuments.us/reader030/viewer/2022041217/5e062af527763d5d6546ed27/html5/thumbnails/64.jpg)
XTC DBMS
25
XML DBMS: Stores tree-structured data
1 bib
2 publication
3 book
year4
id5
type6
title7
author8
Path Synopsis PCRs (Path Class References)
Energy-Efficiency Seminar 29.06.2011 Felix Martin Schuhknecht / 37
![Page 65: Enhancing Energy Efficiency of Database Applications Using ...resources.mpi-inf.mpg.de/departments/d5/teaching/ss11/eedb/talks/Felix...Seminar Energy-Efficient Databases 29.06.2011](https://reader030.fdocuments.us/reader030/viewer/2022041217/5e062af527763d5d6546ed27/html5/thumbnails/65.jpg)
XTC DBMS
26
XML DBMS: Physical representation
1.3.3.7.3 1.9
1.3.3.91 1.9.1
1 bib 1.3 publication 1.3.3
book 1.3.3.1 year 1.3.3.1.3
2003 1.3.3.3 id 1.3.3.3.3
1 1.3.3.5 type 1.3.3.5.3 Science
1.3.3.7 title 1.3.3.7.3 DBMS
1.3.3.9 author 1.3.3.9.3 Gehrke
1.3.3.11 author 1.3.3.11.3 Ramakr.
1.3.5 book ...
...
...
Index
Data
SPLID Content Attribute
Energy-Efficiency Seminar 29.06.2011 Felix Martin Schuhknecht / 37
![Page 66: Enhancing Energy Efficiency of Database Applications Using ...resources.mpi-inf.mpg.de/departments/d5/teaching/ss11/eedb/talks/Felix...Seminar Energy-Efficient Databases 29.06.2011](https://reader030.fdocuments.us/reader030/viewer/2022041217/5e062af527763d5d6546ed27/html5/thumbnails/66.jpg)
XTC DBMS
27
XML DBMS: Storage Mappings
Energy-Efficiency Seminar 29.06.2011 Felix Martin Schuhknecht
• Full Representation (full) → previous slide
• Prefix-Compressed Representation (pc)
• Elementless Representation (eless)
of plain XML file
1 bib 1.3 publication 1.3.3 → 1 bib 3 publication 3
1 bib 3 publication 3 → 1 1 3 2 3
95%
70%
65%
/ 37
![Page 67: Enhancing Energy Efficiency of Database Applications Using ...resources.mpi-inf.mpg.de/departments/d5/teaching/ss11/eedb/talks/Felix...Seminar Energy-Efficient Databases 29.06.2011](https://reader030.fdocuments.us/reader030/viewer/2022041217/5e062af527763d5d6546ed27/html5/thumbnails/67.jpg)
XTC DBMS - Optimizations
28
Problem:
DBMS and OS apply several optimizations.
Good for Performance! Bad for Experiments!
Caches, Buffers and Prefetching may disturb results.
Energy-Efficiency Seminar 29.06.2011 Felix Martin Schuhknecht / 37
![Page 68: Enhancing Energy Efficiency of Database Applications Using ...resources.mpi-inf.mpg.de/departments/d5/teaching/ss11/eedb/talks/Felix...Seminar Energy-Efficient Databases 29.06.2011](https://reader030.fdocuments.us/reader030/viewer/2022041217/5e062af527763d5d6546ed27/html5/thumbnails/68.jpg)
XTC DBMS - Optimizations
29
Cache Hierarchy:Application
VFS
Kernel Cache
Page Cache
Inode Cache
Directory Cache
HDD Device Cache SSD Device
User Level
Kernel Level
StorageLevel
Energy-Efficiency Seminar 29.06.2011 Felix Martin Schuhknecht / 37
![Page 69: Enhancing Energy Efficiency of Database Applications Using ...resources.mpi-inf.mpg.de/departments/d5/teaching/ss11/eedb/talks/Felix...Seminar Energy-Efficient Databases 29.06.2011](https://reader030.fdocuments.us/reader030/viewer/2022041217/5e062af527763d5d6546ed27/html5/thumbnails/69.jpg)
XTC DBMS - Optimizations
30
Problem:
Cold Buffers vs. Hot Buffers
Energy-Efficiency Seminar 29.06.2011 Felix Martin Schuhknecht / 37
![Page 70: Enhancing Energy Efficiency of Database Applications Using ...resources.mpi-inf.mpg.de/departments/d5/teaching/ss11/eedb/talks/Felix...Seminar Energy-Efficient Databases 29.06.2011](https://reader030.fdocuments.us/reader030/viewer/2022041217/5e062af527763d5d6546ed27/html5/thumbnails/70.jpg)
XTC DBMS - Experiments
31
Read performance: 1000 Transactions
Energy-Efficiency Seminar 29.06.2011 Felix Martin Schuhknecht
CPU boundI/O bound
/ 37
![Page 71: Enhancing Energy Efficiency of Database Applications Using ...resources.mpi-inf.mpg.de/departments/d5/teaching/ss11/eedb/talks/Felix...Seminar Energy-Efficient Databases 29.06.2011](https://reader030.fdocuments.us/reader030/viewer/2022041217/5e062af527763d5d6546ed27/html5/thumbnails/71.jpg)
XTC DBMS - Experiments
32Energy-Efficiency Seminar 29.06.2011 Felix Martin Schuhknecht
Read performance: 1000 vs. 10000 Transactions
I/O bound
/ 37
![Page 72: Enhancing Energy Efficiency of Database Applications Using ...resources.mpi-inf.mpg.de/departments/d5/teaching/ss11/eedb/talks/Felix...Seminar Energy-Efficient Databases 29.06.2011](https://reader030.fdocuments.us/reader030/viewer/2022041217/5e062af527763d5d6546ed27/html5/thumbnails/72.jpg)
XTC DBMS - Experiments
32Energy-Efficiency Seminar 29.06.2011 Felix Martin Schuhknecht
Read performance: 1000 vs. 10000 Transactions
I/O bound
Caching reduces
HDD drawbacks!
/ 37
![Page 73: Enhancing Energy Efficiency of Database Applications Using ...resources.mpi-inf.mpg.de/departments/d5/teaching/ss11/eedb/talks/Felix...Seminar Energy-Efficient Databases 29.06.2011](https://reader030.fdocuments.us/reader030/viewer/2022041217/5e062af527763d5d6546ed27/html5/thumbnails/73.jpg)
XTC DBMS - Experiments
33Energy-Efficiency Seminar 29.06.2011 Felix Martin Schuhknecht
Write performance: 1000 Transactions
I/O bound
10% write90% read
20% write80% read
30% write70% read
/ 37
![Page 74: Enhancing Energy Efficiency of Database Applications Using ...resources.mpi-inf.mpg.de/departments/d5/teaching/ss11/eedb/talks/Felix...Seminar Energy-Efficient Databases 29.06.2011](https://reader030.fdocuments.us/reader030/viewer/2022041217/5e062af527763d5d6546ed27/html5/thumbnails/74.jpg)
XTC DBMS - Experiments
33Energy-Efficiency Seminar 29.06.2011 Felix Martin Schuhknecht
Write performance: 1000 Transactions
I/O bound
10% write90% read
20% write80% read
30% write70% read
/ 37
![Page 75: Enhancing Energy Efficiency of Database Applications Using ...resources.mpi-inf.mpg.de/departments/d5/teaching/ss11/eedb/talks/Felix...Seminar Energy-Efficient Databases 29.06.2011](https://reader030.fdocuments.us/reader030/viewer/2022041217/5e062af527763d5d6546ed27/html5/thumbnails/75.jpg)
SSD vs. HDD - Results
34Energy-Efficiency Seminar 29.06.2011 Felix Martin Schuhknecht
Main Problem:
Papers from 2009/2010
Hardware even older
Results are partially outdated
/ 37
![Page 76: Enhancing Energy Efficiency of Database Applications Using ...resources.mpi-inf.mpg.de/departments/d5/teaching/ss11/eedb/talks/Felix...Seminar Energy-Efficient Databases 29.06.2011](https://reader030.fdocuments.us/reader030/viewer/2022041217/5e062af527763d5d6546ed27/html5/thumbnails/76.jpg)
SSD vs. HDD - Results
35Energy-Efficiency Seminar 29.06.2011 Felix Martin Schuhknecht
Device Type Name Sequ. Read
Sequ. Write
Random Read
Random Write
Intel X25-M SSD3250
MB/s70
MB/s35,000pages/s
3,300 pages/s
Intel 320 Series NEW
270MB/s
165MB/s
39,000pages/s
21,000pages/s
Old vs. New:
/ 37
![Page 77: Enhancing Energy Efficiency of Database Applications Using ...resources.mpi-inf.mpg.de/departments/d5/teaching/ss11/eedb/talks/Felix...Seminar Energy-Efficient Databases 29.06.2011](https://reader030.fdocuments.us/reader030/viewer/2022041217/5e062af527763d5d6546ed27/html5/thumbnails/77.jpg)
SSD vs. HDD - Results
36Energy-Efficiency Seminar 29.06.2011 Felix Martin Schuhknecht
Conclusions:
• Today, high-end SSDs outperform HDDs in all cases.
Performance Energy Efficiency
/ 37
![Page 78: Enhancing Energy Efficiency of Database Applications Using ...resources.mpi-inf.mpg.de/departments/d5/teaching/ss11/eedb/talks/Felix...Seminar Energy-Efficient Databases 29.06.2011](https://reader030.fdocuments.us/reader030/viewer/2022041217/5e062af527763d5d6546ed27/html5/thumbnails/78.jpg)
SSD vs. HDD - Results
36Energy-Efficiency Seminar 29.06.2011 Felix Martin Schuhknecht
Conclusions:
• Today, high-end SSDs outperform HDDs in all cases.
Performance Energy Efficiency
Replace all HDDs with SSDs? → Expensive!
/ 37
![Page 79: Enhancing Energy Efficiency of Database Applications Using ...resources.mpi-inf.mpg.de/departments/d5/teaching/ss11/eedb/talks/Felix...Seminar Energy-Efficient Databases 29.06.2011](https://reader030.fdocuments.us/reader030/viewer/2022041217/5e062af527763d5d6546ed27/html5/thumbnails/79.jpg)
SSD vs. HDD - Results
37Energy-Efficiency Seminar 29.06.2011 Felix Martin Schuhknecht
Conclusions:
• Hybrid Systems: Integrate SSDs into existing environment.
• Storage awareness needed (SSD-aware buffer manager)
• Clever data distribution needed (e.g. Index on SSD).
• Remove unnecessary HDD opmizations (ListPrefetch).
• Exploit efficient Standby-Mode of SSDs.
/ 37