MEMS Based Storage Architecture for Relational Databases
description
Transcript of MEMS Based Storage Architecture for Relational Databases
![Page 1: MEMS Based Storage Architecture for Relational Databases](https://reader035.fdocuments.us/reader035/viewer/2022070405/56813da3550346895da76a62/html5/thumbnails/1.jpg)
Arjun SureshS7, R
College of Engineering Trivandrum
![Page 2: MEMS Based Storage Architecture for Relational Databases](https://reader035.fdocuments.us/reader035/viewer/2022070405/56813da3550346895da76a62/html5/thumbnails/2.jpg)
MEMS-based storageRelational database layoutFRM (Flexible Retrieval Model) Query Processing on FRMEvaluationConclusion
Outline
![Page 3: MEMS Based Storage Architecture for Relational Databases](https://reader035.fdocuments.us/reader035/viewer/2022070405/56813da3550346895da76a62/html5/thumbnails/3.jpg)
Building Storage on MEMSMEMS are Micro Electrical Mechanical Systems.
Basic functions: sensors and actuators
Built by standard silicon processing
Combine mechanical and electrical components
Enable “systems-on-a-chip”
![Page 4: MEMS Based Storage Architecture for Relational Databases](https://reader035.fdocuments.us/reader035/viewer/2022070405/56813da3550346895da76a62/html5/thumbnails/4.jpg)
Why need MEMS-based storage? Huge gaps between disks and RAM
1000,000 latency gap (10ms vs 50 ns), widening 50% yearly.
1000 price gap per byte 1000 life gap
MEMS narrows gaps 10X smaller latency than disk 100X cheaper than RAM in the range 1 – 10 GB 100 MB - 1 GB/s bandwidth 10 GB capacity with a penny size
Desired for energy and volume critical systems
![Page 5: MEMS Based Storage Architecture for Relational Databases](https://reader035.fdocuments.us/reader035/viewer/2022070405/56813da3550346895da76a62/html5/thumbnails/5.jpg)
EEPROM/Flash
DRAM
Hard Disk
Latency
Cos
t p
er B
yte
MEMS-based Storage
Technology Trends
![Page 6: MEMS Based Storage Architecture for Relational Databases](https://reader035.fdocuments.us/reader035/viewer/2022070405/56813da3550346895da76a62/html5/thumbnails/6.jpg)
Using pits in the polymers made by tip heating to store data
IBM Millipede
![Page 7: MEMS Based Storage Architecture for Relational Databases](https://reader035.fdocuments.us/reader035/viewer/2022070405/56813da3550346895da76a62/html5/thumbnails/7.jpg)
MEMS Storage Architecture
Read/writetips
Read/writetips
MediaMedia
Bits storedunderneatheach tip
Bits storedunderneatheach tip
side view
![Page 8: MEMS Based Storage Architecture for Relational Databases](https://reader035.fdocuments.us/reader035/viewer/2022070405/56813da3550346895da76a62/html5/thumbnails/8.jpg)
MEMS Storage Architecture
Media Sled
X
Y
![Page 9: MEMS Based Storage Architecture for Relational Databases](https://reader035.fdocuments.us/reader035/viewer/2022070405/56813da3550346895da76a62/html5/thumbnails/9.jpg)
Springs Springs
SpringsSprings
MEMS Storage Architecture
![Page 10: MEMS Based Storage Architecture for Relational Databases](https://reader035.fdocuments.us/reader035/viewer/2022070405/56813da3550346895da76a62/html5/thumbnails/10.jpg)
Anchors attachthe springs tothe chip.
Anchors attachthe springs tothe chip.
Anchor Anchor
AnchorAnchor
X
Y
MEMS Storage Architecture
![Page 11: MEMS Based Storage Architecture for Relational Databases](https://reader035.fdocuments.us/reader035/viewer/2022070405/56813da3550346895da76a62/html5/thumbnails/11.jpg)
Sled is freeto move
Sled is freeto move
X
Y
MEMS Storage Architecture
![Page 12: MEMS Based Storage Architecture for Relational Databases](https://reader035.fdocuments.us/reader035/viewer/2022070405/56813da3550346895da76a62/html5/thumbnails/12.jpg)
Sled is freeto move
Sled is freeto move
X
Y
MEMS Storage Architecture
![Page 13: MEMS Based Storage Architecture for Relational Databases](https://reader035.fdocuments.us/reader035/viewer/2022070405/56813da3550346895da76a62/html5/thumbnails/13.jpg)
Springs pullsled towardcenter
Springs pullsled towardcenter
X
Y
MEMS Storage Architecture
![Page 14: MEMS Based Storage Architecture for Relational Databases](https://reader035.fdocuments.us/reader035/viewer/2022070405/56813da3550346895da76a62/html5/thumbnails/14.jpg)
X
Y
Springs pullsled towardcenter
Springs pullsled towardcenter
MEMS Storage Architecture
![Page 15: MEMS Based Storage Architecture for Relational Databases](https://reader035.fdocuments.us/reader035/viewer/2022070405/56813da3550346895da76a62/html5/thumbnails/15.jpg)
Actuators pullsled in bothdimensions
Actuators pullsled in bothdimensions
Actuator
Actuator
Actuator
X
Y
MEMS Storage Architecture
![Page 16: MEMS Based Storage Architecture for Relational Databases](https://reader035.fdocuments.us/reader035/viewer/2022070405/56813da3550346895da76a62/html5/thumbnails/16.jpg)
Actuators pullsled in bothdimensions
Actuators pullsled in bothdimensions
X
Y
MEMS Storage Architecture
![Page 17: MEMS Based Storage Architecture for Relational Databases](https://reader035.fdocuments.us/reader035/viewer/2022070405/56813da3550346895da76a62/html5/thumbnails/17.jpg)
Actuators pullsled in bothdimensions
Actuators pullsled in bothdimensions
X
Y
MEMS Storage Architecture
![Page 18: MEMS Based Storage Architecture for Relational Databases](https://reader035.fdocuments.us/reader035/viewer/2022070405/56813da3550346895da76a62/html5/thumbnails/18.jpg)
Actuators pullsled in bothdimensions
Actuators pullsled in bothdimensions
X
Y
MEMS Storage Architecture
![Page 19: MEMS Based Storage Architecture for Relational Databases](https://reader035.fdocuments.us/reader035/viewer/2022070405/56813da3550346895da76a62/html5/thumbnails/19.jpg)
Actuators pullsled in bothdimensions
Actuators pullsled in bothdimensions
X
Y
MEMS Storage Architecture
![Page 20: MEMS Based Storage Architecture for Relational Databases](https://reader035.fdocuments.us/reader035/viewer/2022070405/56813da3550346895da76a62/html5/thumbnails/20.jpg)
Probe tipsare fixed
Probe tipsare fixed
Probe tip
Probe tip
X
Y
MEMS Storage Architecture
![Page 21: MEMS Based Storage Architecture for Relational Databases](https://reader035.fdocuments.us/reader035/viewer/2022070405/56813da3550346895da76a62/html5/thumbnails/21.jpg)
X
Y
Probe tipsare fixed
Probe tipsare fixed
MEMS Storage Architecture
![Page 22: MEMS Based Storage Architecture for Relational Databases](https://reader035.fdocuments.us/reader035/viewer/2022070405/56813da3550346895da76a62/html5/thumbnails/22.jpg)
X
Y
Sled onlymoves overthe area of asingle rectangle
Sled onlymoves overthe area of asingle rectangle
One probe tipper rectangle
One probe tipper rectangle
Each tipaccesses dataat the samerelative position
Each tipaccesses dataat the samerelative position
MEMS Storage Architecture
![Page 23: MEMS Based Storage Architecture for Relational Databases](https://reader035.fdocuments.us/reader035/viewer/2022070405/56813da3550346895da76a62/html5/thumbnails/23.jpg)
Properties of MEMS Storage
Sweep area of
One probe tip
![Page 24: MEMS Based Storage Architecture for Relational Databases](https://reader035.fdocuments.us/reader035/viewer/2022070405/56813da3550346895da76a62/html5/thumbnails/24.jpg)
Properties of MEMS Storage
N bits
M b
its
One tip region
One tip sector
![Page 25: MEMS Based Storage Architecture for Relational Databases](https://reader035.fdocuments.us/reader035/viewer/2022070405/56813da3550346895da76a62/html5/thumbnails/25.jpg)
Physical Parameters
Number of tips 6400
Max number of active tips 1280
Tip sector size 8 bytes
Bits per tip region 2000X2000
X axis settle time 0.125ms
Average turnaround time 0.06ms
![Page 26: MEMS Based Storage Architecture for Relational Databases](https://reader035.fdocuments.us/reader035/viewer/2022070405/56813da3550346895da76a62/html5/thumbnails/26.jpg)
Existing Work on Integration of MEMS StorageSolution proposed by CMU researchers
Mapping MEMS storage into conventional diskAdapt I/O scheduling and data placement to
MEMS
Preliminary study showsReduce the I/O stall times by 4 to 74 times over
disksImprove the overall application run times by
1.9 to 4.4Reduce the energy consumption by 10-54 times
![Page 27: MEMS Based Storage Architecture for Relational Databases](https://reader035.fdocuments.us/reader035/viewer/2022070405/56813da3550346895da76a62/html5/thumbnails/27.jpg)
Better solutions??The approach of mapping MEMS into disk
Simplify the procedure of integration of MEMSDoes not consider the physical properties of
MEMS
![Page 28: MEMS Based Storage Architecture for Relational Databases](https://reader035.fdocuments.us/reader035/viewer/2022070405/56813da3550346895da76a62/html5/thumbnails/28.jpg)
Relational Data Placement
StudentGrade
recordIDname
char(16)
perm ID
int(8)
age
int(8)
grade
int(8)
record1 Mary 572 19 86
record2 John 582 18 90
record3 Bob 511 18 80
record4 Jane 537 20 91
![Page 29: MEMS Based Storage Architecture for Relational Databases](https://reader035.fdocuments.us/reader035/viewer/2022070405/56813da3550346895da76a62/html5/thumbnails/29.jpg)
N-ary Storage Model (NSM)
Store records in a relation in slotted disk pages
Organize records sequentially on the disk pages
Page Header Mary 572
19 86 John 582
18 90 Bob 511
18 80 Jane 537
20 91
P4 P3 P2 p1
![Page 30: MEMS Based Storage Architecture for Relational Databases](https://reader035.fdocuments.us/reader035/viewer/2022070405/56813da3550346895da76a62/html5/thumbnails/30.jpg)
Decomposition Storage Model(DSM)
Divide a relation into sub-relations based on the number of attributes
Each sub-relation corresponds to each attribute
Each sub-relation is organized into pages in the same way as NSM
Page Header 1 Mary 2
John 3 Bob 4 Jane
P4 P3 P2 P1
Page Header 1 572 2
582 3 511 4 537
P4 P3 P2 P1
Page Header 1 19 2
18 3 18 4 20
P4 P3 P2 P1
Page Header 1 86 2
90 3 80 4 91
P4 P3 P2 P1
grade
name perm ID
age
A disk page A disk page
A disk page A disk page
![Page 31: MEMS Based Storage Architecture for Relational Databases](https://reader035.fdocuments.us/reader035/viewer/2022070405/56813da3550346895da76a62/html5/thumbnails/31.jpg)
Partition Attributes Across (PAX)Within each page, PAX
groups all values of each attribute into a mini-page
A page is divided into mini-pages based on the number of attributes
It stores the same data as NSM in each page
Page Header Mary John
Bob Jane
P4 P3 P2 P1
572 582 511 537
P4 P3 P2 P1
19 18 18 20
P4 P3 P2 P1
81 90 80 91
P4 P3 P2 P1
A disk page
![Page 32: MEMS Based Storage Architecture for Relational Databases](https://reader035.fdocuments.us/reader035/viewer/2022070405/56813da3550346895da76a62/html5/thumbnails/32.jpg)
Common Workload RequirementsRelational data should be compatible with
OLTP workloads Due to the update characteristics, relations need to
be accessed in a row-wise mannerOLAP workloads
Only a subset of attributes is of interest, data placement should facilitate data retrieval on a column-wise fashion
![Page 33: MEMS Based Storage Architecture for Relational Databases](https://reader035.fdocuments.us/reader035/viewer/2022070405/56813da3550346895da76a62/html5/thumbnails/33.jpg)
Flexible Retrieval Model (FRM)
Facilitates data retrieval in both row-wise and column-wise mannerRetrieves the relevant subsets of the relationsUses two dimensional layout of MEMS storage
Improves the I/O utilizationMaximize the concurrent tips to only retrieve the
necessary data
It is also cache-friendlyUse intra-record locality
![Page 34: MEMS Based Storage Architecture for Relational Databases](https://reader035.fdocuments.us/reader035/viewer/2022070405/56813da3550346895da76a62/html5/thumbnails/34.jpg)
FRM Data Placement and Retrieval
Given a relation with three attributes, the size of each attribute is 8 bytes
Placing this relation in 4x4 MEMS-based storage
4 concurrent tips
(0, 0)
(0, 1)
(0, 0)
(0, 1)
Attr1 Attr2 Attr3
(0, 0)
(0, 0)
(0, 1)
(0, 1)
(0, 2)
(0, 2)
(0, 2)
(0, 2)
(1, 2)
![Page 35: MEMS Based Storage Architecture for Relational Databases](https://reader035.fdocuments.us/reader035/viewer/2022070405/56813da3550346895da76a62/html5/thumbnails/35.jpg)
Query Processing on FRMSelection and projection without index
Two-dimensional table scanSelection and projection with index
Encode data position as 4-tuple (tip-x, tip-y, offset-x, offset-y)
JoinsIndex-based or hash
![Page 36: MEMS Based Storage Architecture for Relational Databases](https://reader035.fdocuments.us/reader035/viewer/2022070405/56813da3550346895da76a62/html5/thumbnails/36.jpg)
Experiment SetupMEMS storage: 1280 concurrent tips out of
6400 total tipsPentium II Celeron 433X2 processorsL1 cache:16KB, 32-byte cache line, 20 ns
delayL2 cache:128KB, 32-byte cache line, 200
ns delayA relation R with 1.28 million recordsSixteen 8-byte attributes in each recordQueries:
SELECT A1, A2,…, An
FROM R WHERE A1 > Bound;
![Page 37: MEMS Based Storage Architecture for Relational Databases](https://reader035.fdocuments.us/reader035/viewer/2022070405/56813da3550346895da76a62/html5/thumbnails/37.jpg)
Memory utilization
The selected attributes in queries
Con
sum
ed m
emor
y(M
B)
![Page 38: MEMS Based Storage Architecture for Relational Databases](https://reader035.fdocuments.us/reader035/viewer/2022070405/56813da3550346895da76a62/html5/thumbnails/38.jpg)
I/O performance
NSM and PAX have the same I/O time
I/O time of FRM is proportional to the size of retrieved attributes
![Page 39: MEMS Based Storage Architecture for Relational Databases](https://reader035.fdocuments.us/reader035/viewer/2022070405/56813da3550346895da76a62/html5/thumbnails/39.jpg)
Selection Queries (2 attributes)
Cache Utilization
![Page 40: MEMS Based Storage Architecture for Relational Databases](https://reader035.fdocuments.us/reader035/viewer/2022070405/56813da3550346895da76a62/html5/thumbnails/40.jpg)
Selection Queries (13 attributes)
![Page 41: MEMS Based Storage Architecture for Relational Databases](https://reader035.fdocuments.us/reader035/viewer/2022070405/56813da3550346895da76a62/html5/thumbnails/41.jpg)
Selectivity = 50%
![Page 42: MEMS Based Storage Architecture for Relational Databases](https://reader035.fdocuments.us/reader035/viewer/2022070405/56813da3550346895da76a62/html5/thumbnails/42.jpg)
Projection Queries
Selectivity =10%
![Page 43: MEMS Based Storage Architecture for Relational Databases](https://reader035.fdocuments.us/reader035/viewer/2022070405/56813da3550346895da76a62/html5/thumbnails/43.jpg)
Conclusion and Future Work
Proposed a relational data placement scheme for MEMS-based storageTake advantage of two-dimensional MEMS access
featureArrange MEMS rows and columns to relational
attributes and recordsSave IO cost and improve cache performance
Other cache friendly techniques for MEMS-based storage devices are to be explored
![Page 44: MEMS Based Storage Architecture for Relational Databases](https://reader035.fdocuments.us/reader035/viewer/2022070405/56813da3550346895da76a62/html5/thumbnails/44.jpg)
Thank You……