E Series Training
description
Transcript of E Series Training
![Page 1: E Series Training](https://reader035.fdocuments.us/reader035/viewer/2022081507/5695d4e51a28ab9b02a3323e/html5/thumbnails/1.jpg)
Disk-Side and Host-Side Cabling
Lesson 2
![Page 2: E Series Training](https://reader035.fdocuments.us/reader035/viewer/2022081507/5695d4e51a28ab9b02a3323e/html5/thumbnails/2.jpg)
Disk-Side Cabling Best Practices
• Cable redundantly from both controllers to both ESMs in each disk shelf
• Be consistent with ESM “in” ports• Use top-down-bottom-up cabling method
2
“In” Expansion Ports “Out” Expansion Port
![Page 3: E Series Training](https://reader035.fdocuments.us/reader035/viewer/2022081507/5695d4e51a28ab9b02a3323e/html5/thumbnails/3.jpg)
E5500 Disk-Side Cabling Example
3
E5560 Controller Shelf
DE6600 Disk Shelf 1
DE6600 Disk Shelf 2
DE6600 Disk Shelf 3
![Page 4: E Series Training](https://reader035.fdocuments.us/reader035/viewer/2022081507/5695d4e51a28ab9b02a3323e/html5/thumbnails/4.jpg)
E5500 Disk-Side Cabling Example
4
To start the top-down loop, cable from the left EXP port on Controller A to the left “in” port on the top ESM in Disk Shelf 1.
![Page 5: E Series Training](https://reader035.fdocuments.us/reader035/viewer/2022081507/5695d4e51a28ab9b02a3323e/html5/thumbnails/5.jpg)
E5500 Disk-Side Cabling Example
5
Next, cable from the left EXP port on Controller B to the right “in” port on the top ESM in Disk Shelf 1.
![Page 6: E Series Training](https://reader035.fdocuments.us/reader035/viewer/2022081507/5695d4e51a28ab9b02a3323e/html5/thumbnails/6.jpg)
E5500 Disk-Side Cabling Example
6
Then cable from the “out” port on the top ESM in Disk Shelf 1 to the left “in” port on the top ESM in Disk Shelf 2.
![Page 7: E Series Training](https://reader035.fdocuments.us/reader035/viewer/2022081507/5695d4e51a28ab9b02a3323e/html5/thumbnails/7.jpg)
E5500 Disk-Side Cabling Example
7
Then cable from the “out” port on the top ESM in Disk Shelf 2 to the left “in” port on the top ESM in Disk Shelf 3 to complete the top-down cabling loop.
![Page 8: E Series Training](https://reader035.fdocuments.us/reader035/viewer/2022081507/5695d4e51a28ab9b02a3323e/html5/thumbnails/8.jpg)
E5500 Disk-Side Cabling Example
8
To start the bottom-up loop, cable from the right EXP port on Controller A to the left “in” port on the bottom ESM in Disk Shelf 3.
![Page 9: E Series Training](https://reader035.fdocuments.us/reader035/viewer/2022081507/5695d4e51a28ab9b02a3323e/html5/thumbnails/9.jpg)
E5500 Disk-Side Cabling Example
9
Next, cable from the right EXP port on Controller B to the right “in” port on the bottom ESM in Disk Shelf 3.
![Page 10: E Series Training](https://reader035.fdocuments.us/reader035/viewer/2022081507/5695d4e51a28ab9b02a3323e/html5/thumbnails/10.jpg)
E5500 Disk-Side Cabling Example
10
Then cable from the “out” port on the bottom ESM in Disk Shelf 3 to the left “in” port on the bottom ESM of Disk Shelf 2.
![Page 11: E Series Training](https://reader035.fdocuments.us/reader035/viewer/2022081507/5695d4e51a28ab9b02a3323e/html5/thumbnails/11.jpg)
E5500 Disk-Side Cabling Example
11
Then cable from the “out” port on the bottom ESM in Disk Shelf 2 to the left “in” port on the bottom ESM of Disk Shelf 1 to complete the bottom-up loop.
![Page 12: E Series Training](https://reader035.fdocuments.us/reader035/viewer/2022081507/5695d4e51a28ab9b02a3323e/html5/thumbnails/12.jpg)
E5400 Disk-Side Cabling Example
12
E5460 Controller Shelf
DE6600 Disk Shelf 1
DE6600 Disk Shelf 2
DE6600 Disk Shelf 3
![Page 13: E Series Training](https://reader035.fdocuments.us/reader035/viewer/2022081507/5695d4e51a28ab9b02a3323e/html5/thumbnails/13.jpg)
E5400 Disk-Side Cabling Example
13
To start the top-down loop, cable from the EXP port on Controller A to the left “in” port on the top ESM in Disk Shelf 1.
![Page 14: E Series Training](https://reader035.fdocuments.us/reader035/viewer/2022081507/5695d4e51a28ab9b02a3323e/html5/thumbnails/14.jpg)
E5400 Disk-Side Cabling Example
14
Next, cable from the “out” port on the top ESM in Disk Shelf 1 to the left “in” port on the top ESM in Drive Shelf 2.
![Page 15: E Series Training](https://reader035.fdocuments.us/reader035/viewer/2022081507/5695d4e51a28ab9b02a3323e/html5/thumbnails/15.jpg)
E5400 Disk-Side Cabling Example
15
Then cable from the “out” port on the top ESM in Disk Shelf 2 to the left “in” port on the top ESM in Drive Shelf 3 to complete the top-down loop.
![Page 16: E Series Training](https://reader035.fdocuments.us/reader035/viewer/2022081507/5695d4e51a28ab9b02a3323e/html5/thumbnails/16.jpg)
E5400 Disk-Side Cabling Example
16
To start the bottom-up loop, cable from the EXP port on Controller B to the left “in” port on the bottom ESM in Disk Shelf 3.
![Page 17: E Series Training](https://reader035.fdocuments.us/reader035/viewer/2022081507/5695d4e51a28ab9b02a3323e/html5/thumbnails/17.jpg)
E5400 Disk-Side Cabling Example
17
Then cable from the “out” port on the bottom ESM in Disk Shelf 3 to the left “in” port on the bottom ESM of Disk Shelf 2.
![Page 18: E Series Training](https://reader035.fdocuments.us/reader035/viewer/2022081507/5695d4e51a28ab9b02a3323e/html5/thumbnails/18.jpg)
E5400 Disk-Side Cabling Example
18
Then cable from the “out” port on the bottom ESM in Disk Shelf 2 to the left “in” port on the bottom ESM of Disk Shelf 1 to complete the bottom-up loop.
![Page 19: E Series Training](https://reader035.fdocuments.us/reader035/viewer/2022081507/5695d4e51a28ab9b02a3323e/html5/thumbnails/19.jpg)
E2700 Disk Expansion Architecture
E2700 Controllers:• Share two disk-side SAS-3 domains• Use dual-ported expansion, so external
bandwidth capability matches internal bandwidth
• Use new mini-SAS HD cable from controller to ESM
19
Mini-SAS connectors (disk shelves)
SAS Mini-HD Connectors (E2700 controllers)
![Page 20: E Series Training](https://reader035.fdocuments.us/reader035/viewer/2022081507/5695d4e51a28ab9b02a3323e/html5/thumbnails/20.jpg)
Maximizing Bandwidth Performance
• Single-stack cabling– Connect both controller EXP ports to same ESM– Daisy-chain from first disk shelf to remaining shelves
• Dual-stack cabling maximizes throughput performance– Use two daisy-chain cascades– Cable one EXP port from each controller to one “in” port in
ESM in one stack– Cable second EXP port from each controller to second “in”
port in ESM in other stack
20
![Page 21: E Series Training](https://reader035.fdocuments.us/reader035/viewer/2022081507/5695d4e51a28ab9b02a3323e/html5/thumbnails/21.jpg)
E2700 Disk-Side Cabling ExampleSingle Stack
21
E2760 Controller Shelf
DE6600 Disk Shelf 1
DE6600 Disk Shelf 2
DE6600 Disk Shelf 3
![Page 22: E Series Training](https://reader035.fdocuments.us/reader035/viewer/2022081507/5695d4e51a28ab9b02a3323e/html5/thumbnails/22.jpg)
E2700 Disk-Side Cabling ExampleSingle Stack
22
To start the top-down loop, cable from the left EXP port on Controller A to the left “in” port on the top ESM in Disk Shelf 1.
![Page 23: E Series Training](https://reader035.fdocuments.us/reader035/viewer/2022081507/5695d4e51a28ab9b02a3323e/html5/thumbnails/23.jpg)
E2700 Disk-Side Cabling ExampleSingle Stack
23
Next, cable from the right EXP port on Controller A to the right “in” port on the top ESM in Disk Shelf 1.
![Page 24: E Series Training](https://reader035.fdocuments.us/reader035/viewer/2022081507/5695d4e51a28ab9b02a3323e/html5/thumbnails/24.jpg)
E2700 Disk-Side Cabling ExampleSingle Stack
24
Next, cable from the “out” port on the top ESM in Disk Shelf 1 to the left “in” port on the top ESM in Drive Shelf 2.
![Page 25: E Series Training](https://reader035.fdocuments.us/reader035/viewer/2022081507/5695d4e51a28ab9b02a3323e/html5/thumbnails/25.jpg)
E2700 Disk-Side Cabling ExampleSingle Stack
25
Then cable from the “out” port on the top ESM in Disk Shelf 2 to the left “in” port on the top ESM in Drive Shelf 3 to complete the top-down loop.
![Page 26: E Series Training](https://reader035.fdocuments.us/reader035/viewer/2022081507/5695d4e51a28ab9b02a3323e/html5/thumbnails/26.jpg)
E2700 Disk-Side Cabling ExampleSingle Stack
26
To start the bottom-up loop, cable from the left EXP port on Controller B to the left “in” port on the bottom ESM in Disk Shelf 3.
![Page 27: E Series Training](https://reader035.fdocuments.us/reader035/viewer/2022081507/5695d4e51a28ab9b02a3323e/html5/thumbnails/27.jpg)
E2700 Disk-Side Cabling ExampleSingle Stack
27
Next, cable from the right EXP port on Controller B to the right “in” port on the bottom ESM in Disk Shelf 3.
![Page 28: E Series Training](https://reader035.fdocuments.us/reader035/viewer/2022081507/5695d4e51a28ab9b02a3323e/html5/thumbnails/28.jpg)
E2700 Disk-Side Cabling ExampleSingle Stack
28
Then cable from the “out” port on the bottom ESM in Disk Shelf 3 to the left “in” port on the bottom ESM of Disk Shelf 2.
![Page 29: E Series Training](https://reader035.fdocuments.us/reader035/viewer/2022081507/5695d4e51a28ab9b02a3323e/html5/thumbnails/29.jpg)
E2700 Disk-Side Cabling ExampleSingle Stack
29
Then cable from the “out” port on the bottom ESM in Disk Shelf 2 to the left “in” port on the bottom ESM of Disk Shelf 1 to complete the bottom-up loop.
![Page 30: E Series Training](https://reader035.fdocuments.us/reader035/viewer/2022081507/5695d4e51a28ab9b02a3323e/html5/thumbnails/30.jpg)
E2700 Disk-Side Cabling ExampleDual Stack
30
E2760 Controller Shelf
DE6600 Disk Shelf
1
DE6600 Disk Shelf
2
DE6600 Disk Shelf
3
DE6600 Disk Shelf
4
![Page 31: E Series Training](https://reader035.fdocuments.us/reader035/viewer/2022081507/5695d4e51a28ab9b02a3323e/html5/thumbnails/31.jpg)
E2700 Disk-Side Cabling ExampleDual Stack
31
![Page 32: E Series Training](https://reader035.fdocuments.us/reader035/viewer/2022081507/5695d4e51a28ab9b02a3323e/html5/thumbnails/32.jpg)
E2700 Disk-Side Cabling ExampleDual Stack
32
![Page 33: E Series Training](https://reader035.fdocuments.us/reader035/viewer/2022081507/5695d4e51a28ab9b02a3323e/html5/thumbnails/33.jpg)
E2700 Disk-Side Cabling ExampleDual Stack
33
![Page 34: E Series Training](https://reader035.fdocuments.us/reader035/viewer/2022081507/5695d4e51a28ab9b02a3323e/html5/thumbnails/34.jpg)
E2700 Disk-Side Cabling ExampleDual Stack
34
![Page 35: E Series Training](https://reader035.fdocuments.us/reader035/viewer/2022081507/5695d4e51a28ab9b02a3323e/html5/thumbnails/35.jpg)
E2700 Disk-Side Cabling ExampleDual Stack
35
![Page 36: E Series Training](https://reader035.fdocuments.us/reader035/viewer/2022081507/5695d4e51a28ab9b02a3323e/html5/thumbnails/36.jpg)
E2700 Disk-Side Cabling ExampleDual Stack
36
![Page 37: E Series Training](https://reader035.fdocuments.us/reader035/viewer/2022081507/5695d4e51a28ab9b02a3323e/html5/thumbnails/37.jpg)
E2700 Disk-Side Cabling ExampleDual Stack
37
![Page 38: E Series Training](https://reader035.fdocuments.us/reader035/viewer/2022081507/5695d4e51a28ab9b02a3323e/html5/thumbnails/38.jpg)
E2700 Disk-Side Cabling ExampleDual Stack
38
![Page 39: E Series Training](https://reader035.fdocuments.us/reader035/viewer/2022081507/5695d4e51a28ab9b02a3323e/html5/thumbnails/39.jpg)
E2600 Disk-Side Cabling Example
39
E2660 Controller Shelf
DE6600 Disk Shelf 1
DE6600 Disk Shelf 2
DE6600 Disk Shelf 3
![Page 40: E Series Training](https://reader035.fdocuments.us/reader035/viewer/2022081507/5695d4e51a28ab9b02a3323e/html5/thumbnails/40.jpg)
E2600 Disk-Side Cabling Example
40
To start the top-down loop, cable from the EXP port on Controller A to the left “in” port on the top ESM in Disk Shelf 1.
![Page 41: E Series Training](https://reader035.fdocuments.us/reader035/viewer/2022081507/5695d4e51a28ab9b02a3323e/html5/thumbnails/41.jpg)
E2600 Disk-Side Cabling Example
41
Next, cable from the “out” port on the top ESM in Disk Shelf 1 to the left “in” port on the top ESM in Drive Shelf 2.
![Page 42: E Series Training](https://reader035.fdocuments.us/reader035/viewer/2022081507/5695d4e51a28ab9b02a3323e/html5/thumbnails/42.jpg)
E2600 Disk-Side Cabling Example
42
Then cable from the “out” port on the top ESM in Disk Shelf 2 to the left “in” port on the top ESM in Drive Shelf 3 to complete the top-down loop.
![Page 43: E Series Training](https://reader035.fdocuments.us/reader035/viewer/2022081507/5695d4e51a28ab9b02a3323e/html5/thumbnails/43.jpg)
E2600 Disk-Side Cabling Example
43
To start the bottom-up loop, cable from the EXP port on Controller B to the left “in” port on the bottom ESM in Disk Shelf 3.
![Page 44: E Series Training](https://reader035.fdocuments.us/reader035/viewer/2022081507/5695d4e51a28ab9b02a3323e/html5/thumbnails/44.jpg)
E2600 Disk-Side Cabling Example
44
Then cable from the “out” port on the bottom ESM in Disk Shelf 3 to the left “in” port on the bottom ESM of Disk Shelf 2.
![Page 45: E Series Training](https://reader035.fdocuments.us/reader035/viewer/2022081507/5695d4e51a28ab9b02a3323e/html5/thumbnails/45.jpg)
E2600 Disk-Side Cabling Example
45
Then cable from the “out” port on the bottom ESM in Disk Shelf 2 to the left “in” port on the bottom ESM of Disk Shelf 1 to complete the bottom-up loop.
![Page 46: E Series Training](https://reader035.fdocuments.us/reader035/viewer/2022081507/5695d4e51a28ab9b02a3323e/html5/thumbnails/46.jpg)
Snapshot Copy-on-Write Technology
46
BaseVolume
Physical Disk Capacity
Snapshot Group
Repository
Physical disk capacity
Logical (No Actual Disk Capacity)
![Page 47: E Series Training](https://reader035.fdocuments.us/reader035/viewer/2022081507/5695d4e51a28ab9b02a3323e/html5/thumbnails/47.jpg)
Copy-on-Write Example
A B C D E GF IH
A B D G I Base Volume
Snapshot
Repository
J
C
Changed Data Blocks in Base Volume
47
C F M
H
HK
E
L
F
E
![Page 48: E Series Training](https://reader035.fdocuments.us/reader035/viewer/2022081507/5695d4e51a28ab9b02a3323e/html5/thumbnails/48.jpg)
Snapshot Considerations
• Performance impact considerations– Copy-on-write technology– Number of changes made to Snapshot volume– Repository full situations
• Capacity considerations– Snapshot takes less actual capacity than actual
clone copy– Repository takes some disk capacity
48
![Page 49: E Series Training](https://reader035.fdocuments.us/reader035/viewer/2022081507/5695d4e51a28ab9b02a3323e/html5/thumbnails/49.jpg)
Disk Pools
To start creating disk pools, you right-click Unconfigured Capacity.Disk pools have fewer options but they have dynamic functionality:• In GUI, no choice
of individual disks attime of creation
• No RAID-level choice
• 11-disk minimum• No drawer loss
protection
49
![Page 50: E Series Training](https://reader035.fdocuments.us/reader035/viewer/2022081507/5695d4e51a28ab9b02a3323e/html5/thumbnails/50.jpg)
Disk Pool Data Usage
• 4-GB d-stripe made of 10 d-pieces residing on 10 disks within pool• Intelligent algorithm defines which disks used:‒ Different set of 10 disks used for each d-stripe‒ Pseudorandom d-stripe distribution maintains balance
50
24-Drive Disk Pool
![Page 51: E Series Training](https://reader035.fdocuments.us/reader035/viewer/2022081507/5695d4e51a28ab9b02a3323e/html5/thumbnails/51.jpg)
Default Preservation Capacity
• Functions like hot spares for disk pools• Set at pool creation• Can be altered later to
more or less capacity:– Minimum amount
required: 0– Maximum amount
supported: 10 disks’ worth
51
Number of Disks in Pool
Default Capacity (Number of Disks’
Worth)
11 1
12–31 2
32–63 3
64–127 4
128–191 6
192–255 7
256–384 8
![Page 52: E Series Training](https://reader035.fdocuments.us/reader035/viewer/2022081507/5695d4e51a28ab9b02a3323e/html5/thumbnails/52.jpg)
24-Drive Disk Pool Becomes 23-Drive Disk Pool
Dynamic Disk Pools: Disk Failure
• For each d-stripe with data on the failed disk:‒ Segments on other disks read to recreate data‒ Data written to set of 10 disks in pool
• Rebuild operations run in parallel across all disks
52
![Page 53: E Series Training](https://reader035.fdocuments.us/reader035/viewer/2022081507/5695d4e51a28ab9b02a3323e/html5/thumbnails/53.jpg)
Controller Cache
• Is dedicated to these I/O operations:– Between controllers and hosts– Between controllers and disks
• Increases controller performance:– Acts as buffer for I/O– Provides faster reads/writes than disk access– Speeds up writes when write-back caching used– Uses “prefetch” to speed up sequential reads
53
![Page 54: E Series Training](https://reader035.fdocuments.us/reader035/viewer/2022081507/5695d4e51a28ab9b02a3323e/html5/thumbnails/54.jpg)
Cache Data FlowWrite Caching
Host App
Disk I/OQueue
W W R R W
? W
Response: okay
54
![Page 55: E Series Training](https://reader035.fdocuments.us/reader035/viewer/2022081507/5695d4e51a28ab9b02a3323e/html5/thumbnails/55.jpg)
Cache Data FlowRequest for Data Location in Cache
Host App
Disk I/Oqueue is full.
? 0x03 0x01
0x0f
0x03
Response: okay
I/O is writtento cache.
55
![Page 56: E Series Training](https://reader035.fdocuments.us/reader035/viewer/2022081507/5695d4e51a28ab9b02a3323e/html5/thumbnails/56.jpg)
Cache Data FlowRead Caching
Host App
Disk I/OQueue Full
0x03 0x01
0x0f
Response: okay
I/O is handledby cache.
Read 0x3
0x03
56
![Page 57: E Series Training](https://reader035.fdocuments.us/reader035/viewer/2022081507/5695d4e51a28ab9b02a3323e/html5/thumbnails/57.jpg)
Cache Flushing
• Cache automatically “flushed” to disk:– Age based: When data times out (10-second
default)– Demand based: When cache space reaches fill
point• Start demand cache flushing: When start
percentage reached, controller starts flushing data in cache to disks
57
![Page 58: E Series Training](https://reader035.fdocuments.us/reader035/viewer/2022081507/5695d4e51a28ab9b02a3323e/html5/thumbnails/58.jpg)
Cache Blocks
• Free cache: Empty cache blocks available for data
• Dirty cache: Data in cache block not yet written to disk
• Clean cache: Data in cache block consistent with data on disk
58
FreeCache
DirtyCache
CleanCache
![Page 59: E Series Training](https://reader035.fdocuments.us/reader035/viewer/2022081507/5695d4e51a28ab9b02a3323e/html5/thumbnails/59.jpg)
Flushing ExampleFree Cache Area
FreeCache
DirtyCache
CleanCache
Flush threshold start = 50%Write cache is enabled.Read cache is enabled.
59
![Page 60: E Series Training](https://reader035.fdocuments.us/reader035/viewer/2022081507/5695d4e51a28ab9b02a3323e/html5/thumbnails/60.jpg)
Flushing ExampleInitial I/O
60
0x0
0x1 0x4
0x3 0x6
FreeCache
DirtyCache
CleanCache
Flush threshold start = 50%Write cache is enabled.Read cache is enabled.
Read 0x0Read 0x1Read 0x3Read 0x4Write 0x3 (cache hit)Read 0x6
Read 0x0Read 0x1Read 0x3Read 0x4Read 0x6
![Page 61: E Series Training](https://reader035.fdocuments.us/reader035/viewer/2022081507/5695d4e51a28ab9b02a3323e/html5/thumbnails/61.jpg)
Flushing ExampleDirty Cache
FreeCache
DirtyCache
CleanCache
Flush threshold start = 50%Write cache is enabled.Read cache is enabled.
61
Read 0x3Read 0xaRead 0x1Write 0x7Write 0x3
Read 0xa0x0
0x1 0x4 0xa
0x3 0x6 0x7
![Page 62: E Series Training](https://reader035.fdocuments.us/reader035/viewer/2022081507/5695d4e51a28ab9b02a3323e/html5/thumbnails/62.jpg)
Flushing ExampleStart demand cache flushing Threshold Reached
Write 0x3Write 0xaWrite 0xbWrite 0x2Read 0x3
Write 0x0Write 0x7Write 0xb
62
FreeCache
DirtyCache
CleanCache
Flush threshold start = 50%Write cache is enabled.Read cache is enabled.
0x0
0x1 0x4 0xb0xa
0x3 0x6 0x7
![Page 63: E Series Training](https://reader035.fdocuments.us/reader035/viewer/2022081507/5695d4e51a28ab9b02a3323e/html5/thumbnails/63.jpg)
Flushing ExampleAfter the Cache Flush
FreeCache
DirtyCache
CleanCache
Flush threshold start = 50%Write cache is enabled.Read cache is enabled.
63
0x0
0x1 0x4 0xb0xa
0x3 0x6 0x7
![Page 64: E Series Training](https://reader035.fdocuments.us/reader035/viewer/2022081507/5695d4e51a28ab9b02a3323e/html5/thumbnails/64.jpg)
FreeCache
DirtyCache
CleanCache
Flush threshold start = 50%Write cache is enabled.Read cache is enabled.
64
0x0
0x1 0x4 0xb0xa
0x3 0x6 0x7Write 0xc (uses LRU) 0x5
0xd 0xc
Flushing ExampleLeast Recently Used Queue
Read 0x5Read 0x5 (uses LRU)Read 0x0 (cache hit)
Write 0x3 (cache hit)
Read 0xd (uses LRU)
Read 0xd