Post on 15-Feb-2018
Lightning Overview
• 2U 30(U.2) or 60(M.2) NVMe SSDs
• Flexible Choice of Various SSDs Form Factors
• Tool-less and Modularized Design for Easy Maintenance
• Ultra-high IOPS and microsecond grade latency
Lightning (ST7200)
Evolution from Lightning
Thunder (ST300)Lightning (ST7200)
Physically designed as a 1U 19”
to Thunder
Thunder Key Features
• 1U 24 hot-pluggable U.2 NVMe with two x16 PCIe Gen3 Uplinks supported
• PSU & Cooling redundancy, tool-less drawer for Easy SSD Maintenance
• Flexible SSD resource reassignment
• Excellent system performance
Thunder (ST300)
IOM
RJ-45 / PCIe x16
I/O Modules (68.5 x 102mm)
(Front access SKU)
4056 Fan
4+1
Tool-less maintenance
Drive Plane Board
421 x 590 mm
DPB
2.5” U.2 NVMe SSD
24 pcs, with SSD carrier
FCB
Fan Control Board
135 x 363.56 mm
Chassis
446(W) x 800(D) mm
SSD drawer
Easier SSD maintenance
I/O Module
(Rear access SKU*)
IOM
PSU
1+1
System Architecture
Block Diagram
IOM
x 12
PCIe x4
x 12
PCIe x4
Internal
Cables U.2 SSD x 12
2.5” SSD2.5” SSDU.2 SSD
U.2 SSD x 12
2.5” SSD2.5” SSDU.2 SSD
IOM
DPB
BMC(AST2500)
PCIe Switch
96 lanes
PCIe Switch
96 lanes
I2C
I2C
I2C &
PowerFCB
PCIe x16
PCIe x16
I2C
Switch
I2C
Switch
I2C
Switch
I2C
Switch
I2C
I2C
I2C
I2C
PHYRJ45 RJ45 RJ45
x 8 x 8
x 12
PCIe x4
x 12
PCIe x4
U.2 SSD x 12
2.5” SSD2.5” SSDU.2 SSD
U.2 SSD x 12
2.5” SSD2.5” SSDU.2 SSD
PCIe Switch
96 lanes
PCIe Switch
96 lanes
I2C
I2C
I2C
Switch
I2C
Switch
I2C
Switch
I2C
Switch
I2C
I2C
I2C
I2C
External
Cables
Host#
1
PCIe x 16
PCIe x 16
DPB
BMC(AST2500)
PCIe x16
PCIe x16
PHYRJ45
Block Diagram with Dedicated Host
• 1 host access 24 NVMe SSDs through two PCIe x16 with two re-timer cards
With 1 Host
Internal
Cables
IOM
IOMRJ45 RJ45
x 8 x 8
• Each host accesses up to 24 NVMe SSDs by flexible NVMe SSD reassignment. The dynamic partitioning provides for uses to allocate SSD pools dynamically.
With 2 Hosts
x 12
PCIe x4
x 12
PCIe x4
U.2 SSD x 12
2.5” SSD2.5” SSDU.2 SSD
U.2 SSD x 12
2.5” SSD2.5” SSDU.2 SSD
PCIe Switch
96 lanes
PCIe Switch
96 lanes
I2C
I2C
I2C
Switch
I2C
Switch
I2C
Switch
I2C
Switch
I2C
I2C
I2C
I2CHost#
2
Host#
1
PCIe x 16
PCIe x 16
Block Diagram with 2 Hosts(Flexible Resource allocation among Hosts)
DPB
BMC(AST2500)
PCIe x16
PCIe x16
PHYRJ45
External
Cables
Internal
Cables
RJ45
IOM
IOMRJ45 RJ45
x 8 x 8
Manageability of BMC
Monitor• Temperature• Voltage• Power
Consumption
Control• Fan Speed• LED
USB, I2C, Ethernet OOB (Out-of-band)
Host #1
CPU
BMC
USB
I2C
Drive Plane Board
BMC
RJ
45
USB
I2C
NIC
PCIe
Switch
Cable
Flexible IOM for Front / Rear Cabling
IOM for Front cabling IOM for Rear cabling
Front View Rear View
Physical connection with Thunder
19”
OCP Server
IOMOut-band BMC
Management
External PCIe x16 Cable Standard low profile
OCP PCIe-retimer Card
19”
Generic ServerThunder
Standard low profile
OCP PCIe-retimer Card
IOM
External PCIe x16 cable
High Key Performance
VSJBOF**
12 NVMe SSD
JBOF*12 SATA SSD
JBOD*12 SAS HDD VS
* The measurement in SAS JBOD and SATA JBOF system were based on two miniSAS HD x4 connection
** The measurement in NVMe JBOF system was based on PCIex16 connection
• Disk IO Performance
Throughput, IOPS
• IO-Watt Performance (Performance/Price)
IOPS / Watt
5X Throughput + 854X IOPS
0
5000
10000
15000
Sequential Read Sequential WriteBa
nd
wid
th M
B/s
100% 32K Sequential
SAS12G HDD JBOD SATA SSD JBOF NVMe JBOF (Thunder)
- Actual Throughput- READ : GB/s
- WRITE : GB/s
Theoretical PCIe Gen3 x16 = 15.754GB/s (128b/130b)
Based on FIO 2.1.10 + CentOS 7.2
2x2x5x
0
500
1000
1500
2000
2500
Random Read Random Write
IOP
s K
100% 4K Random
SAS12G HDD JBOD SATA SSD JBOF NVMe JBOF (Thunder) - Actual IOPs- READ : IOPs
- WRITE : IOPs
294x169x
854x
338x
Significant IO-Watt Performance
0
2000
4000
6000
8000
10000
12000
SAS12G HDD JBOD SATA SSD JBOF NVMe JBOF (Thunder)
IOPS (per PCIe Switch) = 2329k
IO-Watt = (IOPS x 2) / (Power Consumption)
= 2329k x 2 / 450W
= 10351
NVMe JBOF <450w
IOPS/Watt
Wiwynn’s High Density NVMe Storage
Thunder (ST300)@ B3
• Service more CSPs with same Lightning DNA
• Flexible PCIe cabling for Cold/Hot aisle
• Tool-less drawer for Easy SSD Maintenance
• Redundant PSUs and Cooling design
• Flexible SSD resource reassignment
• Excellent System Performance 26GB/s Throughput 4,658K IOPS 10,351 IOPS/Watt