Kinetic swift quick tour

24
Tim Feldman Technologist Product Development @timfoon OpenStack Icehouse Design Summit November 2013

Transcript of Kinetic swift quick tour

Page 1: Kinetic swift quick tour

Tim Feldman Technologist Product Development @timfoon

OpenStack Icehouse Design Summit November 2013

Page 2: Kinetic swift quick tour

Agenda

••••

Page 3: Kinetic swift quick tour

•–

»»

»

•–

Workload Generation, Tracing and Analysis

Page 4: Kinetic swift quick tour

Detailed look a 3 of 60 drives

disk s2b1/sdn (low)

s3b1/sdd (ave)

s3b1/sdp (high)

trace duration [minutes] 29.2 29.1 29.1 command rate [IOPS] 37.4 52.5 57.9 data transferred [GB] 20.8 23.6 25.9

data throughput [MB/s] 11.9 13.5 14.8

Page 5: Kinetic swift quick tour

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

0.1 1 10 100 1000 10000 100000

Cum

ulat

ive

Port

ion

Sequential Run Length [KiB]

swift-bench 20-MiB objectsSequential Run Counts and Data Transfer Counts by Sequential Run Size

high seq'l run count

med. seq'l run count

low seq'l run count

high data xfer count

med. data xfer count

low data xfer count

90% of the disk ops move 1% of the data

Page 6: Kinetic swift quick tour

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

0.1 1 10 100 1000 10000 100000

Cum

ulat

ive

Port

ion

Sequential Run Length [KiB]

swift-bench 20-MiB objectsSequential Run Counts and Data Transfer Counts by Sequential Run Size

high seq'l run count

med. seq'l run count

low seq'l run count

high data xfer count

med. data xfer count

low data xfer count

Page 7: Kinetic swift quick tour

When, where and how big

Page 8: Kinetic swift quick tour

A new open storage platform

Page 9: Kinetic swift quick tour

Disintermediated Hardware and Software

Page 10: Kinetic swift quick tour

•–

•–

•–

Disintermediate

Page 11: Kinetic swift quick tour

Disaggregated Storage

Page 12: Kinetic swift quick tour

•–

•–

Disaggregate

Page 13: Kinetic swift quick tour

Seagate’s Kinetic Open Storage Platform

Page 14: Kinetic swift quick tour

•••

SAS versus Kinetic Open Storage

•••

Page 15: Kinetic swift quick tour

Device Functional Model

Kinetic

Page 16: Kinetic swift quick tour

•–

•–

–»»

Kinetic Open Storage API

Partition Collection Name Chunk id

Page 17: Kinetic swift quick tour

•–

Kinetic Open Storage API

Page 18: Kinetic swift quick tour

•–

•–

•–

Kinetic Open Storage API

Page 19: Kinetic swift quick tour

•–

–»»

–»

Kinetic Open Storage API

Page 20: Kinetic swift quick tour

•»

•–

Kinetic Open Storage API

Page 21: Kinetic swift quick tour

•–

–»»»»

Kinetic Open Storage API

Page 22: Kinetic swift quick tour

•»»

•»»»

Kinetic-Swift In Action

Page 23: Kinetic swift quick tour

Kinetic-Swift Topology

Page 24: Kinetic swift quick tour

Kinetic Open Storage Platform