RocksDB vs. TRocksDB · Eric Ries. SVP, Memory and Storage Strategy. Toshiba Memory America, Inc....

65
Eric Ries SVP, Memory and Storage Strategy Toshiba Memory America, Inc.

Transcript of RocksDB vs. TRocksDB · Eric Ries. SVP, Memory and Storage Strategy. Toshiba Memory America, Inc....

Page 1: RocksDB vs. TRocksDB · Eric Ries. SVP, Memory and Storage Strategy. Toshiba Memory America, Inc. First things first . . . an announcement. Next week our name changes to…. KIOKU

Eric RiesSVP, Memory and Storage Strategy

Toshiba Memory America, Inc.

Page 2: RocksDB vs. TRocksDB · Eric Ries. SVP, Memory and Storage Strategy. Toshiba Memory America, Inc. First things first . . . an announcement. Next week our name changes to…. KIOKU

First things first . . .

an announcement

Page 3: RocksDB vs. TRocksDB · Eric Ries. SVP, Memory and Storage Strategy. Toshiba Memory America, Inc. First things first . . . an announcement. Next week our name changes to…. KIOKU

Next week our name changes to….

Page 4: RocksDB vs. TRocksDB · Eric Ries. SVP, Memory and Storage Strategy. Toshiba Memory America, Inc. First things first . . . an announcement. Next week our name changes to…. KIOKU

KIOKU + AXIAKIOXIA is a combination of the Japanese word kioku meaning “memory”

and the Greek word axia meaning “value.” Kioku, which underpins our

mission and vision, goes beyond the notion of memory as mere data to

broadly encompass experiences, emotions and ideas.

KIOXIA Corporation

Page 5: RocksDB vs. TRocksDB · Eric Ries. SVP, Memory and Storage Strategy. Toshiba Memory America, Inc. First things first . . . an announcement. Next week our name changes to…. KIOKU

And now,for something completely different…

Page 6: RocksDB vs. TRocksDB · Eric Ries. SVP, Memory and Storage Strategy. Toshiba Memory America, Inc. First things first . . . an announcement. Next week our name changes to…. KIOKU

our storage world continues changingand the change is accelerating…

Page 7: RocksDB vs. TRocksDB · Eric Ries. SVP, Memory and Storage Strategy. Toshiba Memory America, Inc. First things first . . . an announcement. Next week our name changes to…. KIOKU

Cloud Storage is Inescapable (nearly)

https://www.statista.com/study/26788/data-storage-statista-dossier/Source:

Page 8: RocksDB vs. TRocksDB · Eric Ries. SVP, Memory and Storage Strategy. Toshiba Memory America, Inc. First things first . . . an announcement. Next week our name changes to…. KIOKU

…and themajority of Exabytes sold

will shift to Cloud vendors

Page 9: RocksDB vs. TRocksDB · Eric Ries. SVP, Memory and Storage Strategy. Toshiba Memory America, Inc. First things first . . . an announcement. Next week our name changes to…. KIOKU

Cloud will consume majority of new flash storage.

2018 2019 2020 2021 2022 2023Cloud 25,512 27,729 43,500 58,164 82,178 117,733Enterprise 19,524 28,112 34,767 51,174 68,216 85,373

-

50,000

100,000

150,000

200,000

250,000

Flash ShipmentsPetabytes

Source: Forward Insights Aug 2019

58%

Page 10: RocksDB vs. TRocksDB · Eric Ries. SVP, Memory and Storage Strategy. Toshiba Memory America, Inc. First things first . . . an announcement. Next week our name changes to…. KIOKU

The majority of Cloud bytes will go to the

Hyperscaleproviders

Page 11: RocksDB vs. TRocksDB · Eric Ries. SVP, Memory and Storage Strategy. Toshiba Memory America, Inc. First things first . . . an announcement. Next week our name changes to…. KIOKU

Hyperscalers(we’ve noticed)

use storage differently…

Page 12: RocksDB vs. TRocksDB · Eric Ries. SVP, Memory and Storage Strategy. Toshiba Memory America, Inc. First things first . . . an announcement. Next week our name changes to…. KIOKU

Hyperscale cloudis application-driven

(software-defined)

Page 13: RocksDB vs. TRocksDB · Eric Ries. SVP, Memory and Storage Strategy. Toshiba Memory America, Inc. First things first . . . an announcement. Next week our name changes to…. KIOKU

Storage devicesare

NOT(software-driven)

Page 14: RocksDB vs. TRocksDB · Eric Ries. SVP, Memory and Storage Strategy. Toshiba Memory America, Inc. First things first . . . an announcement. Next week our name changes to…. KIOKU

So,the Hyperscale cloud providers

began defining their ownflash storage devices

Page 15: RocksDB vs. TRocksDB · Eric Ries. SVP, Memory and Storage Strategy. Toshiba Memory America, Inc. First things first . . . an announcement. Next week our name changes to…. KIOKU

These devices arehost-controlled, application-driven

andhighly integrated into the stack

Page 16: RocksDB vs. TRocksDB · Eric Ries. SVP, Memory and Storage Strategy. Toshiba Memory America, Inc. First things first . . . an announcement. Next week our name changes to…. KIOKU

The host and applicationcontrol many of the

flash-unique processes

Page 17: RocksDB vs. TRocksDB · Eric Ries. SVP, Memory and Storage Strategy. Toshiba Memory America, Inc. First things first . . . an announcement. Next week our name changes to…. KIOKU

As developersyou know this.

Page 18: RocksDB vs. TRocksDB · Eric Ries. SVP, Memory and Storage Strategy. Toshiba Memory America, Inc. First things first . . . an announcement. Next week our name changes to…. KIOKU

Storage, as a device,

has evolved at its own pace

Page 19: RocksDB vs. TRocksDB · Eric Ries. SVP, Memory and Storage Strategy. Toshiba Memory America, Inc. First things first . . . an announcement. Next week our name changes to…. KIOKU

For so long it was just “rotating rust”

Page 20: RocksDB vs. TRocksDB · Eric Ries. SVP, Memory and Storage Strategy. Toshiba Memory America, Inc. First things first . . . an announcement. Next week our name changes to…. KIOKU

The big new“innovation”was enabling

FLASHfor storage

Page 21: RocksDB vs. TRocksDB · Eric Ries. SVP, Memory and Storage Strategy. Toshiba Memory America, Inc. First things first . . . an announcement. Next week our name changes to…. KIOKU

Solid-state storage is digital,

yet it is still deliveredlike a drive

Page 22: RocksDB vs. TRocksDB · Eric Ries. SVP, Memory and Storage Strategy. Toshiba Memory America, Inc. First things first . . . an announcement. Next week our name changes to…. KIOKU

Solid-state storage must be enabled for

Page 23: RocksDB vs. TRocksDB · Eric Ries. SVP, Memory and Storage Strategy. Toshiba Memory America, Inc. First things first . . . an announcement. Next week our name changes to…. KIOKU

Hyperscale cloud is alreadydoing it.

Storage vendors need to pay attention.

Page 24: RocksDB vs. TRocksDB · Eric Ries. SVP, Memory and Storage Strategy. Toshiba Memory America, Inc. First things first . . . an announcement. Next week our name changes to…. KIOKU

Today’s innovations in

storageare driven by cloud

applications

Page 25: RocksDB vs. TRocksDB · Eric Ries. SVP, Memory and Storage Strategy. Toshiba Memory America, Inc. First things first . . . an announcement. Next week our name changes to…. KIOKU

Yet today’sstorage devices define their own

mode of access…

Page 26: RocksDB vs. TRocksDB · Eric Ries. SVP, Memory and Storage Strategy. Toshiba Memory America, Inc. First things first . . . an announcement. Next week our name changes to…. KIOKU

Cloud operators requiretheir applications to

define how data is stored…

Page 27: RocksDB vs. TRocksDB · Eric Ries. SVP, Memory and Storage Strategy. Toshiba Memory America, Inc. First things first . . . an announcement. Next week our name changes to…. KIOKU

and these storage-related factorsimpact

Hyperscale service quality

(orchestration)

Page 28: RocksDB vs. TRocksDB · Eric Ries. SVP, Memory and Storage Strategy. Toshiba Memory America, Inc. First things first . . . an announcement. Next week our name changes to…. KIOKU

This is where Hyperscale is innovatingwith storage

(orchestration)

Page 29: RocksDB vs. TRocksDB · Eric Ries. SVP, Memory and Storage Strategy. Toshiba Memory America, Inc. First things first . . . an announcement. Next week our name changes to…. KIOKU

Solid-state devices are digital.A software-enabled device can

control these features

(orchestration)

AND MORE…

Page 30: RocksDB vs. TRocksDB · Eric Ries. SVP, Memory and Storage Strategy. Toshiba Memory America, Inc. First things first . . . an announcement. Next week our name changes to…. KIOKU

As developers,You know a

new paradigmis coming to solid-state storage.

Page 31: RocksDB vs. TRocksDB · Eric Ries. SVP, Memory and Storage Strategy. Toshiba Memory America, Inc. First things first . . . an announcement. Next week our name changes to…. KIOKU

In the new paradigmthe application is king.

Solid-state storagemust embrace this.

Page 32: RocksDB vs. TRocksDB · Eric Ries. SVP, Memory and Storage Strategy. Toshiba Memory America, Inc. First things first . . . an announcement. Next week our name changes to…. KIOKU

Cloud-based applicationsare the new normal.

This will drive further innovationdemands for solid-state storage.

Page 33: RocksDB vs. TRocksDB · Eric Ries. SVP, Memory and Storage Strategy. Toshiba Memory America, Inc. First things first . . . an announcement. Next week our name changes to…. KIOKU

Future versions of software-enabledsolid-state storage may support:

• Workload-driven aggregation and disaggregation of a storage pool• Multi-mode capability/functionality• Latency control by software• Host control over garbage collection and wear leveling

Page 34: RocksDB vs. TRocksDB · Eric Ries. SVP, Memory and Storage Strategy. Toshiba Memory America, Inc. First things first . . . an announcement. Next week our name changes to…. KIOKU

The Cloud is eating into Enterprise.Hyperscale cloud is software-driven.Their applications are king [for storage].

This new paradigm is at our heels.

Page 35: RocksDB vs. TRocksDB · Eric Ries. SVP, Memory and Storage Strategy. Toshiba Memory America, Inc. First things first . . . an announcement. Next week our name changes to…. KIOKU

You’ve talked about these concepts before…

Page 36: RocksDB vs. TRocksDB · Eric Ries. SVP, Memory and Storage Strategy. Toshiba Memory America, Inc. First things first . . . an announcement. Next week our name changes to…. KIOKU

We’re exploring how to make flash

more valuablein a sofware-defined world.

Page 37: RocksDB vs. TRocksDB · Eric Ries. SVP, Memory and Storage Strategy. Toshiba Memory America, Inc. First things first . . . an announcement. Next week our name changes to…. KIOKU

Two examples:1. Software can be drive-aware

2. Software can be “media-aware”

Page 38: RocksDB vs. TRocksDB · Eric Ries. SVP, Memory and Storage Strategy. Toshiba Memory America, Inc. First things first . . . an announcement. Next week our name changes to…. KIOKU

Toshiba Memory’s KumoScale™

Software that deploys SSDs at cloud-scale…enables NVMe™ Flash as a Service

NVMe is a trademark of NVM Express, Inc.

Page 39: RocksDB vs. TRocksDB · Eric Ries. SVP, Memory and Storage Strategy. Toshiba Memory America, Inc. First things first . . . an announcement. Next week our name changes to…. KIOKU

What is KumoScale?

• A Software product– Implements a fast, networked block storage service– Disaggregation based on NVMe ™ -over-Fabrics standard– Focused on speed, very low cost

• Target:– Mid to large-scale (50k-500k nodes) on-prem data center– Bare metal or containerized

• Architected for Private Clouds (not enterprise)– Integrates with (not replaces) management infrastructure– Tight integration with Kubernetes®/CSI– Zero touch deployment at scale

Software enablingNVMe™ Flash as a Service

“kumo”雲 くも Cloud

蜘蛛 くも Spider

Page 40: RocksDB vs. TRocksDB · Eric Ries. SVP, Memory and Storage Strategy. Toshiba Memory America, Inc. First things first . . . an announcement. Next week our name changes to…. KIOKU

Storage Node ArchitectureProvisioning &OrchestrationFrameworks

Management Engine• Volume management• ACL, QoS administration• Telemetry• API

MapperNamespaceDrive + offset

NVMe-oF™ Target

NIC Driver

NVMe™ Initiator

NVMe™ Driver

ToshibaSoftware

Telemetry &Logging

Frameworks

REST APIJSON, etc.

userkernel

Network(logical volumes)

Local PCIe®(Physical SSD’s) 40

NVMe and NVMe-oF are trademarks of NVM Express, Inc. PCIe is a registered trademark of PCI-SIG.

Page 41: RocksDB vs. TRocksDB · Eric Ries. SVP, Memory and Storage Strategy. Toshiba Memory America, Inc. First things first . . . an announcement. Next week our name changes to…. KIOKU

Storage Node ArchitectureProvisioning &OrchestrationFrameworks

Management Engine• Volume management• ACL, QoS administration• Telemetry• API

MapperNamespaceDrive + offset

NVMe-oF™ Target

NIC Driver

NVMe™ Initiator

NVMe™ Driver

ToshibaSoftware

Telemetry &Logging

Frameworks

REST APIJSON, etc.

userkernel

Network(logical volumes)

Local PCIe®(Physical SSD’s) 41

NVMe and NVMe-oF are trademarks of NVM Express, Inc. PCIe is a registered trademark of PCI-SIG.

Page 42: RocksDB vs. TRocksDB · Eric Ries. SVP, Memory and Storage Strategy. Toshiba Memory America, Inc. First things first . . . an announcement. Next week our name changes to…. KIOKU

KumoScale™: Storage Software Enabling NVMe™ Flash as a Service

Phone-home

Provisioner Service

Your Provisioning Tools or Orchestration Infrastructure

Mapping Advisories

Analytics Service Management Service• Active license counter• Phone-home telemetry• GUI server (optional)

Data CenterTelemetry

Data CenterLogging

CustomerControl PlaneMonitoringLive I/O Traffic

Toshiba MemoryControl PlaneMonitoring

Mapping Telemetry

Data Center Telemetry & Logging

Provisioning

Storage Data

Storage-classspecs

CSI

• Drive performance & wear modelling• Storage-class I/O characterization• Storage Node QoS scoring• Closed-loop optimization

StorageClasses

Page 43: RocksDB vs. TRocksDB · Eric Ries. SVP, Memory and Storage Strategy. Toshiba Memory America, Inc. First things first . . . an announcement. Next week our name changes to…. KIOKU

TRocksDB

Modified RocksDBto be more “media-aware”

for better TCO

Page 44: RocksDB vs. TRocksDB · Eric Ries. SVP, Memory and Storage Strategy. Toshiba Memory America, Inc. First things first . . . an announcement. Next week our name changes to…. KIOKU

RocksDB• A popular data storage engine • Used by a wide range of database applications:

Cassandra is a registered trademark of The Apache Software Foundation. Ceph is a trademark of Red Hat, Inc. or its subsidiaries in the United States and other countries. Python is a registered trademark of the Python Software Foundation. MariaDB is a registered trademark of MariaDB in the European Union and other regions.

ArangoDB Ceph™

Python®MyRocks Rockset

Cassandra® MariaDB®

All other company names, product names and service names may be trademarks of their respective companies.

Page 45: RocksDB vs. TRocksDB · Eric Ries. SVP, Memory and Storage Strategy. Toshiba Memory America, Inc. First things first . . . an announcement. Next week our name changes to…. KIOKU

RocksDB

• Good for HDD and small database values

• Not “flash media-aware”‒ Compaction layer heavily rewritten ‒ Generates write-amp of 20x to 30x‒ This degrades flash memory endurance

Page 46: RocksDB vs. TRocksDB · Eric Ries. SVP, Memory and Storage Strategy. Toshiba Memory America, Inc. First things first . . . an announcement. Next week our name changes to…. KIOKU

TRocksDB

But…there is a better way

Page 47: RocksDB vs. TRocksDB · Eric Ries. SVP, Memory and Storage Strategy. Toshiba Memory America, Inc. First things first . . . an announcement. Next week our name changes to…. KIOKU

TRocksDB

Toshiba Memory Americare-architected RocksDB

to be more flash media-aware

Page 48: RocksDB vs. TRocksDB · Eric Ries. SVP, Memory and Storage Strategy. Toshiba Memory America, Inc. First things first . . . an announcement. Next week our name changes to…. KIOKU

TRocksDB

…all done in software;no changes to the SSD necessary.

Page 49: RocksDB vs. TRocksDB · Eric Ries. SVP, Memory and Storage Strategy. Toshiba Memory America, Inc. First things first . . . an announcement. Next week our name changes to…. KIOKU

TRocksDB

We want to show youwhat software can do if it’s media-aware.

Page 50: RocksDB vs. TRocksDB · Eric Ries. SVP, Memory and Storage Strategy. Toshiba Memory America, Inc. First things first . . . an announcement. Next week our name changes to…. KIOKU

How does TRocksDB work?

Value Log

V

Level 4Target 1000 GB

Level 1Target 1GB

Level 2Target 10 GB

Level 3Target 100 GB

Level 0k

DataKey

V

Value is unaffected by compactions

RocksDB TRocksDB

Keys & Values are paired together

Keys & Valuesare split

Compaction layers updated

regularly by rewriting keys & values together

WRITE AMP

Keys go into compaction

layers

Values are stored separately in a ring buffer

Page 51: RocksDB vs. TRocksDB · Eric Ries. SVP, Memory and Storage Strategy. Toshiba Memory America, Inc. First things first . . . an announcement. Next week our name changes to…. KIOKU

By being cognizant of media characteristics,

a developer can enhancestorage value.

Page 52: RocksDB vs. TRocksDB · Eric Ries. SVP, Memory and Storage Strategy. Toshiba Memory America, Inc. First things first . . . an announcement. Next week our name changes to…. KIOKU

The greatest value:improved endurance

at no performance cost.

Page 53: RocksDB vs. TRocksDB · Eric Ries. SVP, Memory and Storage Strategy. Toshiba Memory America, Inc. First things first . . . an announcement. Next week our name changes to…. KIOKU

Greater SSD Endurance: Better TCO

0

0.5

1

1.5

2

2.5

3

3.5

4

4.5

5

Test 1:Random Bulk Load

Test 2: Bulk Sequential Load

Test 3:Random Overwrites

0.6 0.6

2.1

1 1

4.9

Write Amplification(lower is better)

TRocks 1.2.5.23

Rocks FB 6.4

0

20,000

40,000

60,000

80,000

100,000

120,000

140,000

160,000

Test 1:Random Bulk

Load

Test 2: Bulk Sequential

Load

Test 3:Random

Overwrites

Test 4:Random Key

Reads

21,565

6,1559,595

118,244

29,742

6,938 9,890

155,081

Performance Comparison(lower is better)

TRocks 1.2.5.23

Rocks FB 6.4

Improved Write Amplification Same or Better Performance

Page 54: RocksDB vs. TRocksDB · Eric Ries. SVP, Memory and Storage Strategy. Toshiba Memory America, Inc. First things first . . . an announcement. Next week our name changes to…. KIOKU

Toshiba Memory wants to show examples of how software can enhance

solid-state storage…

Page 55: RocksDB vs. TRocksDB · Eric Ries. SVP, Memory and Storage Strategy. Toshiba Memory America, Inc. First things first . . . an announcement. Next week our name changes to…. KIOKU

So, we developed TRocks as Open Source software

available today:

https://github.com/ToshibaMemoryAmerica

Page 56: RocksDB vs. TRocksDB · Eric Ries. SVP, Memory and Storage Strategy. Toshiba Memory America, Inc. First things first . . . an announcement. Next week our name changes to…. KIOKU

Join the project;improve and contribute

to the code:

https://github.com/ToshibaMemoryAmerica

Page 57: RocksDB vs. TRocksDB · Eric Ries. SVP, Memory and Storage Strategy. Toshiba Memory America, Inc. First things first . . . an announcement. Next week our name changes to…. KIOKU

To conclude,a new paradigm shift in storage

is coming…

Page 58: RocksDB vs. TRocksDB · Eric Ries. SVP, Memory and Storage Strategy. Toshiba Memory America, Inc. First things first . . . an announcement. Next week our name changes to…. KIOKU

Continued innovations in softwareare necessary and…

Page 59: RocksDB vs. TRocksDB · Eric Ries. SVP, Memory and Storage Strategy. Toshiba Memory America, Inc. First things first . . . an announcement. Next week our name changes to…. KIOKU

…Solid-state storage has a big role to play…

Page 60: RocksDB vs. TRocksDB · Eric Ries. SVP, Memory and Storage Strategy. Toshiba Memory America, Inc. First things first . . . an announcement. Next week our name changes to…. KIOKU

…but,it needs to be software-enabled

to take advantage of its

digital nature.

Page 61: RocksDB vs. TRocksDB · Eric Ries. SVP, Memory and Storage Strategy. Toshiba Memory America, Inc. First things first . . . an announcement. Next week our name changes to…. KIOKU

I shared two modest examplesof Toshiba Memory’sefforts in this direction

Page 62: RocksDB vs. TRocksDB · Eric Ries. SVP, Memory and Storage Strategy. Toshiba Memory America, Inc. First things first . . . an announcement. Next week our name changes to…. KIOKU

We are investingin these and other methods

on a larger scalein both media and

software.

Page 63: RocksDB vs. TRocksDB · Eric Ries. SVP, Memory and Storage Strategy. Toshiba Memory America, Inc. First things first . . . an announcement. Next week our name changes to…. KIOKU

There’s more to discuss in future.

Page 64: RocksDB vs. TRocksDB · Eric Ries. SVP, Memory and Storage Strategy. Toshiba Memory America, Inc. First things first . . . an announcement. Next week our name changes to…. KIOKU

Thank YouThank You

Page 65: RocksDB vs. TRocksDB · Eric Ries. SVP, Memory and Storage Strategy. Toshiba Memory America, Inc. First things first . . . an announcement. Next week our name changes to…. KIOKU

© 2019 Toshiba Memory America, Inc. All rights reserved. Information, including product pricing and specifications, content of services, and contact information is current and believed to be accurate on the date of the announcement, but is subject to change without prior notice. Technical and application information contained here is subject to the most recent applicable Toshiba Memory product specifications.

Company names, product names, and service names may be trademarks of their respective companies.