The next step in Software-Defined Storage with Virtual SAN · The next step in Software-Defined...

36
© 2014 VMware Inc. All rights reserved. The next step in Software-Defined Storage with Virtual SAN VMware vForum, 2014

Transcript of The next step in Software-Defined Storage with Virtual SAN · The next step in Software-Defined...

Page 1: The next step in Software-Defined Storage with Virtual SAN · The next step in Software-Defined Storage with Virtual SAN VMware vForum, 2014 . ... Software-Defined Storage 10 Bringing

© 2014 VMware Inc. All rights reserved.

The next step in Software-Defined Storage with Virtual SAN

VMware vForum, 2014

Page 2: The next step in Software-Defined Storage with Virtual SAN · The next step in Software-Defined Storage with Virtual SAN VMware vForum, 2014 . ... Software-Defined Storage 10 Bringing

What’s on the agenda?

• Where Virtual SAN fits in the Software Defined Data Center

• Overview of Virtual SAN

– How to build and configure

– Ecosystem

– Features: Resiliency, Scaling, Performance, Simplicity, Integration

• Virtual SAN Use Cases

• Additional Resources

Page 3: The next step in Software-Defined Storage with Virtual SAN · The next step in Software-Defined Storage with Virtual SAN VMware vForum, 2014 . ... Software-Defined Storage 10 Bringing

The Software-Defined Data Center

3

Transform storage by aligning it with app demands

Management tools give way to automation

Expand virtual

compute to all

applications

Virtualize the network for speed and efficiency

Page 4: The next step in Software-Defined Storage with Virtual SAN · The next step in Software-Defined Storage with Virtual SAN VMware vForum, 2014 . ... Software-Defined Storage 10 Bringing

The Software-Defined Data Center

4

Transform storage by aligning it with app demands

Page 5: The next step in Software-Defined Storage with Virtual SAN · The next step in Software-Defined Storage with Virtual SAN VMware vForum, 2014 . ... Software-Defined Storage 10 Bringing

Today’s Challenge: Massive Increase in Storage Demand & Complexity

5

24%

26%

28%

28%

31%

42%

Management

Complexity

Provisioning

Time/budget

DataMigrations

Troubleshooting

MeetingSLA

Most Pressing Storage Challenges

M

20M

40M

60M

80M

100M

120M

2008 2009 2010 2011 2012 2013 2014 2015 2016

Terabytes Sold

Terabytes Sold

Source: IDC, Yezhkova, Worldwide Enterprise Storage Systems Forecast, November 2013, #244293

Storage Growth

41% YoY

Source: IDC, Storage Predictions 2014, January 2014, General Storage QuickPoll, #243511, n=307

Page 6: The next step in Software-Defined Storage with Virtual SAN · The next step in Software-Defined Storage with Virtual SAN VMware vForum, 2014 . ... Software-Defined Storage 10 Bringing

Storage Market in Midst of Disruption

6

Key

Drivers Server flash

Falling storage prices

Abundant CPU cycles

Hypervisor-converged

infrastructure

Cloud economics

Server Storage

20-30 years ago

Shared

Storage

10-15 years ago

New

Forms

Today

Page 7: The next step in Software-Defined Storage with Virtual SAN · The next step in Software-Defined Storage with Virtual SAN VMware vForum, 2014 . ... Software-Defined Storage 10 Bringing

New Storage Tiers Are Rapidly Growing

7

• Flash: Enables New Storage Architectures

• Flash is 50x – 2,000x faster than HDD

– 110K/140K IOPs R/W from 360GB MLC PCIe card1

– Less than $0.10 per IOP

• Eliminates the need to stripe across 100s of HDDs

• Enables high performance server-side storage

• Cloud: Enables Cost-Effective Storage

• Highly scalable, pay-as-you-go

• Access through standard APIs

• Low cost for capacity

– $0.05 per GB per month2

• Forecasted to grow at 40% annually to 20183

Cloud Storage

1. Source: FusionIO ioDrive2, Feb 2014 2. Source: Amazon S3, Feb 2014 3. Source: MarketsandMarkets Cloud Storage report - http://www.marketsandmarkets.com/PressReleases/cloud-storage.asp

Page 8: The next step in Software-Defined Storage with Virtual SAN · The next step in Software-Defined Storage with Virtual SAN VMware vForum, 2014 . ... Software-Defined Storage 10 Bringing

The Hypervisor Opens Up New Opportunities

8

SAN /

NAS

x86

Servers

Cloud

Storage

vSphere

The virtualization

platform:

• Knows the needs

of all apps in real

time

• Sits directly in the

I/O path

• Global view of

underlying

infrastructure

• Hardware agnostic

Page 9: The next step in Software-Defined Storage with Virtual SAN · The next step in Software-Defined Storage with Virtual SAN VMware vForum, 2014 . ... Software-Defined Storage 10 Bringing

Object-based

Pool

SAN/NAS

Pool

Hypervisor

Converged

Pool

Leveraging The Hypervisor We Can Transform Storage

9

• Today • Software-defined Storage

LU

N

Array A

LU

N

LU

N

Array B

LU

N LU

N Abstract and

pool (Virtualized Data Plane)

Automate SLAs

via VM-centric

policies (Policy-based Control

Plane)

VM level Data

services (Virtual Data Services)

SAN /

NAS

x86 Servers

Cloud

Object

Storage

vSphere

Replicati

on

Snapshot

s

Page 10: The next step in Software-Defined Storage with Virtual SAN · The next step in Software-Defined Storage with Virtual SAN VMware vForum, 2014 . ... Software-Defined Storage 10 Bringing

Software-Defined Storage

10

Bringing the efficient operational model of virtualization to storage

Virtual Data

Services Data

Protection Mobility Performance

Policy-driven Control Plane

SAN /

NAS

SAN/NAS Pool

Virtual Data Plane

x86 Servers

Hypervisor-converged Storage pool

Object Storage

Pool

Cloud

Object

Storage Virtual SAN

Page 11: The next step in Software-Defined Storage with Virtual SAN · The next step in Software-Defined Storage with Virtual SAN VMware vForum, 2014 . ... Software-Defined Storage 10 Bringing

VMware Virtual SAN 5.5 Radically Simple Hypervisor-Converged Storage

Page 12: The next step in Software-Defined Storage with Virtual SAN · The next step in Software-Defined Storage with Virtual SAN VMware vForum, 2014 . ... Software-Defined Storage 10 Bringing

Virtual SAN: Radically Simple Hypervisor-Converged Storage

12

vSphere + Virtual SAN

• Software-defined storage

embedded in vSphere

• Runs on any standard x86 server

• Pools HDD/flash into a shared

datastore

• Managed through storage policy-

based management framework

• High performance through flash

acceleration

• Highly resilient - zero data loss in

the event of hardware failures

• Deeply integrated with the

VMware stack

The Basics

Hard disks SSD

Hard disks SSD

Hard

disks

SSD

Virtual SAN

Shared Datastore

Page 13: The next step in Software-Defined Storage with Virtual SAN · The next step in Software-Defined Storage with Virtual SAN VMware vForum, 2014 . ... Software-Defined Storage 10 Bringing

Flash Based Devices

In Virtual SAN ALL read and write operations always go directly to the Flash tier.

Flash based devices serve two purposes in Virtual SAN

1. Non-volatile Write Buffer (30%)

– Writes are acknowledged when they enter prepare stage on SSD.

– Reduces latency for writes

2. Read Cache (70%)

– Cache hits reduces read latency

– Cache miss – retrieve data from HDD

Choice of hardware is the #1 performance differentiator between Virtual SAN configurations.

13

Page 14: The next step in Software-Defined Storage with Virtual SAN · The next step in Software-Defined Storage with Virtual SAN VMware vForum, 2014 . ... Software-Defined Storage 10 Bringing

Magnetic Disks (HDD)

• SAS/NL-SAS/SATA HDDs supported

– 7200 RPM for capacity

– 10000 RPM for performance

– 15000 RPM for additional performance

• NL SAS will provide higher HDD controller queue depth at same drive rotational speed and similar price point

– NL SAS recommended if choosing between SATA and NL SAS

• Differentiate performance between clusters with SSD selection, and SSD:HDD ratio. Rule of thumb guideline is 10% of anticipated capacity usage

14

Page 15: The next step in Software-Defined Storage with Virtual SAN · The next step in Software-Defined Storage with Virtual SAN VMware vForum, 2014 . ... Software-Defined Storage 10 Bringing

Storage Controllers

• SAS/SATA Storage Controllers

– Pass-through or “RAID0” mode supported

• Performance using RAID0 mode is controller dependent

– Check with your vendor for SSD performance behind a RAID-controller

• Storage Controller Queue Depth matters

– Higher storage controller queue depth will increase performance

• Validate number of drives supported for each controller

15

Page 16: The next step in Software-Defined Storage with Virtual SAN · The next step in Software-Defined Storage with Virtual SAN VMware vForum, 2014 . ... Software-Defined Storage 10 Bringing

Network

• 1Gb / 10Gb supported

– 10Gb shared with NIOC for QoS will support most environments

– If 1GB then recommend dedicated links for Virtual SAN

• Jumbo Frames will provide nominal performance increase

– Enable for greenfield deployments

• Virtual SAN supports both VSS & VDS

– NIOC requires VDS

– Nexus 1000v – Should work but hasn't been fully tested

• Network bandwidth performance has more impact on host evacuation, rebuild times than on workload performance

16

Page 17: The next step in Software-Defined Storage with Virtual SAN · The next step in Software-Defined Storage with Virtual SAN VMware vForum, 2014 . ... Software-Defined Storage 10 Bringing

12,000+ Virtual SAN

Beta

Participants

95% Beta

customers

Recommend

VSAN

90% Believe VSAN

will impact

Storage like

vSphere did to

Compute

Unprecedented Customer Interest And Validation

17

Page 18: The next step in Software-Defined Storage with Virtual SAN · The next step in Software-Defined Storage with Virtual SAN VMware vForum, 2014 . ... Software-Defined Storage 10 Bringing

Why Virtual SAN?

18

• Two click Install

• Single pane of glass

• Policy-driven

• Self-tuning

• Integrated with VMware

stack

Radically Simple

• Embedded in vSphere

kernel

• Flash-accelerated

• Up to 2M IOPs from 32

nodes

• Granular and linear

scaling

High Performance Lower TCO

• Server-side economics

• No large upfront

investments

• Grow-as-you-go

• Easy to operate with

powerful automation

• No specialized skillset

Page 19: The next step in Software-Defined Storage with Virtual SAN · The next step in Software-Defined Storage with Virtual SAN VMware vForum, 2014 . ... Software-Defined Storage 10 Bringing

Two Ways to Build a Virtual SAN Node

• Completely Hardware Independent

19

1. Virtual SAN Ready Node

…with multiple options available at GA + 30

Preconfigured server ready to use Virtual SAN…

2. Build Your Own

…using the Virtual SAN Compatibility Guide*

Choose individual components …

SSD or PCIe

SAS/NL-SAS/ SATA

HDDs

Any Server on

vSphere Hardware

Compatibility List

HBA/RAID Controller

Note: For additional details, please refer to Virtual SAN VMware Compatibility Guide Page

Components for Virtual SAN must be chosen from Virtual SAN HCL, using any other

components is unsupported

Page 20: The next step in Software-Defined Storage with Virtual SAN · The next step in Software-Defined Storage with Virtual SAN VMware vForum, 2014 . ... Software-Defined Storage 10 Bringing

Flexibly Configure For Performance And Capacity

20

Performance

2xCPU – 8-core

128GB Memory

2xCPU – 8-core

128GB Memory

2xCPU – 8-core

128GB Memory

1x

400GB MLC SSD (~15% of usable capacity)

1x

400GB MLC SSD (~10% of usable capacity)

2x

400GB MLC SSD (~4% of usable capacity)

5x

1.2TB 10K SAS

7x

2TB 7.2K NL-SAS

10x

4TB 7.2K NL-SAS

IOPS1

Raw

Capacity

~20-15K

6TB

~15-10K

14TB

~10-5K

40TB

Capacity

1. Mix workload 70% Read, 80% Random

Estimated based on 2013 street pricing,

Capex

(includes storage hardware + Software

License costs)

Page 21: The next step in Software-Defined Storage with Virtual SAN · The next step in Software-Defined Storage with Virtual SAN VMware vForum, 2014 . ... Software-Defined Storage 10 Bringing

Broad Partner Ecosystem Support for Virtual SAN

21

Storage Server / Systems

Solution

Data Protection

Solution

Page 22: The next step in Software-Defined Storage with Virtual SAN · The next step in Software-Defined Storage with Virtual SAN VMware vForum, 2014 . ... Software-Defined Storage 10 Bringing

vSphere + Virtual SAN

22

Simple to set up via policy

Delivered on per VM basis

Zero data loss in case of disk, network or host failures

Ensures zero downtime from disk or network failures

Interoperable with vSphere HA and Maintenance Mode

Virtual SAN Is Highly Resilient Against Any Hardware Failure Virtual SAN is Designed to Ensure Data is Never Lost in Case of Failures

Page 23: The next step in Software-Defined Storage with Virtual SAN · The next step in Software-Defined Storage with Virtual SAN VMware vForum, 2014 . ... Software-Defined Storage 10 Bringing

Failure handling philosophy

Traditional SANs

– Physical drive needs to be replaced to get back to full redundancy

– Hot-spare disks are set aside to take role of failed disks immediately

– In both cases: 1:1 replacement of disk

Virtual SAN

– Entire cluster is a “hot-spare”, we always want to get back to full redundancy

– When a disk fails, many small components (stripes or mirrors of objects) fail

– New copies of these components can be spread around the cluster for balancing

– Replacement of the physical disk just adds back resources

Page 24: The next step in Software-Defined Storage with Virtual SAN · The next step in Software-Defined Storage with Virtual SAN VMware vForum, 2014 . ... Software-Defined Storage 10 Bringing

Scale UP Add more

Disks

IOPS Capacity

40 TB

400 TB

4.4 PB

Scale OUT

Add more

nodes

Elastic Grow or shrink on demand

Granular Add single nodes or disks

Non-disruptive No app downtime

Virtual SAN Enables Elastic Linear Scaling of Performance and Capacity No More Complex Forecasting & Large Upfront Investments

“Virtual SAN enables us to

scale our storage

infrastructure and while

providing the necessary

redundancy. This allows us

to be more agile and bring

our solutions to market

faster.” Frans Van Rooyen,

Cloud Architect, Adobe 24

Page 25: The next step in Software-Defined Storage with Virtual SAN · The next step in Software-Defined Storage with Virtual SAN VMware vForum, 2014 . ... Software-Defined Storage 10 Bringing

Virtual SAN Delivers Enterprise-Grade Scale

25

2M IOPS

3,20

0 VMs

4.4 Petabytes

Maximum Scalability per Virtual SAN Cluster

32 Hosts

“Virtual SAN allows us to build

out scalable heterogeneous

storage infrastructure like the

Facebooks and Googles of the

world. Virtual SAN allows us

to add scale, add resources,

while being able to service

high performance

workloads.” — Dave Burns

VP of Tech Ops, Cincinnati Bell

Page 26: The next step in Software-Defined Storage with Virtual SAN · The next step in Software-Defined Storage with Virtual SAN VMware vForum, 2014 . ... Software-Defined Storage 10 Bringing

High Performance with Elastic and Linear Scalability

26

80K 160K

320K 480K

640K

253K

505K

1M

1.5M

2M

4 8 16 24 32

IOP

S

Number of Hosts In Virtual SAN Cluster

Mixed 100% Read

286

473

677

767 805

3 5 7 8

Number of Hosts In Virtual SAN Cluster

Number of VDI VMs

VSAN All SSD Array

Notes: based on IOmeter benchmark Mixed = 70% Read, 4K 80% random Notes: Based on View Planner benchmark

Up to 2M IOPs in 32 Node Cluster Comparable VDI density to an All Flash

Array

Page 27: The next step in Software-Defined Storage with Virtual SAN · The next step in Software-Defined Storage with Virtual SAN VMware vForum, 2014 . ... Software-Defined Storage 10 Bringing

Virtual SAN Simplifies Storage

27

Two clicks to deploy!

If You Know vSphere, You Know Virtual SAN

Page 28: The next step in Software-Defined Storage with Virtual SAN · The next step in Software-Defined Storage with Virtual SAN VMware vForum, 2014 . ... Software-Defined Storage 10 Bringing

Virtual SAN: Deeply Integrated with VMware Stack

28

Ideal for VMware Environments

vMotion

vSphere

HA

DRS

Storage

vMotion

vSphere

Snapshots

Linked

Clones

VDP Advanced

vSphere

Replication

Data Protection

VMware

View

Virtual Desktop

vCenter Operations Mgr

vCloud Automation

Center

IaaS

Cloud Ops and

Automation

Site Recovery

Manager

Disaster Recovery

Site A

Site B

Storage Policy-Based

Management

Page 29: The next step in Software-Defined Storage with Virtual SAN · The next step in Software-Defined Storage with Virtual SAN VMware vForum, 2014 . ... Software-Defined Storage 10 Bringing

Virtual SAN

Virtual SAN Puts The App In Charge

• Simpler and Automated Storage Management Through Application-centric Approach

29

Today

1. Pre-define storage

configurations

2. Pre-allocate static bins

3. Expose pre-allocated bins

4. Select appropriate bin

5. Consume from pre-allocated

bin

1. Define storage policy

2. Apply policy at VM creation

Resource and data service are automatically provisioned and maintained.

Virtual SAN

Shared

Datastore ✖ Overprovisioning

(Better safe than sorry!)

✖ Wasted resources, wasted time

✖ Frequent data migrations

No overprovisioning

Less resources, less time

Easy to change

Today

Page 30: The next step in Software-Defined Storage with Virtual SAN · The next step in Software-Defined Storage with Virtual SAN VMware vForum, 2014 . ... Software-Defined Storage 10 Bringing

Virtual SAN Simplifies And Automates Storage Management

30

Per VM Storage Service Levels From a Single Self-tuning Datastore

Storage Policy-Based

Management

Virtual SAN

Shared

Datastore

vSphere + Virtual SAN

SLAs

Software Automates Control of Service

Levels

No more LUNs/Volumes!

Policies Set Based on Application

Needs

Capacity

Performance

Availability

Per VM Storage Policies

“Virtual SAN is easy to deploy, just a few check boxes. No need to configure RAID.”

Jim Streit, IT Architect,

Thomson Reuters

Page 31: The next step in Software-Defined Storage with Virtual SAN · The next step in Software-Defined Storage with Virtual SAN VMware vForum, 2014 . ... Software-Defined Storage 10 Bringing

Virtual SAN Reduces CAPEX and OPEX for Better TCO

31

CAPEX

• Server-side economics

• No Fibre Channel network

• Pay-as-you-grow

OPEX

• Simplified storage configuration

• No LUNs

• Managed directly through vSphere Web Client

• Automated VM provisioning

• Simplified capacity planning

As Low

as

$0.50/GB2

As Low

as

$0.25/IOP

S

5X Lower

OPEX4

Up to 50%

TCO

Reduction

As Low

as

$50/Desk

top1

1. Full clones 2. Usable capacity 3. Estimated based on 2013 street pricing, Capex (includes storage hardware + Software License costs)

4. Source: Taneja Group

Page 32: The next step in Software-Defined Storage with Virtual SAN · The next step in Software-Defined Storage with Virtual SAN VMware vForum, 2014 . ... Software-Defined Storage 10 Bringing

• Compared to external storage at scale

• Estimated based on 2013 street pricing, Capex (includes storage hardware + Software License costs)

• Additional savings come from reduced Opex through automation

• Virtual SAN configuration: 9 VMs per core, with 40GB per VM, 2 copies for availability and 10% SSD for performance

Granular Scaling Eliminates Overprovisioning

• Delivers Predictable Scaling and ability to Control Costs

32

VSAN enables predictable linear

scaling

Spikes correspond to

scaling out due to IOPs

requirements

$40

$90

$140

$190

$240

500 1000 1500 2000 2500 3000

Sto

rag

e C

ost

Per

Deskto

p

Number of Desktops

$/VDI Storage Cost Virtual SAN

Page 33: The next step in Software-Defined Storage with Virtual SAN · The next step in Software-Defined Storage with Virtual SAN VMware vForum, 2014 . ... Software-Defined Storage 10 Bringing

Running a Google-like Datacenter

• Modular infrastructure. Break-Replace Operations

33

"From a break fix

perspective, I think there's

a huge difference in what

needs to be done when a

piece of hardware fails. I

can have anyone on my

team go back and replace

a 1U or 2U servers. …

essentially modularizing

my datacenter and

delivering a true

Software-Defined

Storage architecture."

— Ryan Hoenle

Director of IT, DOE Fund

Page 34: The next step in Software-Defined Storage with Virtual SAN · The next step in Software-Defined Storage with Virtual SAN VMware vForum, 2014 . ... Software-Defined Storage 10 Bringing

Virtual Desktop

(VDI) Tier 2 / Tier 3 / Staging DR Target

• Rapid storage

provisioning and

complete

automation

• Ideal

price/performance

• Enables Cloud

Architect to easily

provision storage

• Integrated with

vSphere Replication

and VMware SRM

• Reduces cost of

storage

• Minimizes data

center footprint

• Handle peak

performance

requirements (boot,

login, read/write storms)

• Granularly scale from

POC to production

without huge upfront

investments

• Support high VDI

density

Virtual SAN Use Cases

• Use Cases for Virtual SAN 5.5

34

Site A Site B

Page 35: The next step in Software-Defined Storage with Virtual SAN · The next step in Software-Defined Storage with Virtual SAN VMware vForum, 2014 . ... Software-Defined Storage 10 Bringing

Additional Resources

35

Product Page http://www.vmware.com/products/virtual-san/

VSAN Community https://communities.vmware.com/community/vmtn/vsan

VIP Tool vip.vmware.com/salessignup

Hands-On-Lab

http://vmware.com/go/vsanlab

Virtual SAN 60-day Free Evaluation

http://www.vmware.com/go/try-vsan-en

Software-defined Storage Sales Team

[email protected]

Page 36: The next step in Software-Defined Storage with Virtual SAN · The next step in Software-Defined Storage with Virtual SAN VMware vForum, 2014 . ... Software-Defined Storage 10 Bringing

Thank You Rouan Hugo [email protected]