Storage Virtualization Strategies

24
Storage Virtualization Strategies Storage Virtualization Strategies Arun Taneja Founder, Taneja Group September 25, 2006

description

 

Transcript of Storage Virtualization Strategies

Page 1: Storage Virtualization Strategies

Storage Virtualization StrategiesStorage Virtualization Strategies

Arun Taneja

Founder, Taneja Group

September 25, 2006

Page 2: Storage Virtualization Strategies

AgendaAgenda

• Next Generation Data Center & Virtualization

• Storage Virtualization Approaches, Architecture, & Players

• Other Types of Virtualization & their Impact on Storage

• Recommendations to End Users

Page 3: Storage Virtualization Strategies

Virtual Server Virtual Server Virtual Server Virtual Server

• “Pools” of commonly grouped physical resources

• Dynamic allocations based on application level grouping and usage policies

• Interconnected and controlled through an intelligent interconnect fabric

Server Processing I/O StorageApplications

Intelligent Fabric

Stand-By

Resource Pool

Compute Networking and Storage VirtualizationCompute Networking and Storage Virtualization

Page 4: Storage Virtualization Strategies

Virtualized Data CenterVirtualized Data Center

• Four main types of virtualization technologies emerging:

– Server Virtualization

• Virtualizes the physical CPU, Memory, I/O of servers

– I/O Virtualization

• Virtualizes the physical network topology and mappings between

servers and storage

– File Virtualization

• Virtualizes files and namespaces across file servers

– Storage Virtualization

• Virtualizes physical block storage devices

Page 5: Storage Virtualization Strategies

The State of Data StorageThe State of Data StorageA Snapshot of “Where We Are” Today:

• Data Tsunami Continues• Data Scattered across data centers and remote

locations• Stringent Compliance And Regulatory Environment• Data Protection is at a break point• Can’t add IT staff indiscriminately to keep up with

capacity growth• Storage management tools are archaic• Storage tiers still infancy. Data is not mobile.

Page 6: Storage Virtualization Strategies

Typical SAN TodayTypical SAN Today

Ultimate Vision of SAN is Incomplete

SANSAN

V1V1

V2V2V3V3

V4V4 V5V5

Server 1Server 1

V1V1

V2V2 V3V3 V4V4 V5V5

Server 2Server 2 Server 3Server 3 Server 4Server 4

Page 7: Storage Virtualization Strategies

Why Storage Virtualization is En Vogue Again…Why Storage Virtualization is En Vogue Again…

• Heterogeneous Storage is a Reality

• Data Migration, Data Consolidation are Disruptive Processes Today

• V has Passed the “Hype” and “Low Point” Stages and into “Reality” Stage

• Big guys have Ratified the Concept (IBM, EMC, HDS)

Page 8: Storage Virtualization Strategies

What is Storage Virtualization?What is Storage Virtualization?

• Separation of Physical and Logical

• Enables One Common Set of Applications

• Physical can be Heterogeneous or Homogeneous

• Underwear

RAID equals elemental storage virtualization

Page 9: Storage Virtualization Strategies

Heterogeneous & Homogeneous Heterogeneous & Homogeneous VirtualizationVirtualization

EMCEMC

Virtualization LayerVirtualization Layer

Common Storage ApplicationsCommon Storage Applications

EMCEMC HDSHDS JBODJBOD

Page 10: Storage Virtualization Strategies

What Does Storage Virtualization Enable?What Does Storage Virtualization Enable?

• Consistent Interface for All Storage Applications

• Non-disruptive LUN Creation, Expansion, Deletion

• Non-disruptive Data Consolidation, Data Migration

• Non-disruptive RAID Level Changes

• Tiering of Storage Using Hetero Storage

• Replication Across Hetero Storage

• Backup/Restore, Archival, Thin Provisioning, etc.

Storage Virtualization Completes SAN Vision…

Page 11: Storage Virtualization Strategies

Where Can It Be Done?Where Can It Be Done?Host-based Host-based

VolumeVolumeManagementManagement

Network-basedNetwork-basedVirtualizationVirtualization

ApplianceAppliance Purpose BuiltPurpose BuiltAppliance (PBA)Appliance (PBA)

Controller-basedController-basedVirtualizationVirtualization

SANSAN

Intelligent SwitchIntelligent Switch

Page 12: Storage Virtualization Strategies

Types of Network-based SolutionsTypes of Network-based Solutions1. Intel-based platforms (Appliance):

– Simple and cost-effective form factor

– Most widely deployed approach to date

– Rich set of advanced storage applications available

– Examples: IBM SVC, DataCore, FalconStor

2. Purpose-built appliances (PBA):– Strong interoperability support in heterogeneous environments

– Support for multiple storage applications

– Designed for mid-range to mission-critical apps

– Require two management interfaces

– Examples: QLogic/Troika

Page 13: Storage Virtualization Strategies

Types of Network-based Solutions ContinuedTypes of Network-based Solutions Continued

3. Intelligent Switches:– Promises highest levels of scalability, availability, and

performance

– Data-center ready design

– Virtualization controller software unproven & lack key storage applications

– Relatively higher cost per port

– Switch Examples: Brocade, Cisco, McData

– Virtualization Controller Examples: EMC InVista, Incipient, StoreAge

Page 14: Storage Virtualization Strategies

Fundamental ConceptsFundamental Concepts• Metadata Server

– Maintains Configuration Database

– Virtualization Mapping Tables

• Control Path Software– Provides Interface Between Metadata Server and Data Path Server

– Performs Background I/O Tasks

• Data Path Software– Moves Data from Server to Storage (and vice versa)

– Performs Translation from Virtual to Physical Addresses

Note: Datapath Software is Always in the Data Path

Page 15: Storage Virtualization Strategies

Virtualization Architectures: In-Band vs. Virtualization Architectures: In-Band vs. Out-of-BandOut-of-Band• In-Band

– Data and Control Data are managed by same compute elements

– Initial implementations lacked scalability and performance

– Newer implementations much more scalable and “enterprise-class”

– Examples: IBM SVC, FalconStor

• Out-of-Band

– Separates data and control paths

– Requires host agents creating management complexity and potential for security breaches

– Example: StoreAge

Page 16: Storage Virtualization Strategies

Virtualization Architectures: Split Path Virtualization Architectures: Split Path Architecture for Intelligent Devices (SPAID)Architecture for Intelligent Devices (SPAID)

• Hybrid of In-Band & Out-of-Band Approaches

– Separates control path from the data path

– Leverages port-level processing capabilities of intelligent

switches or purpose-built controllers

– Unproven approach given the lack of availability of intelligent

switches (holds highest potential)

– Example: EMC InVista, Incipient, StoreAge

Page 17: Storage Virtualization Strategies

SPAID ArchitectureSPAID Architecture

Arrays

Hosts

Fabric AFabric B

Split Path Architecture Most I/O are routed through the Fast Path at near

line speeds on purpose-built ASICs Few I/Os are faulted to the Control Path (CP) No state / no cache Full fabric bandwidth Scalable across entire fabric

Intelligent FC Switch

Page 18: Storage Virtualization Strategies

Players and StrategyPlayers and Strategy

• IBM (SVC on Appliance)

• EMC (InVista on Intelligent Switches)

• Incipient (Incipient on Intelligent Switches)

• HDS (Internal Controller)

• QLogic/Troika (PBA via Partnerships with Software Vendors)

• StoreAge (Out of band Appliance or Intelligent Switch)

• FalconStor (Appliance)

• Cloverleaf (Appliance)

• Cisco, Brocade/McData (Intelligent Switches via Partnerships)

Page 19: Storage Virtualization Strategies

File System VirtualizationFile System Virtualization

• Abstraction of logical relationships above

individual file system image

• Separates user and group relationships from

specific devices

• Enables creation of exports and shares

Creates a global namespace

Page 20: Storage Virtualization Strategies

Server Virtualization & StorageServer Virtualization & Storage• Server virtualization presents unique challenges

for storage– Much higher SAN attach rate than traditional applications

– Shared storage & CLVM is common deployment for VM

mobility (e.g. VMotion & Live Migration)

– HBAs must be specifically qualified to run at hypervisor level

for VMWare

– Single HBA shared across all virtualized guest OSes

Page 21: Storage Virtualization Strategies

Server Virtualization & Virtual HBAsServer Virtualization & Virtual HBAs• Enables HBAs to be virtualized using industry-standard N-Port ID Virtualization

(NPIV)• Enables SAN best practices, standard management tools in a virtualized

environment– Examples: Fabric zoning, Array-based LUN masking

NPIV HBAs

A B C

Hypervisor

A B C

Hypervisor

HBAs

Server

OS

Single Fibre Channel

view shared among all virtual machines Logical views for each VM

or group of VMs

Server

OS OS OSOS OS

I/O I/O I/O

I/O

SAN (single view) AB

C

Example: Example: EmulexEmulex

Page 22: Storage Virtualization Strategies

Network & I/O VirtualizationNetwork & I/O VirtualizationIO Virtualization

– Quickly map and re-map server and storage

configuration (e.g. MAC & WWN identifiers, boot images,

etc) so that applications can be provisioned and re-

provisioned without changes to fabric or servers.

– Step toward virtual data center and stateless servers

that change personality based on demand

– Ex. HP Virtual Connect, Cisco VFrame, Voltaire

GridVision

Page 23: Storage Virtualization Strategies

Recommendations to UsersRecommendations to Users

• If Mostly Homogeneous, virtualization is still

important.– Stay with existing vendor’s virtualization solution.

• If Highly Heterogeneous, go with intelligent

switch, PBA, or appliance

• Ensure the Applications you want are Available

• Be Wary of Internal Controller Approaches

• Ensure Solution is Not “All or Nothing”

Page 24: Storage Virtualization Strategies

QuestionsQuestions

Arun Taneja

[email protected]