IBM Storage Virtualisation Technologies - University of...

30
IBM TotalStorage ® © 2005 IBM Corporation IBM Storage Virtualisation Technologies Steve Legg Senior Architect

Transcript of IBM Storage Virtualisation Technologies - University of...

Page 1: IBM Storage Virtualisation Technologies - University of …tsm-symposium.oucs.ox.ac.uk/2005/papers/Storage Virtualization... · IBM Storage Virtualisation Technologies ... 6 IBM TotalStorage

IBM TotalStorage®

© 2005 IBM Corporation

IBM Storage VirtualisationTechnologies

Steve LeggSenior Architect

Page 2: IBM Storage Virtualisation Technologies - University of …tsm-symposium.oucs.ox.ac.uk/2005/papers/Storage Virtualization... · IBM Storage Virtualisation Technologies ... 6 IBM TotalStorage

2

IBM TotalStorage®

IBM TotalStorage | The power to break through © 2005 IBM Corporation

LogicalSimplificationPools of resources Multiple OS’s per serverRapid ProvisioningAutomated management

Virtualization

Virtual Servers, Storage, Networks

StorageServersNetworking

PhysicalConsolidation

Windows Server

Unix Server

Linux Server

Networking

Fewer devices and licensesDisparate management toolsLabor intense provisioning

Storage

Reducing Complexity Windows Servers

Linux Servers

Unix Servers

Islands of computing and dataDisparate management toolsManual Provisioning

Management Servers

Complex

Networking

Page 3: IBM Storage Virtualisation Technologies - University of …tsm-symposium.oucs.ox.ac.uk/2005/papers/Storage Virtualization... · IBM Storage Virtualisation Technologies ... 6 IBM TotalStorage

3

IBM TotalStorage®

IBM TotalStorage | The power to break through © 2005 IBM Corporation

Automate

Virtualize

Visualize

• Categorise your data• Perform clean-up• Improve utilisation

• Simplify your storage infrastructure• Make open vendor choice a reality• Make the infrastructure dynamic

• Integrate with systems management• Workflow automation

Page 4: IBM Storage Virtualisation Technologies - University of …tsm-symposium.oucs.ox.ac.uk/2005/papers/Storage Virtualization... · IBM Storage Virtualisation Technologies ... 6 IBM TotalStorage

4

IBM TotalStorage®

IBM TotalStorage | The power to break through © 2005 IBM Corporation

Virtualisation

Simplify the underlying IT infrastructure and its management to help lower cost and complexity while increasing your ability to respond to changing demands

OrchestrationOrchestration

StorageInfrastructureManagement

StorageStorageInfrastructureInfrastructureManagementManagement

HierarchicalStorage

Management

HierarchicalHierarchicalStorageStorage

ManagementManagementArchive

ManagementArchiveArchive

ManagementManagementRecovery

ManagementRecoveryRecovery

ManagementManagement

Storage VirtualizationStorage Virtualization

Advanced Copy ServicesAdvanced Copy Services

Hardware InfrastructureHardware InfrastructureTapeTapeDiskDisk Storage NetworkingStorage Networking

Content M

anagement

Content M

anagement

Page 5: IBM Storage Virtualisation Technologies - University of …tsm-symposium.oucs.ox.ac.uk/2005/papers/Storage Virtualization... · IBM Storage Virtualisation Technologies ... 6 IBM TotalStorage

5

IBM TotalStorage®

IBM TotalStorage | The power to break through © 2005 IBM Corporation

Infrastructure SimplificationSome terminology

Consolidation– Leverage advances in storage density to consolidate many older

devices into fewer – or one – newer device.

Virtualization– Separate the logical representation of a resource from its physical

implementation – improving flexibility and simplifying management.

Page 6: IBM Storage Virtualisation Technologies - University of …tsm-symposium.oucs.ox.ac.uk/2005/papers/Storage Virtualization... · IBM Storage Virtualisation Technologies ... 6 IBM TotalStorage

6

IBM TotalStorage®

IBM TotalStorage | The power to break through © 2005 IBM Corporation

Quality of Service

Cos

t per

MB

Quality of Service

Cos

t per

MB

Enterprise-class Disk

Mid-range Disk with Fibre Channel

Mid-range Disk with S-ATA

Virtual Tape Enterprise-class TapeMid-range Tape

Hardware InfrastructureA hierarchy from high quality-of-service to low-cost

Mid-rangeFibre Channel disks

Mid-rangeSerial ATA disks

Enterprise-class disk

Virtual tape

Enterprise andMid-range tape

Page 7: IBM Storage Virtualisation Technologies - University of …tsm-symposium.oucs.ox.ac.uk/2005/papers/Storage Virtualization... · IBM Storage Virtualisation Technologies ... 6 IBM TotalStorage

IBM TotalStorage®

© 2005 IBM Corporation

Block Virtualisation withIBM SAN Volume Controller

Steve LeggSenior Architect

Page 8: IBM Storage Virtualisation Technologies - University of …tsm-symposium.oucs.ox.ac.uk/2005/papers/Storage Virtualization... · IBM Storage Virtualisation Technologies ... 6 IBM TotalStorage

8

IBM TotalStorage®

IBM TotalStorage | The power to break through © 2005 IBM Corporation

Why Virtualization?Lower TCO

SAN

HitachiThunder

HitachiLightning

EMCCLARiiON

EMCDMX

•Initial purchase price is significant

•With software and maintenance, 4-year TCO can easily double

Page 9: IBM Storage Virtualisation Technologies - University of …tsm-symposium.oucs.ox.ac.uk/2005/papers/Storage Virtualization... · IBM Storage Virtualisation Technologies ... 6 IBM TotalStorage

9

IBM TotalStorage®

IBM TotalStorage | The power to break through © 2005 IBM Corporation

Why Virtualization?Lower TCO

SAN

HitachiThunder

HitachiLightning

EMCCLARiiON

EMCDMX

Driver Driver Driver DriverDriverHowever, multi-vendor disk environments come with problems…•Multi-path drivers•Management software•Copy service APIs

HitachiHiCommand EMC

ControlCenter

ShadowImageTrueCopy

TimeFinderSRDF

EMCControlCenter

SymmetrixManager EMC

ControlCenterNavisphere

Page 10: IBM Storage Virtualisation Technologies - University of …tsm-symposium.oucs.ox.ac.uk/2005/papers/Storage Virtualization... · IBM Storage Virtualisation Technologies ... 6 IBM TotalStorage

10

IBM TotalStorage®

IBM TotalStorage | The power to break through © 2005 IBM Corporation

Virtualize the Disks

SAN

Traditionally, host systems were aware of physical changes in the storage infrastructure.

Page 11: IBM Storage Virtualisation Technologies - University of …tsm-symposium.oucs.ox.ac.uk/2005/papers/Storage Virtualization... · IBM Storage Virtualisation Technologies ... 6 IBM TotalStorage

11

IBM TotalStorage®

IBM TotalStorage | The power to break through © 2005 IBM Corporation

SANVolume Controller

Virtualize the Disks

SAN

SDD SDD SDD SDD

TotalStorageProductivity Center

Single set of copy services

Page 12: IBM Storage Virtualisation Technologies - University of …tsm-symposium.oucs.ox.ac.uk/2005/papers/Storage Virtualization... · IBM Storage Virtualisation Technologies ... 6 IBM TotalStorage

12

IBM TotalStorage®

IBM TotalStorage | The power to break through © 2005 IBM Corporation

SANVolume Controller

Virtualize the Disks

SAN

SDD SDD SDD SDD

TotalStorageProductivity Center

Single set of copy services

Page 13: IBM Storage Virtualisation Technologies - University of …tsm-symposium.oucs.ox.ac.uk/2005/papers/Storage Virtualization... · IBM Storage Virtualisation Technologies ... 6 IBM TotalStorage

13

IBM TotalStorage®

IBM TotalStorage | The power to break through © 2005 IBM Corporation

SANSAN

Volume Controller

SAN

Improved Application Availability

Traditional SAN1. Stop the application2. Move data3. Re-establish host connections4. Start application

SAN Volume Controller1. Move data

Host systems and applications are not affected.

VirtualDisk

Page 14: IBM Storage Virtualisation Technologies - University of …tsm-symposium.oucs.ox.ac.uk/2005/papers/Storage Virtualization... · IBM Storage Virtualisation Technologies ... 6 IBM TotalStorage

14

IBM TotalStorage®

IBM TotalStorage | The power to break through © 2005 IBM Corporation

Reduced Cost and Improved Flexibilityfor Replication Services

Traditional SANReplication service API’s differ by vendor, making it difficult to integrate applicationsLower-cost disks offer primitive, or no replication services

SAN Volume ControllerCommon replication API, SAN-wide, that does not change as storage hardware changesReplication targets can be on lower-cost disks, reducing the overall cost of exploiting replication services

SAN SANSAN

Volume Controller

IBMDS8000

IBMDS6000

HPEVA

HPEVA

FlashCopyMetro Mirror

Business CopyContinuous Access

IBMDS8000

IBMDS4300

FC

EMCSym

HPEVA

SVC

IBMDS4100

S-ATA

Page 15: IBM Storage Virtualisation Technologies - University of …tsm-symposium.oucs.ox.ac.uk/2005/papers/Storage Virtualization... · IBM Storage Virtualisation Technologies ... 6 IBM TotalStorage

15

IBM TotalStorage®

IBM TotalStorage | The power to break through © 2005 IBM Corporation

DS6000 DS4100S-ATASymmetrix

SAN Volume Controller SAN Volume Controller

Cross-device consistency groups

TotalStorage SAN Volume Controller Copy Services

Clariion

Page 16: IBM Storage Virtualisation Technologies - University of …tsm-symposium.oucs.ox.ac.uk/2005/papers/Storage Virtualization... · IBM Storage Virtualisation Technologies ... 6 IBM TotalStorage

16

IBM TotalStorage®

IBM TotalStorage | The power to break through © 2005 IBM Corporation

Performance – node pair

IOPs– Read (cache hit) 140,000 IO/s per node pair– Read (cache miss) 50,000– Write 20,000

Bandwidth– Read (cache hit) 1.5GB/s– Read (cache miss) 1.0GB/s– Write 400MB/s

Scales linearly with number of node pairs

Page 17: IBM Storage Virtualisation Technologies - University of …tsm-symposium.oucs.ox.ac.uk/2005/papers/Storage Virtualization... · IBM Storage Virtualisation Technologies ... 6 IBM TotalStorage

17

IBM TotalStorage®

IBM TotalStorage | The power to break through © 2005 IBM Corporation

5

10

15

20

25

2040

60

50100

150

20

40

60

1020

3040

510

15

SPC-like

70/30/50

RH

RM

WH

WM

FAStT storage

FAStT+SVC

SVC 2 Node Max

Configurations : Six FAStT600, 168 15K RPM disks, 2 SVC nodes, 4 FC host paths, RAID-5

SVC Virtualization Layer Performance

Page 18: IBM Storage Virtualisation Technologies - University of …tsm-symposium.oucs.ox.ac.uk/2005/papers/Storage Virtualization... · IBM Storage Virtualisation Technologies ... 6 IBM TotalStorage

18

IBM TotalStorage®

IBM TotalStorage | The power to break through © 2005 IBM Corporation

SANVolume Controller

TotalStorage SAN Volume ControllerSupported Environments

SAN

MicrosoftMSCS

MPIO, VSS, GDS

IBM AIX

HACMP-XD

SunSolaris

VCS Clustering

HP/UXServiceGuard

Clustering

Linux(Intel / POWER)RHEL / SuSE

IBMBladeCenterWindows/Linux/AIX

VMWare

SAN

SANVolume Controller

Continuous CopyMetro Mirror

FCP

Intended as an overview only.For the most complete information, visit ibm.com/storage/software

NovellNetware

Clustering

Point-in-time CopyFull volume

Copy on write

VMWareWindows / Linux /NetWare guests

IBMFAStT

100/200/500600/600T700/900

HitachiThunder

920095xxV

HPEVA30005000

IBMDS

DS8000DS6000DS4000

HitachiLightning

9980V9970V

9910/9960

HPMA/EMA

80001200016000

EMCSymm

8000DMX

EMC/DellCLARiiON

FC4700CX2/3/4/5/6/700

IBMESS

F20750800

Sun

9910/99609970/9980

Page 19: IBM Storage Virtualisation Technologies - University of …tsm-symposium.oucs.ox.ac.uk/2005/papers/Storage Virtualization... · IBM Storage Virtualisation Technologies ... 6 IBM TotalStorage

19

IBM TotalStorage®

IBM TotalStorage | The power to break through © 2005 IBM Corporation

SAN Volume Controller Storage Software Roadmap

V1.1V1.1

V1.2V1.2

V2.1V2.1

3Q03SVC applianceSIS SAN-in-a-Can

1Q04NAS 500G S-ATA EXP-100Veritas DMP support DWDM FC ExtendersSVC4MDS w/FC-IP

1Q05

#Hosts ScalabilitySolaris & HP-UX clustering

HP-UX lift 8 LUN limit Netware 6.5 w/clusteringNew FAStT, New LCRBW2K3-MPIO, VSS,GDSImage Mode Data MigrationSW-Master Console option

UPS smaller package (2x1U)

4Q048 node scalability #vdisks scalabilityHP EVA, 9960/9910DS6000 / DS8000SUSE SLES 8EMC DMX

4Q05Enable Array Copy SrvsScalability: 1K HostsHardware upgrade

x336, 8GB cacheCust Ease of Use EnhInterop Enhancements:

storage, hosts2Q04

EMC Clariion/SymmHDS 9500V/9900VHP MA/EMA (full spt)Increase #hostsW2K3 w/clusteringVMWare, Solaris 9, RedHat 3.0BladeCenter

4Q03Data Migration, FlashCopy, Metro Mirror, ICAT, SMI-SUNIX, Windows w/ MSCS, LINUX, AIX with HACMP, BladeCenter OPMHP MA/EMA (single path)Heterogeneous storage: ESS, HDS, HP, EMC

SVC for MDS9000 Blade

Adv Copy ServicesSEFCMultiple FC TgtsOverallocationIncremental FC

2X Scaling: nodes, hosts

Interoperability EnhEmbedded CIMOMESS/DS Copy Srvs & Interop Converg

Note: States IBM's future product plans and general intentions only. It is subject to change or cancellation without notice and

should not be relied on for any purpose.

V1.2.1V1.2.1

V3.1V3.1V4.1V4.1

FuturesFutures

2Q06Adv Copy Services

Global MirrorHardware upgrade:

4Gb/s HBA, RoHSSMI-S 1.1 ICATCustomer Install

HW/SWInterop Enhancemts:

storage, hosts

Page 20: IBM Storage Virtualisation Technologies - University of …tsm-symposium.oucs.ox.ac.uk/2005/papers/Storage Virtualization... · IBM Storage Virtualisation Technologies ... 6 IBM TotalStorage

IBM TotalStorage®

© 2005 IBM Corporation

File Virtualisation withIBM TotalStorageSAN File System

Page 21: IBM Storage Virtualisation Technologies - University of …tsm-symposium.oucs.ox.ac.uk/2005/papers/Storage Virtualization... · IBM Storage Virtualisation Technologies ... 6 IBM TotalStorage

21

IBM TotalStorage®

IBM TotalStorage | The power to break through © 2005 IBM Corporation

IBM TotalStorage SAN File SystemAddresses file and data management issues

File, Data Management IssuesFile, Data Management Issues• File tasks must be done on each server• Difficult to migrate applications to other servers• Application Downtime required for FS changes• No single view/access to files or data• Cannot pool files based on Quality of Service

Volume, Storage Management IssuesVolume, Storage Management Issues• Server to storage logical connections are static• Server Downtime required to manage LUNs,

migrate volumes• Copy services are unique to each device• Difficult to pool volumes

SANSAN

Volume ControllerAdv

Function

SANFile System

FileSystem

FileSystem

FileSystem

FileSystem

Page 22: IBM Storage Virtualisation Technologies - University of …tsm-symposium.oucs.ox.ac.uk/2005/papers/Storage Virtualization... · IBM Storage Virtualisation Technologies ... 6 IBM TotalStorage

22

IBM TotalStorage®

IBM TotalStorage | The power to break through © 2005 IBM Corporation

SANVolume Controller

VirtualDisk

VirtualDisk

VirtualDisk

IBM TotalStorage SAN File System

SAN

ESS SATA

SANFile System

Storage Pool

Storage Pool

Storage Pool

Good Better BestProject A Project B Project CCustomer 1

Customer 2

Customer 3

Storage Pool

Storage Pool

Storage Pool

Storage Pool•Pools of capacity•Segmented based on business need

Page 23: IBM Storage Virtualisation Technologies - University of …tsm-symposium.oucs.ox.ac.uk/2005/papers/Storage Virtualization... · IBM Storage Virtualisation Technologies ... 6 IBM TotalStorage

23

IBM TotalStorage®

IBM TotalStorage | The power to break through © 2005 IBM Corporation

IBM TotalStorage SAN File System

SANFile System

/Storage Utility/A /B

/D /E /F/C

Name Space•Shared by all participating servers

Page 24: IBM Storage Virtualisation Technologies - University of …tsm-symposium.oucs.ox.ac.uk/2005/papers/Storage Virtualization... · IBM Storage Virtualisation Technologies ... 6 IBM TotalStorage

24

IBM TotalStorage®

IBM TotalStorage | The power to break through © 2005 IBM Corporation

IBM TotalStorage SAN File System

SAN

Storage Pool

Storage Pool

Storage Pool

SANFile System

Policies•File placement based on business need

Page 25: IBM Storage Virtualisation Technologies - University of …tsm-symposium.oucs.ox.ac.uk/2005/papers/Storage Virtualization... · IBM Storage Virtualisation Technologies ... 6 IBM TotalStorage

25

IBM TotalStorage®

IBM TotalStorage | The power to break through © 2005 IBM Corporation

IBM TotalStorage SAN File System

SAN

SANFile System

Storage Pool

Storage Pool

Storage Pool

ServerConsolidation

Page 26: IBM Storage Virtualisation Technologies - University of …tsm-symposium.oucs.ox.ac.uk/2005/papers/Storage Virtualization... · IBM Storage Virtualisation Technologies ... 6 IBM TotalStorage

26

IBM TotalStorage®

IBM TotalStorage | The power to break through © 2005 IBM Corporation

BackupServer

IBM TotalStorage SAN File System

SAN

SANFile System

Storage Pool

Storage Pool

Storage Pool

Bkupagent

Bkupagent

Bkupagent

Bkupagent

NewEfficiencies•Backup•Virus scanning•Other?

Page 27: IBM Storage Virtualisation Technologies - University of …tsm-symposium.oucs.ox.ac.uk/2005/papers/Storage Virtualization... · IBM Storage Virtualisation Technologies ... 6 IBM TotalStorage

27

IBM TotalStorage®

IBM TotalStorage | The power to break through © 2005 IBM Corporation

SAN

Improved Access to and Sharing of DataTraditional SAN

Difficult to share across applicationsData is replicated – duplicate storage requiredTurnaround times are slowed by data copy and batch processing

SAN File SystemNo replicationNo duplicationStreamlined turnaround times

SAN

SANFile System

FTP FTP Share Share

Page 28: IBM Storage Virtualisation Technologies - University of …tsm-symposium.oucs.ox.ac.uk/2005/papers/Storage Virtualization... · IBM Storage Virtualisation Technologies ... 6 IBM TotalStorage

28

IBM TotalStorage®

IBM TotalStorage | The power to break through © 2005 IBM Corporation

VFS w/Cache IFS w/CacheVFS w/Cache VFS w/Cache VFS w/Cache

IP Network for Client/Metadata Cluster Communications

Storage NetworkStorage Network

AIX Solaris HP-UX Linux Windows

Multiple Storage poolsData Store

Shared Storage Devices

Metadata Server Cluster

NFS CIFS

Admin Client

External Clients

Metadata Server

Metadata Server

Metadata Server

Metadata Store

IBM TotalStorage SAN File System – Architecturebased on Storage TankTM technology

Page 29: IBM Storage Virtualisation Technologies - University of …tsm-symposium.oucs.ox.ac.uk/2005/papers/Storage Virtualization... · IBM Storage Virtualisation Technologies ... 6 IBM TotalStorage

29

IBM TotalStorage®

IBM TotalStorage | The power to break through © 2005 IBM Corporation

TotalStorage SAN File SystemSupported Environments

SAN

IBMESSF20/800

HitachiThunder

9200

HPEMA1200016000

IBMFAStT200/500

600/600T700/900

HPMA8000

MicrosoftWindows

MSCS

IBM AIXHACMP

SunSolarisClustering

Linux(Intel)

IBMESS

HitachiThunder

HPEMA

IBMFAStT

HitachiLightning

HPMA

EMCSymmetrix

EMCCLARiiON

SANVolume Controller

VirtualDisk

VirtualDisk

VirtualDisk

“ANY”Disk

Page 30: IBM Storage Virtualisation Technologies - University of …tsm-symposium.oucs.ox.ac.uk/2005/papers/Storage Virtualization... · IBM Storage Virtualisation Technologies ... 6 IBM TotalStorage

IBM TotalStorage®

© 2005 IBM Corporation

Thanks