Cloud Storage - Ivy Worldwideivyworldwide.com/.../terri/2013/04/6Patrick-Osborne-HP-Storage.pdf ·...

Cloud Storage Patrick Osborne (@patrick_osborne) Director of Product Management

Sam Fineberg

Distinguished Technologist

HP Storage

© Copyright 2012 Hewlett -Packard Development Company, L.P. The information contained herein is subject to change without notice. HP Confidential 2

Why HP will WIN with Converged Storage

Industry Standard x86-based platforms Increase storage performance and density

Scale-out and federated software

Non-disruptive data growth and mobility

Converged management orchestration Choreograph across servers, networks, and storage

Modern storage architecture designed for the cloud,

optimized for big data and built on converged infrastructure.


Federation Enables the Aggregation of Individual Virtualized Array Functionality

Why Federated Storage is a key requirement in cloud datacenters

Manage resources at the data center or metro level, versus device by device

Experience secure, non-disruptive data mobility at the array level (versus host)

Distributed volume management across self-governing, homogeneous

peer systems using native communication between peers.

Like Compute Federation, Storage Federation is Peer-to-Peer versus Hierarchical

Storage Federation


Polymorphic simplicity: cloud storage without boundaries

Eliminating distinctions between midrange and Tier 1

HP 3PAR StoreServ

10800

HP 3PAR StoreServ

10400

HP 3PAR StoreServ 7400

HP 3PAR StoreServ 7200

NEW Tier 1 storage at less than $40K USD!

NEW Redefining the Midrange from $25K USD!

• New 3PAR StoreServ 7000 Storage

• One Architecture

• Federated

• Efficient

• Multi-Tenant

Only HP


3PAR StoreServ Web Services API

Developers Guide and Sample Client can be downloaded from HP Software depot

http://software.hp.com

Tasks Supported

• Creation and removal of − Virtual Volumes

− Virtual Copies

− Common Provisioning Groups (CPG)

− VLUN

• Query all − Volumes and their

properties

− CPGs and their properties − VLUNs and their properties

Provides a well-defined application programming interface for performing storage management tasks


Primary Storage

HP 3PAR StoreServ

Tier 1 storage for virtualization and ITaaS for block, object and file

Information Retention / Analytics

Information Protection

HP StoreAll

Hyperscale storage to tame and mine your

content explosion

HP StoreOnce

Federated Deduplication from small sites to service providers

Software Defined Storage

Server/Storage Agnostic | Scale-Out | Hypervisor Independent HP StoreVirtual

HP Converged Storage is transforming the industry

The new style of IT


Block, file, and object compared

Block

File

Object

Shares & pathnames

IDs & metadata

RAID & LUNs

Data center proximity

Fibre Channel, SAS, iSCSI

Local and wide area proximity

SMB (CIFS), NFS, HTTP, FTP

Internet proximity

REST API

Applications

Clients

Hosts

Acc

ess

sim

plic

ity,

sca

lab

ility

, lat

ency


Cloud Storage 101

Block Storage • Generally SCSI protocol

based, organized by LUNs

• Not directly consumed by applications, usually used to hold a filesystem

• Low level storage abstraction upon which file and object storage is built

File Storage • Files organized in directory

hierarchy and accessed by pathname

• File-based NAS protocols like NFS and CIFS

• Rich and complex application support: random access, in-place file updates, locking, etc.

Object Storage • Efficient flat namespace: objects

organized by accounts, containers, object keys, and metadata

• HTTP / REST / URL based – easily scriptable, many language choices

• Relatively simple interface compared to file storage

• Scalable to very high object counts

• More easily scaled across multiple geographies

• Ideal for relatively static data


New: HP StoreVirtual 4530 & 4730 Storage

HP StoreVirtual: software defined storage

• Simple: Simple management for virtualized environments

• Scalable: Non-disruptively scale performance and capacity

• Highly-Available: Cost-effective multi-site disaster recovery

New: StoreVirtual 4530/4730

Virtual appliance or

ProLiant Gen8 appliance


StoreAll architecture

Storage segments

Distributed File Engine

Object REST API

Node

Node

Allocated segments

Allocated segments

Data Protection e.g. Constant Validation

and Snapshots

Data Retention e.g. Retention Policies

and WORM

Data Mobility e.g. Tiering

and Replication

Data Management e.g. Express Query

and Quotas

File NFS, SMB, HTTP and HTTPS, WebDAV, FTP and FTPS

Node

Node

Allocated segments

Allocated segments

Not all Data Services are available for object storage

Centralized Management


Leveraging HP storage in the OpenStack Environment

What is HPSD doing to make customers deploying OpenStack clouds with HP storage successful?

• Block Storage • Cinder drivers integrating HP storage devices

• StoreVirtual

• 3Par

• Extending OpenStack to support additional storage capabilities

• Fiber Channel

• Volume Types


Cinder Overview

OpenStack VMs use block storage for

• Boot volumes

• Additional storage volumes

Cinder

• Originally Nova had a block storage component – Nova Volume

• Beginning with Folsom, a separate block storage service (Cinder) has been available

• Cinder is a pluggable interface for managing OpenStack block storage volumes

Status

• In Folsom, Cinder mirrored the Nova volume functionality

• In Grizzly and beyond, support for additional storage devices and features are being added

• E.g., Snapshotting, Backup to Swift, Fiber Channel, etc.



Block Storage

• StoreVirtual iSCSI Cinder driver • Created/contributed by Rackspace

• Distributed as part of OpenStack “Folsom” release – available to anyone

• Implements all “Folsom” Cinder functions

• Volume: Create, Delete, Attach, Detach, Snapshot

• Utilizes SAN/iQ cli interface

• HP teams have fixed some bugs

• Part of OpenStack “Folsom” release NOW

• In production use by Rackspace

OpenStack / Cinder

StoreVirtual iSCSI Driver



Block Storage

• 3Par iSCSI Cinder driver • Created by HP

• Submitted/Reviewed/Accepted by the Cinder project for distribution in OpenStack “Grizzly” release

• Implements all of the Cinder API functions

• Create Volume, Delete Volume, Create Snapshot, Delete Snapshot, Attach Volume, Detach Volume, Create Volume from Snapshot

• Driver performs provisioning using a single virtual domain / CPG

• Part of OpenStack “Grizzly” release in April ‘13

OpenStack / Cinder

3Par iSCSI Driver

3Par Web Client Library



Block Storage

• Fibre Channel • HP has formed a cross-industry group to add Fibre Channel support to OpenStack

• HP, Brocade, EMC, IBM, Hitachi participants

• Blueprints submitted to Cinder & Nova projects to add Fibre Channel SAN support

• https://blueprints.launchpad.net/cinder/+spec/fibre-channel-block-storage

• https://blueprints.launchpad.net/nova/+spec/libvirt-fibre-channel

• Phase 1 supports open & pre-zoned SAN’s only (i.e. no active zoning)

• Implementation by HP done, code accepted to Cinder and Nova

• Part of OpenStack “Grizzly” in April ‘13

• 3Par FC Cinder driver • Implementation complete, being accepted to Cinder project

• Similar functionality as 3Par iSCSI driver

• Part of OpenStack “Grizzly” in April ‘13

OpenStack / Cinder

3Par iSCSI Driver

iSCSI FC

3Par FC Driver

https://blueprints.launchpad.net/cinder/+spec/fibre-channel-block-storage









https://blueprints.launchpad.net/nova/+spec/libvirt-fibre-channel









Block Storage – Beyond “Grizzly”

• FC active Zoning • Why?

• To enable private SAN deployments leveraging DC infrastructure

• New driver interface being created to allow SAN switch vendors to add their own drivers to zone their SAN switches

• Working with Brocade to define active zoning blueprints & implementation

• Supporting Multiple SAN configurations:

• Single SAN

• Redundant SANs

• Partitioned SANs

• Direct connect SANs (Flat SANs)

• Targeted for inclusion in OpenStack “Havana” release in Oct ’13

OpenStack / Cinder

3Par iSCSI Driver

iSCSI FC

3Par FC Driver

SAN

Brocade SAN Driver

SAN Host Connect



Block Storage – Beyond “Grizzly”

• Cinder “Volume Types” support in 3Par drivers • Enables storage admin to define volume types that invoke

different device capabilities

• Service catalog of software defined storage types

• 3Par capabilities exposed so they are accessible to Cinder Volume Type mechanism

• Target release in OpenStack “Havana” release in Oct ‘13 3Par Capabilities: • VD/CPG selection • Thin provisioning • Hostmode selection • iSCSI/FC SAN selection • QoS specification

Volume Types

Device Capabilities

Cloud Users

“Silver” Storage

“Gold” Storage

Cloud Storage - Ivy Worldwideivyworldwide.com/.../terri/2013/04/6Patrick-Osborne-HP-Storage.pdf ·...

Documents

Transcript of Cloud Storage - Ivy Worldwideivyworldwide.com/.../terri/2013/04/6Patrick-Osborne-HP-Storage.pdf ·...