Jeremiah Loscalzo - TB3011 - Designing a storage cloud

© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

TB3011Designing a storage cloud


Designing a storage cloudStorage cloud requirements – an evolution

Jeremiah Loscalzo, Manager: Worldwide Storage Consulting PortfolioJune 2012

© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.3

Agenda

• HP’s WW Storage Consulting Portfolio• The path to storage cloud is not

always clear • Storage Cloud Design Service• Five (5) architectures to help address

client requirements− 3PAR− X9000− Cloudpointe Connect− Fluid Operations− Nirvanix

• Summary

Services abstract: Architect and design your new private storage cloud to include macro and micro diagrams, a transition plan and a bill of materials to enable the freedom to execute the solution on your own, leverage HP’s experience or even leverage a third party


Implement & operate

Architect & design

Assess & plan

Strategize & discover

Transformation

Infrastructure servicesDevelop a vision for storage and backup infrastructure and discover current capabilities

Understand gaps and identify levers for improvement

Design a new Infrastructure that will support your vision and initiatives

Custom Implementations for even the most complex infrastructures

Residency servicesOur experienced consultants can help you build a vision or strategy

Our project and program managers can help you with planning and co-ordination

Our skilled architects can help you with any design and architecture challenge

Deep product knowledge to help implement and manage heterogeneous environments

Migration servicesCollect vital data about your pre-migration environment creating a live blueprint

Plan for a successful migration by identifying all required upgrades and crucial linkages

Design a migration plan that preserves organization productivity during the move

Move the data non disruptively either online or offline environments

Big data servicesDevelop a strategy to integrate unstructured data with structured data for intelligent decisions

Understand gaps and identify levers for improvement

Design Infrastructure that will bring together structured and unstructured data seamlessly

Custom Implementations for even the most complex big data infrastructures

HP’s worldwide storage consulting services


The promise of the Public Storage Cloud

• Low cost• Self service and the predefined, automated

provisioning inherent to that• Usage based with chargebacks• Resilient and available


Customers will evolve to the cloud at different speeds

Bu

sin

ess

Tran

sfo

rmati

on

to S

tora

ge C

lou

d

IT Transformation to “Strategic Service Broker”

Standardize and consolidate

Virtualize and automate

Self-provision services on-demand• Non-mission

critical and mission-critical

Aggregate internal and external services

Become a Service Provider


Some clients are ready for cloud…

• They know the in-scope environment− Future user community− Workloads− Applications− Related data and data models− Supporting infrastructure− Relevant departments

• Accounting practices charge profit centers for the use of cost centers


For the rest of our clients who need storage cloud…• They don’t know that the intended

data requires traditional SAN storage• Their accounting environment

(storage cost center and profit centers pay for their consumption) is not optimized for cloud• Their storage networking

environment is not optimized• They are not positioned to deliver

on low cost• Storage service process best

practices are not "operationalized"


Based on our experience, use cases vary from SAN design and virtualization to public cloud• Public or private storage cloud -

block or file storage based• Private compute cloud- block, file

or cloud based storage• Public or private file sharing

storage cloud - block or file storage based• File or block based storage

virtualization/ storage modernization/ optimization• Automated tier one block/ SAN

storage (not low cost but optimized operations)


Some practical storage cloud definitions

private storage cloud public storage cloud hybrid storage cloud

This solution can be block or file based storage but must offer scale out capacity and performance, a single global namespace, policy based data movement, tiered storage , low cost and minimal administration for internal users. Advanced versions include either a managed service that offers provisioning and billing or technology that delivers self service, automated provisioning and showback/ chargebacks. Workloads are not as limited by low network speeds as public solutions must reply on WAN bandwidth. Data is typically unstructured or semi-structured via CAS

This solution must deliver storage over a WAN and while the base storage can be block storage, file based storage is the most logical choice. Public solutions must also offer scale out capacity and performance, a single global namespace, policy based data movement, tiered storage , low cost and minimal administration for internal and even external customers. Public solutions assume either a managed service that offers provisioning and billing or technology that delivers self service, automated provisioning and showback/ chargebacks. Data is typically unstructured or semi-structured via CAS

A hybrid cloud is the future of our cloud enterprise. It marries the features and benefits of a private and public storage cloud while offering a single global namespace and access to data through the LAN or WAN and offers service for a larger mix of workloads made up of unstructured data


The challenge our clients face is real

• Defining requirements for the cloud. Do you need a public, private or hybrid cloud? Capacity, accessibility, automation are part of it but what workloads and related data will best live on a private storage cloud?• Matching requirements with existing technologies services and

vendors and wading through the marketing hype and weighing the tradeoffs• What can I reuse in my existing environment and should you build

a storage cloud based on SAN or NAS virtualization technologies and which deliver the lowest TCO and or ROI?


HP storage cloud design service

• Workshop and interview based data gathering sessions

• Customer driven reference architecture design

• Optional strategy session, cost benefit analysis (CBA)/return on investment (ROI) studies


The benefits our clients can expect

• Speed: HP starts with a clear industry position and drives a focused initiative for the client organization. We offer accelerated time to decision, supported by vendor-independent perspectives and key stakeholders involvement

• Cost: By facilitating key decisions in a compressed period of time, you save time and money. We leverage our intellectual property to keep your project costs down and shorten the time required to realize your return on investment

• Efficiency: By leveraging subject matter experts, your teams are integral to the process, yet do not have to “drop everything” to reach a high-quality project result

• Practicality: Our consulting engagements focus on facilitating actionable, high-value plans completely aligned to your critical success factors. You can start executing immediately through HP, yourself or even a third party

• Simplicity: Our approach means increased storage platform optimization. This translates into an increased number of supported platforms and downstream compatibility requirements plus simplified management


HP’s Storage Cloud Design Service is a 5-phase engagement with defined deliverables estimated over a 1--week project

Project Plan Overview includes 5 (five) phases Final Presentation Includes…

PHASE I – Project Initiation (Pre-Visit Activities) • Contact client to plan engagement and initial kickoff• Provide and receive pre-visit questionnaire and workshop planning template• Schedule project kickoff with customer• Complete workshop and kickoff presentation template including returned data from

questionnaire• Kickoff with client

• Executive summary• Project Participants (HP and client)• Current Environment Baseline• Client requirements and identified workloads• Future target storage macro and micro

architecture• Architectural Assumptions and Rules of thumb• Transition Plan• How HP can accelerate those next stepsPHASE II – Discovery

• Conduct planned workshops and interviews as required• Record initial findings and notes and share that draft with the client for validation

PHASE III – Architecture and Design• Build requirements with client• Review current environment for reusable hw and sw infrastructure.• Build the detailed target storage and backup environment while recording assumptions

that guided the development in the Architecture Diagram template

PHASE IV – Transition Planning• Complete transition plan• Complete Materials list

PHASE V - Presentation and Project Close• Present Client with completed Design for Private Storage Cloud Report • Deliver Final Executive presentation to client team • Complete project close activities with client and internal paperwork


Compare storage features across architecturesDescription

#1 X9000 ONLY Based

Virtualization Solution

#2 3PAR Only Virtualization

Solution

#3 X9000 File Sharing

Solution with Cloudpointe

#4 X9000 Storage Cloud

with Fluid-Ops

#5 Nirvanix with Block Storage

Cloud Type Private Private Hybrid Hybrid Hybrid

Service Type Self Self Managed/ Self Self Managed

HP block storage (3PAR, MSA, etc) Yes with X9 GW 3PAR Yes with X9 GW 3PAR, etc MSA, 3PAR, etc

HP file storage (X9000, etc) Yes No Yes Yes NoUltra scalable Capacity Yes - Yes Yes NoUltra scalable Performance Yes - Yes Yes NoLow cost per TB (No SAN, low admin) Yes No Yes Yes NoGlobal / single shared namespace Yes No Yes Yes NoAutomated policy based data movement and archiving Yes Yes Yes Yes NoStorage Network Supported LAN SAN LAN/ WAN LAN/ WAN LAN/ WANAccess to cloud or application based storage sharing (Amazon, Sharepoint, Dropbox, etc) No No Yes No No

Access to legacy file servers and NAS No No Yes Yes TBDAdvanced file sharing features: Maintain the latest file with no duplication, added encryption, read only, both inside and outside firewall as needed

No No Yes No No

Mobile File Viewer and Edit functionality No No Yes No NoMigration Friendly No No Yes No NoBranded content delivery No No Yes Yes TBDWeb portal Access Admin only Admin only Yes Yes YesStorage Capacity Reporting

No NoYes – minor

dev.Yes Yes

Self storage allocationNo No

Yes – minor dev.

Yes Yes

user alerting (running out of storage for ex.)No No

Yes – minor dev.

Yes TBD

Automated Storage DeallocationNo No

Yes – minor dev.

Yes TBD

Chargebacks/ ShowbacksNo No

Both – minor dev.

Both Both


For some, virtualized storage arrays – 3PAR• Usually reusing existing tier one (not low

cost storage)• Goal is to automate provisioning (not always

self service) and reduce allocation and rising administration costs• Positioned to be integrated with scale out

NAS or any of our cloud partners


HP 3PAR Utility StorageConverged Storage without Boundaries


Next-generation Tier 1 Utility Storage for IT-as-a-Service

HP 3PAR Utility Storage

BUILT for THE CLOUD One technology from midrange to high-

end

F-Class T-ClassV-Class

World record

performance

Efficient• Reduce acquisition and operational costs

by 50%

Autonomic• Increase storage management efficiency

10x

Multi-tenant and federated• Support unpredictable new apps and

cloud


HP 3PAR: Enterprise Storage Leader

Execution and vision leader

Fastest array in the world Best in class

Gartner Magic Quadrant for midrange and high-end modular arrays

SPC-1 benchmark leadership with HP P10000 3PAR

HP 3PAR F400 ranked Best in Class in DCIG 2012 Midrange Buyers Guide

0

5

10

15

20

25

30

0 50,000 100,000 150,000 200,000 250,000 300,000 350,000 400,000 450,000 500,000

Resp

onse

Tim

e (m

s)

SPC-1 IOPS TM

HP P10000 3PAR V800

HP 3PAR T800

HP 3PAR F400

IBM SVC (6 Node Cluster with 2x DS8700)

HDS USP-V

IBM DS8300 Turbo

IBM DS8700 Easy Tier with SSD

IBM StorewizeV7000

NetApp FAS3170

Pillar Axiom600 Series 3

EMC ClarrionCX3-40

HDS AMS 2500

Oracle Sun Storage 6780

HDS VSP


HP IBRIX X9000 Storage


IBRIX: modern architecture designed for storage cloud

X9730X9320 X9320

43.2 TBPerformance

192 TBCapacity

1.68 PBExtreme density

Existing FC / iSCSI Storage

Existing tapelibraries

X9730

Small fileRandom access

Large fileSequential access

X9300 X9300

Industry standard storage

NFS client

IBRIX client CIFS

client

An X9000 single namespace … grows up to 16 PB

SAN(FC/iSCSI)


Big Data requires big solution

IBRIX: Best-in-class scale-out NAS

• Simple− Single global namespace up to 16 PB’s with over 1000+

nodes− Centralized management by a single UI− Under 10 minutes install for X9320 and under 2 hours for

X9730• Efficient

− Policy-based data tiering matches infrastructure with business needs

− Automated load rebalancing optimize system resources and spread data evenly

− All inclusive software licenses without hidden costs• Adaptable

− Start small and grow on demands − Scale capacity and performance independently

IBRIX: Innovation Knows No Boundaries

Source: 2011 DCIG Enterprise Scale-out NAS Buying Guide

http://h18006.www1.hp.com/storage/pdfs/Excerpt-4AA3-7329ENW.pdf

http://h18006.www1.hp.com/storage/pdfs/Excerpt-4AA3-7329ENW.pdf


The IBRIX X9000 product family offers a complete storage solution (single global namespace) for your complex environmentX9300

NAS GatewayX9320

Simple NAS ApplianceX9730

Extreme Dense Storage

Flexible Optimized Massive

• Used with HP 3PAR, LeftHand, EVA, or third-party arrays

• Installed under 10 minutes!• SFF or LFF SAS drives.• Starts with 24 drives and

expand

• Up to 3X more powerful• Highly integrated and

dense• Up to 1.68PB

NEW!


CloudPointe Connect®


Four basic solution designs

CloudPointe is for clients who want full control over digital assets outside the enterprise

Single File, Secure Sharing Multi-File, Secure Collaboration

Workspace-Hub Combination Workspace-Hub Combination with Multi-Storage Variety

Workspace

Workspace

Hub

Workspace

Hub

ee

ee

cc

e


CloudPointe is fundamentally different. Many solutions store your files. CloudPointe does not.

Commercial cloud

Consumer storage

Virtual data rooms


CloudPointe’s SaaS Architecture supports ECM style cloud and Big Data requirements across large and small clients

CloudPointe Connect®

Acc

ess

Bro

keri

ng

Dig

ital Sig

natu

res

Transf

orm

ati

on

Managed F

ile

Transf

er

Expir

ati

on

Sin

gle

Sourc

e

Auth

enti

city

CloudPointe Portal Services (Hub)

CloudPointe Aggregation Services

Hadoop / Map Reduce

CloudPointe Connect API

Unstructured Content

SharePoint Box.net

WebDAV etc.

Hub Services API

Structured Content

Social Media Email etc.

File “Pointing” ECM Architecture

“Big Data” Architecture


CloudPointe Connect

CloudPointe Connect® and Hub® are middleware that connect to your client’s storage locations inside/outside the enterprise to any endpoint

FTP/SFTP

On-premise The cloud Endpoints

FusionDox

Insert your

service here

The Analysts are talking about FluidOps

http://www.cio.de/was_ist_cloud_computing/anbieter/2274043/index4.html

“Semantic wiki technology to annotate resources, establish relationships and add free-text documentation is offered by fluid”Gartner – Cameron Haight, David M. Coyle - The Use of Social IT Management Tools and Technologies for IT Operations Is Embryonic, but Growing

“... one company, fluidOps, is incorporating some of this technology in its eCloudManager product, and other vendors may follow”Gartner – Cameron Haight – Collaborative Operations Management

Experton Group – Steve Janata – Cloud Vendor Benchmark 2011“Users should pay special attention to the cloud management product family of Fluid Operations AG, … is among the most interesting cloud management platform technologies in the market.”

“There is currently no other direct competition”Gartner – Cameron Haight, Thomas Otter / Research VPs – Gartner Cool Vendors in the SAP Ecosystem 2010, G00175172

“In cooperation with fluid Operations, T-System was able to show a dynamic provisioning of SAP Systems in a elasticity that is hardly found elsewhereForrester – Stefan Ried, Senior Analyst --CeBit 2010 Enterprise Trends (http://blogs.forrester.com/stefan_ried/10-03-08-cebit_2010_enterprise_trends)

“That elevates fluidOps from an application-aware infrastructure manager (although it's certainly that) to a true cloud-enablement player”451 Group – Rachel Chalmers – fluidOps Emerges as Full-Fledged IaaS-Enablement Play



http://blogs.forrester.com/stefan_ried/10-03-08-cebit_2010_enterprise_trends


Platform

Self-service

Enterprise applications

Data cloud

Cloudmanagemen

t

eCloudManager is a modular platform with storage and data as a service as one of the tools we will use in Storage Cloud Design• Application Monitoring

• Application Provisioning

• Application Integration

• Landscape as a Service™

• Storage as a Service

• Data as a Service

• Linked data-based Integration

• Anlytics and reporting

• User management

• Quotas / reservations

• Easy Self-Service Access (also for non-technical users)

• Infrastructure as a Service

• Platform as a Service

• Blade as a Service ™

• Infrastructure management

• Monitoring

• Storage provisioning

• Policy engine / notifications

• KPI and SLA monitoring

• One central platform

• Multi-tenancy

• Use of Semantic Technologies

• Metadata management / RDF as basis


eCloudManager leverages existing virtualizations layers, enabling clients to evolve their infrastructure into a cloud management platform

Server Farm

Tranditional Adaptive Computing Virtualization Virtual Landscape Private Cloud Cloud Computing Management

2002 2012

Goal: IT Infrastructure as a Service

• Low cost• High performance• High flexibility• Controlled usage

of public clouds• Budget/Cost control

U

nix

/ L

inux /

W

ind

ow

s

Over commitmentHardware

• n Systems / Instancesper Plattform

Blade TechnologyStorage Technology

• Complex• Limited

Virtual MachineHypervisor

• Flexible Usage• Volume / Perfor-

mance limited• High manual Effort

Application Mgt.Automation

Automated and dynamic• Software as a Service• Platform as a Service• Infrastructure as a Service

Everything as a Service Intra Company

• Service Portal• Billing• Monitoring

Cloud • Hybrid of Private & Public

• Service provider & in-house

eCloudManager leverages existing virtualization layers


With eCloudManager, everything and certainly storage as a service can help clients achieve cost reduction goals and improve process enabling self serviceWhat we knew so far...... is virtualization• HW is abstracted

• Server/Storage tasks got easier

• Operations, processess still the same – Same Cost,

• Tending to higher Cost

eCloudManager• Everything as a Service

• Whole Stack leveraged

• Automated processess

• Self Service Era

• Reduced operations, processes

Own Virtualization Layer

VMA

Virtualization ManagementBusiness & operations self-

service

ITaaS management layer

AVMAny virtualization

layer VDesktop

A


Self service is the final path to a cloud and can be made available to all users across the enterpriseClouds are achieved from the moment an end user has a agile Self-Service experience:• eCloudManager offers a “N-tiered”

Self-Service Portal• End-User consumes Storage

Services ad-hoc regardless who provides it

• Enterprises save money – End Users are positioned to select an SLA with the right cost/performance based on their budget constraints

Atmos

REST + POX API

REST, SOAP, SMTP,SMI-S,RFC

STaaS 3STaaS 2STaaS 1

X90003PAR...

SalesIndividual

SalesEMEA

SalesWW

LocalDC

CentralDC


The Nirvanix Storage Cloud


Nirvanix Cloud Storage Services leveraging HP Converged InfrastructureNirvanix Cloud Storage Node is comprised of:Software:• Nirvanix Cloud File System™

− Multi-tenant directory structure− Single massive geo-diverse namespace

• Policy-based replication; Metadata tags; ReportingHardware:• HP High-Density Storage Arrays (MDS, 3PAR, EVA, LeftHand)• HP Management Servers & Controllers (DL, BladeSystem)• HP 1 or 10 GE Networking Equipment • All fully managed as a service


Extending the Data Center

Customer NAS Offloads

Storage for Fixed Content Clouds

Storage for Compute Clouds

Storage for Archiving

Nirvanix provides clients with solutions to address key cloud storage opportunities


Nirvanix key differentiators

Software:• Self-Healing Cloud—continuous data integrity• Global Namespace—upload once, access anywhere• Data Consistency—change once, available everywhere• Highly Granular Multi-Tenancy—millions of sub-domains within a single storage pool• Self Provisioning—customers can provision their own data from a dedicated, intuitive

management console• End-to-End Network Visibility & Management—from gateway to cloud• Military-Grade Security—unparalleled security safeguards and processes at the user, data

storage and physical data center levels

Services:• Flexible Storage Locations—you choose where & when• Enterprise SLAs—5 nines, not 3 or 4 nines or best efforts• Data Center Inspections—third party audits are encouraged


• The Nirvanix Cloud Storage Network • A Cluster of 8 Global Interconnected Nodes• One Global Namespace managing PBs of Enterprise-Class Customer Capacity• Extreme Levels of Availability, Scalability & Redundancy• Designed for Millions of Users, Billions of Objects

• A Hybrid, Federated Cloud• Private Node of Cloud Storage on your Premises• PLUS the Ability to Support Cloudbursting during Peak Times

−Access the Nirvanix Public Cloud for Additional Capacity and Bandwidth • Unavailable from anyone else• All Managed as a Service• A Single Monthly Bill, Like a Utility Service

• A Private Node of Enterprise Storage Capacity• Located inside your Private Data Center• Fully Managed as a Service by Nirvanix• Enables companies to comply with the most stringent corporate or legal data retention policies

by storing data within their own facility• Supports the addition of nodes in any other of the organization’s data center locations all

under a single namespace

The Nirvanix Public Cloud


Thank you

Jeremiah Loscalzo - TB3011 - Designing a storage cloud

Technology

Transcript of Jeremiah Loscalzo - TB3011 - Designing a storage cloud