EMC Software Defined Storage · PDF fileProfile Defined in ViPR. Delivered by VMAX. and...

1© Copyright 2014 EMC Corporation. All rights reserved.© Copyright 2014 EMC Corporation. All rights reserved.

EMC Software Defined StoragePrashant Maiti


Today’s Storage Infrastructure

BLOCK FILE FILE BLOCK FILE OBJECT HDFS


BLOCK FILE FILE BLOCK FILE OBJECT HDFS

# ./symdev -sid 78 list –noport# ./symconfigure -sid 78 list -freespace -units CYLINDER# ./symdisk -sid 78 list -by_diskgroup#./symconfigure -sid 78 -cmd "create devcount=1,size=18414,emulation=FBA,config=RAID-5,data_member_count=7,disk_group=1;" prepare

# disk assign lun3 -p0# disk assign lun3 -p1# disk assign lun4 -p0# disk assign lun4 –p1# aggr create siteAaggr -m -d lun1 lun2# aggr create sitebaggr -m -d lun3 lun4

# naviseccli –h 1.2.3.4 - user < > -password < > -scope 0 connection –addset -name mv_iscsi_connection_to_456# naviseccli –h 1.2.3.4 - user < > -password < > -scope 0 connection –addpath –name mv_iscsi_connection_to_456 –target <MirrorView iSCSI port IP address on target SP-a> –sp a –portid < MV ISCSI port ID on 123 array’s SPA>

# fdisk /dev/sdc# fdisk /dev/sdd# mdadm --zero-superblock /dev/sdc /dev/sdd# mdadm --create /dev/md0 --level=1 --raid-devices=2 /dev/sdc1 /dev/sdd1# mkfs.ext3 /dev/md0# mkdir /raid1# mount /dev/md0 /raid1

#create enhancedGlobalMirrorGroupuserLabel="enhancedGlobalMirrorGroupName"(remoteStoragesubsystemName="storagesubsystemName" | remoteStoragesubsystemWwn="wwID")interfaceType=(FC | iSCSI)[remotePassword="password"syncInterval=integer (minutes | hours | days)warningSyncThreshold=integer (minutes | hou)

# objectcfg volume geo-replication datastoreremote.emc.net:/object/geo-replication config remote-syncd/usr/lib/object/syncd# objectcfg volume geo-replication datastoreremote.emc.net:/object/geo-replication/ start# objectcfg volume geo-replication datastoreremote.emc.net:/object/geo-replication/ status

# ./hadoop fs -mkdir /user/hadoop/dir1 /user/hadoop/dir2# ./hadoop fs -mkdirhdfs://nn1.example.com/user/hadoop/dir hdfs://nn2.example.com/user/hadoop/dir# ./hadoop fs -put localfile/user/hadoop/hadoopfile# ./hadoop fs -put localfile1 localfile2 /user/hadoop/hadoopdir# ./hadoop fs -get /user/hadoop/file localfile

Today’s Storage Infrastructure


NEW PLATFORMS & APPROACHES

END USER DEMAND FOR CLOUD

IT’S ONLY GOING TO GET

MASSIVE DATA GROWTH

WORSE


How Do WeSolvefor This?


Help MeReduceCosts

Give Me Freedom of

Choice

I Want a Path to the

Cloud


Build A ModernHyperScale

Storage InfrastructureUsing Commodity

Platforms.


Deliver Storage On Commodity Platforms with ViPR

CommodityPlatforms

ViPRServices BLOCK

STORAGEHDFS

STORAGEOBJECT

STORAGE


Make Storage Management Simple

CommodityPlatforms

ViPRServices BLOCK

STORAGEHDFS

STORAGEOBJECT

STORAGE

ViPRController Self

ServicePolicy-basedAutomation

SingleAPI

Reporting &Chargeback


Managing more thanone array?

ViPR can automate yourentire storage infrastructure

reducing management timeby up to 80%.


One Software Platform to Unite All Storage

ViPRController

Array Support through OpenStackNative Support

VNX IsilonVMAX VBLOCK

ORACLEZFS

NetAppE-Series Solidfire

DellEqual-Logic

HP 3PAR HPLeft-Hand

IBMXIV

IBMSVC

IBMDS8000

HitachiVSP

(Block)

HitachiHUS VM

NetAppFAS

ECSHP SL4540


Reduces Provisioning Time to SecondsAdministrators can focus on value-driven activities

<60 seconds: discovery and ingestion of storage 5 Clicks: Self-Service Provisioning (all storage) 63%: Average reduction in time for an administrator to

provision storage 74%: VNX Block, 48.4%: VNX File 86.5%: VMAX Block 60.5%: Isilon File 45.6%: NetApp File

Based on third-party lab testing

“Reduces the risk of human error and the need for

lengthy management reviews and can make your

organization more nimble” –Principled Technologies

Realizing Software-Defined Storage with EMC ViPR, Principled Technologies, 2014


Easily ManageYour Entire

StorageEnvironment.


Self-Service Access to Storage


Storage Federation for Automating Provisioning

Profile Defined in ViPR Delivered by VMAXand Connectrix

Automated by ViPR

• Resource allocation• Performance settings

LowVolumeCONNECTRIX

VMAX

Service Catalog

HIGH

LOW

WEB-BASED

MEDIUM

LOW

ApplicationOwner

Performance: 0.5 IOPS/GB

Availability: Over Five 9s

RTO/RPO: 1hr/6hr; CDP = NO

SAP TEST & DEV.


• D@RE• High

Performance • FAST• Host I/O

Limits• Over 5 9’s


Automating Move to ProductionDelivered by VMAX

Automated by ViPR

Sets New:• Resource allocation• Performance settings

LowVolume

MediumVolume

CONNECTRIX

VMAX

Profile Defined in ViPR

HIGH

LOW

WEB-BASED

MEDIUM

LOW

Service CatalogApplication

Owner

MEDIUM


Availability: Over Five 9s

RTO/RPO: 1hr/6hr; CDP = NO

SAP TEST & DEV.Performance: 1.0 IOPS/GB

Availability: Continuous

RTO/RPO: 0/0; CDP = YES

SAP PRODUCTION


• D@RE• High

Performance • FAST• Host I/O

Limits• Over 5 9’s


||

||

||

||

||

||

||

||

||

||

||

||

||

||

||

Automating Availability with VPLEXProfile Defined in ViPR

Automated by ViPRMediumVolume

MediumVolume

Medium DistributedVirtual Volume

MirroredPair

Site 1 Site 2

Delivered by VPLEX• Continuous availability• Non-disruptive mobility

VMAX to VMAX, or VNX, or 3rd Party Arrays

HIGH

LOW

WEB-BASED

MEDIUMMEDIUM




SAP PRODUCTION


Service CatalogApplication

Owner




EXCHANGE PRODUCTION



EMC is bringingHYPERSCALE

CAPABILITIESto everyone.and ECONOMICS


State-of-the-Art Object Storage

Built for HyperScale

Cloud-in-a-box (Object, Block & HDFS)

9%-28% Cheaper Than Public Cloud

Self-Service Provisioning

Industry’s Most Cost-Effective HDFS

Platform

ViPR Now Available As An Appliance


Geo-Replicated Data ProtectionProtection against local and global failures

Site 1

Site 3

Site 2

• Handles local hardware and full data center failures

– Disk, Node, Rack, Data Center are failure domains

• Local hardware failure recovery requires no WAN traffic

• New Hybrid encoding approach enables low storage overhead


Storage Overhead

1,33

2,67

2,001,771,67 1,601,551,52

0,000,501,001,502,002,503,00

1 2 3 4 5 6 7 8

Overhead

# of Data Centers

Optimized data access, protection and efficiency


Active-Active Read/Write ArchitectureAnywhere access to content

https://accesspoint.yourcompany.com • Single global namespace across data centers

• Strong consistency across data centers

• Optimized for minimal WAN round trips by sensing access patterns across data centers on individual entities


Comprehensive Data Access

• Simultaneous access to underlying data through multiple interfaces

– Object, HDFS , File (Future)

• HDFS compatible with Cloudera, Hortonworks, Pivotal etc.

• Support for S3, Swift, Atmos and Centera CAS APIs object

• Extensions to APIs– Byte-Range updates, Atomic appends, Rich

ACLs etc.

Compatibility with common industry APIs

HDFS


2.9PB1.4PB360TB

Three Object/HDFS Configurations


Need to have more visibility into both their traditional and

software-defined environments?

ViPR & ViPR SRM does it.


Centralizes Storage ManagementA Simple Way to Manage Mixed Storage Environments

• ViPR Monitoring and Reporting– Capacity reporting for ViPR virtual

resources– Discovers physical arrays and available

capacity to support provisioning capacity to ViPR

• ViPR SRM– Enables management of physical

infrastructure under ViPR control– Tracks use of capacity on physical arrays

to support purchasing processes– Enables SLA management for traditional

and ViPR software-defined storage


The STRONGESTSoftware-Defined Storage portfolio

in the industryjust got STRONGER.


ViPR Controller/SRM Use CasesStorage Automation Storage-as-a-Service

Multi-tenancy Metering & Chargeback

Self-service access to all

storage

Universal API & Protocol support

< 60 seconds

Storage discovery and

ingestion 5 Clicks

Automated storage provisioning

63%Average reduction

in provisioning times

VNX Isilon XIO3rd Party

VMAX

Commodity Platforms


Global Content RepositoryState-of-the-art on-premise unstructured storage platform

PROBLEM• Can’t cost-effectively manage or scale storage to

support explosive growth in unstructured content.• Traditional storage not suited for new Web, mobile

and cloud applications.• Difficult and costly to manage data lifecycle and

retention policies across archive silos and sites

SOLUTIONEMC ECS Appliance (Object, HDFS, Block)

VALUE• Reduce complexity and cost–one globally

accessible, geo-efficient archive that serves multiple applications and content types at lower cost than public cloud.

• Anywhere data access – All data globally accessible by Web, mobile and cloud apps.

• Enterprise-grade data protection – Efficient geo-protection and policy-based retention for basic compliance and governance.

https://accesspoint.yourcompany.com

U.K.L.A.

Memphis

Applications Tiering, Archiving, Backup


Geo-Scale Big Data AnalyticsEfficient Geo-capable Storage & Global Big Data Analytics

https://accesspoint.yourcompany.com

U.K.L.A.

New York

ANALYTICS

PROBLEM• Large (and growing) data volumes lead to

exponential storage costs• Traditional Hadoop replication leads to

unmanageable DC footprint with data growth• Always have to move data to the analytics cluster

SOLUTIONEMC ECS Appliance (Object, HDFS, Block)

VALUE• Cost Efficient Storage – ECS is 28% cheaper

than even public cloud • HDFS Archive – ECS brings state of the art

patented technology to provide highly dense storage for Hadoop

• Global Analytics –Bring analytics to geo-distributed data and archives

EMC Software Defined Storage · PDF fileProfile Defined in ViPR. Delivered by VMAX. and...

Documents

Transcript of EMC Software Defined Storage · PDF fileProfile Defined in ViPR. Delivered by VMAX. and...