NAS Meets SAN - An Introduction to Unified Storage

1© Copyright 2010 EMC Corporation. All rights reserved.

NAS Meets SANAn Introduction to Unified Storage

Rob Hazen

EMC Unified Storage Division

Brian Boyd

Duke University

Office of Information Technology


EMC makes no representation and undertakes no obligations with regard to product planning information, anticipated product characteristics, performance specifications, or anticipated release dates (collectively, ―Roadmap Information‖).

Roadmap Information is provided by EMC as an accommodation to the recipient solely for purposes of discussion and without intending to be bound thereby.

Roadmap information is EMC Restricted Confidential and is provided under the terms, conditions and restrictions defined in the EMC Non-Disclosure Agreement in place with your organization.

Roadmap Information Disclaimer


Your Data Center Today

Users

SQL

Oracle

Exchange

CIFS

NFS

iSCSI

CIFS

NFS

iSCSI

CIFS

NFS

iSCSI

SQL

SAN

Multiple protocols

Inefficient backup

No disaster recovery

Difficult to scale

High management costs

Server sprawl

Out of power

Out of space

Underutilized direct-attached storage


Multiple protocols

Inefficient backup


Difficult to scale


Server sprawl

Out of power

Out of space


Solution: Consolidate Your Data

Users

SQL

Oracle

Exchange

SQL

Centralized Storage


Multiple protocols

Inefficient backup


Difficult to scale


Server sprawl

Out of power

Out of space


Solution: Virtualize Your Servers

Users

SQL

Oracle

Exchange

SQL

Centralized Storage


Which Protocol?

So…they want me to consolidate my storage infrastructure

How do I do that?Do I use…

NAS (Network Attached Storage)?

iSCSI (SCSI over IP)?

SAN (Storage Attached Network)?

How do I choose?

Block File FC IP

NAS

iSCSI

SAN

Data Type Transport


Which Protocol?


How do I do that?Do I use…

NAS (Network Attached Storage)?

iSCSI (SCSI over IP)?

SAN (Storage Attached Network)?

How do I choose?

Block File FC IP

NAS

iSCSI

SAN

Data Type Transport

Wrong Question!


The REAL Questions


Think about the right questions…

How do I

Drive down costs?

Increase storage efficiency?

Guarantee compliance?

Provide data protection?

Protect my investment?

Deliver reliable service?


Agenda – How do I…

Drive down costs Storage Consolidation

Multi-Protocol Connectivity

Increase storage efficiency

Deduplication

Storage Tiering

Virtual Provisioning

Guarantee compliance File-Level Compliance

Provide data protection File-Level Restore

Backup and Replication

Celerra Unified StorageInsure investment protection

and uptime reliability


Drive Down Costs…

Users

SQL

Oracle

Exchange

CIFS

NFS

iSCSI

CIFS

NFS

iSCSI

CIFS

NFS

iSCSI

SQL

SAN

Consolidating storage to a Celerra

Unified Storage Platform

ENABLES Operational Savings

and Improved Management


Increase Storage Efficiency… Consolidation

Consolidate storage to Celerra Unified Storage

Reduce physical server count with virtualization

Supports NFS/CIFS and iSCSI

Simplified manageability

Increased availability

Add Fibre Channel as needed

SQL

Oracle

VMware

SQL

Oracle

Exchange

Users

Celerra

http://www.emc.com/products/detail/hardware/celerra-ns-g8.htm


Celerra Innovations

Unified storageCost-effective NAS and iSCSI

and high-performance Multi-Path File System

and Fibre Channel

Fully Automated Storage Tiering (FAST)

Tier data according to business value

Simplified setup and provisioning

Celerra Startup Assistant and Celerra Provisioning

Wizard

DeduplicationFile system deduplication with compression reduces

capacity requirements by up to 50%

Advanced functionality at no extra costDeduplication, Virtual

Provisioning, snaps, and Automated Volume Manager

included at no additional cost

ComplianceCompliant file-level

retention (WORM) for archiving

Flash drives

Tier 0 storage with up to 30 times more IOPS

Virtual infrastructure

Common infrastructure for virtual and physical

applications


Celerra Architecture: Unified Storage

DART Operating System– Common across all Celerra platforms

– Hardware independent

– Managed through Celerra Manager

GUI or CLI

N+1

Data Movers

―X-Blades‖

N+1

Data Movers

―X-Blades‖

N+1

Data Movers

―X-Blades‖

10/100/1000

Ethernet

1/10 GigE

Scalable Disk Array

Enclosures

DART OS

N+1 X-Blades– Support NFS, CIFS, iSCSI

Dual Storage Processors (SP)– Automatic failover

– CLARiiON FLARE technology

– Fiber Channel option available

through CLARiiON

SP B

SP A

Flare

Embedded CLARiiON

Block Storage– iSCSI

– Fibre Channel

Celerra and CLARiiON best in class functionality in one easy platform


Increase Storage Efficiency

Pressure to Store File Data More Efficiently

Data growth is exploding, primarily due to the growth of unstructured data

Having multiple copies of data is desirable and widely considered responsible

What about all of these files?

Users and apps demand more storage!

Sub-optimal storage utilization

Users request dedicated storage but have low utilization rates

Storage over allocated to applications to insure future growth

Difficult to manage storage capacity planning

However…

Having an unnecessarily large number of copies of data is wasteful and irresponsible

Lowering infrastructure costs is a necessity

Data DeDuplication


Tiered Storage


Celerra Unified Storage Efficiency

Virtual Provisioning– Request based on project expectations

– Consume storage as the project rolls out

– If Project doesn‘t meet expectations - space available for the next project

Online file system expansion– If Project exceeds expectations – increase space online

without disruption

– Invisible to VMware ESX operations

Celerra Virtual Provisioning

Built-in thin provisioning

Proj B4 TB

Proj A5 TB

Proj C6 TB

Logical application and user view

Physical allocation

4 TB

2 TB2 TB

Physical consumed storage

Celerra Data Deduplication

Up to 50% savings

File-level deduplication and compression

~ 5 TB

File data

Active

1 TB10 TB

Compress &deduplicate

Inactive

Deduplication/compression– Reduce the space consumed by files up to 50%

– Inactive data managed by policies

– Active data managed by users

– Intelligent, tunable, simple, fully integrated

Celerra Plug-in for VMware– VMware Administrator controls storage provisioning and

efficiency management


Celerra Deduplication Calculator

Easy-to-Use Celerra Deduplication Calculator

1. Enter data size

2. Enter growth rate

3. Enter storage cost

4. Click ―Calculate‖

5. Discover projected space and cost savings

Celerra Inactive File-Level Deduplication plus Compression

Allows up to 50% storage savings for typical office files

Intelligent file selection means low impact to users with flexibility to tune for specific environments


FAST – Fully Automated Storage Tiering

Celerra

FAST

…at the right timeGet the right data to the right tier…

Create policy

Define rules

Save and enact policy

SATA

FibreChannel

Flash

…automatically


Celerra FAST Deployment Options

Within the Celerra

Celerra

EMC File Management Appliance/VE

Flash

Fibre Channel

SATA

Extending outside the Celerra

Celerra

Centera

Atmos

Celerra

EMC FileManagement

Appliance

Flash

Fibre Channel

SATA

SATA

SATA


LUN 3

LUN 2

LUN 1

FAST – Sub LUN Enhancement

Tier 2

Tier 1

Pool

Before After

Tier 0

Most Activity

Neutral Activity

Least Activity

Available to hosts using block

access

More Granular: Extends FAST to

sub-LUN blocks (1 GB)

More Automated: moves hot or

cold blocks with increased

automation

Enables customers to optimize

their mix of SATA, FC, and EFD

drives… maximizing for both cost

and performance

Available

Soon


Guarantee Compliance…

Use Celerra File Level Retention

Capabilities to enforce governance

policies that limit write access

Compliance Challenges

Securities and Exchange Commission (SEC) Rule 17a-4(f) stipulates requirements to regulate the storage, retrieval, and management of electronic records by members, brokers, or dealers

Business Challenges

Business best practices require that data be retained for certain time periods

Business must preserve information for product lifetime and as a hedge against litigation


Celerra File-Level Retention Options

Compliance (FLR-C) Option

Meets SEC Rule 17a-4(f) requirements

Prevents file system deletions with locked files

―Hard‖ default retention periods

Write-verify to validate committed content

Retention periods cannot be modified, files and file systems cannot be deleted

Tamper-proof clock cannot be modified

Third-party compliance validation

Enterprise (FLR-E) Option

Enables adherence to organizational policy

Provides for retention periods per file, modifiable by authorized users

File systems may be deleted


Provide Data Protection…

Protect data against loss

Single file undelete

Loss of file system

Disaster scenarios

Provide data backup and recovery solutions

Celerra offers a wide range of solutions for

protecting and recovering data: Snaps,

Replication, Backup


Celerra Snaps

Provides a read-only or read-write, point-in-time view of file data

Backup the snap not the source

Recover data without administrator

Productionfile system

Logicalpoint-in-time

copy

Celerra UnifiedStorage

R/Osnap

R/Wsnap

Logical writeable

copy

Writable Snaps allow read/write access based on previous checkpoint

– Does not change production file system

– Does not change previous snap

– Changed blocks written to snap save area

Writable Snap Benefits– Adds write capabilities to both local and

remote snaps

– Creates test environments for databases

– After testing, changes can be applied to the production file system


Celerra Replication – CIFS, NFS, iSCSI

Flexible– Local or remote replication

– Application-consistent replication

– Copy can be read only or read/write

– Changes can be incrementally reapplied to the primary on failback

Application consistent replication– Via Replication Manager

– Celerra Virtual Data Mover (VDM) maintains context with CIFS data

Highly Scalable– Up to 1,024 replication sessions

– 1-to-N replication for data distribution

– Cascading Replication for multi-site disaster recovery

Point-in-Time Asynchronous File System and iSCSI LUN Replication

Fully Automated– Recovery Point Objective (RPO)

– Quality of Service

Efficient– Production data always available

– Send only changes


Celerra with VMware for Disaster Recovery

Celerra and VMware vCenter Site Recovery Manager Integration

Celerra Replicator controlled by vCenter Site Recovery Manager

Define Celerra and VMware business continuity/disaster recovery workflows for discovery, testing, and failover

Celerra-specific VMware vCenter Server plug-in simplifies the failback process

Benefits

Simplifies and automates disaster recovery

Makes disaster recovery a property of the virtual machine

Provides central management of recovery plans from VMware vCenter Server

Turns manual recovery processes into automated recovery plans

Makes disaster recovery rapid, reliable, manageable, affordable

Production

ESX servers

Recovery

Celerra Replicator

Celerra Celerra

vCenter Site Recovery Manager

failback

ESX Servers ESX serversESX Servers


Tape-Based Backup and Restore Options

Network Backup

Most backup utilities

NFS/CIFS mounts over the client network or separate sub-network

Network

Data

CelerraUnifiedStorage

Tape/disk

library

Backupserver

NDMP Backup(LAN-less local backup)

EMC NetWorker, Symantec NetBackup, CommVault Galaxy, HP OpenView, Atempo Time Navigator, IBM Tivoli Storage Mgr, ++

Data

Backupserver

CelerraUnifiedStorage

Tape/disk

library

Network

SAN Backup(LAN-less and serverless)

Most backup utilities

Backup with Celerra MPFS

Fast and efficient

SymmetrixTapeBackup

server

CelerraGateway

Data

Network


Are we done?


• Celerra Unified StorageInvestment protection and

reliability

Investment protection and

reliability

Agenda - Recap

Driving down costs Storage Consolidation Multi-Protocol Connectivity

Guarantee compliance File Level Compliance

Data protection File level restore



Deduplication

Storage Tiering


Driving down costsStorage ConsolidationMulti-Protocol Connectivity


Deduplication

Storage Tiering


Guarantee compliance File-Level Compliance

Data protectionFile-Level restore


Celerra Unified StorageInvestment protection and

reliability

Investment protection and

reliability


Why EMC Celerra

No-compromise availability– Designed to deliver Five 9s (99.999%)

availability with advanced failover

Comprehensive unified storage – NAS, iSCSI, Fibre Channel, and patented

Celerra Multi-Path File System (MPFS)

Scalability leadership– Up to eight X-Blades on the front end; up to

four arrays on the back end

– Native Fibre Channel connectivity for most demanding performance requirements

– Flash drives for I/O-intensive applications

Automated tiering for unified storage– Fully Automated Storage Tiering (FAST)

automatically moves data to the optimal storage type based on activity

– Reduce file system capacity requirements up to 50% through Data Deduplication and compression

#1 in NAS (IDC, Q4 2009)

CELERRAThe Industry-Leading

Unified Storage Platform


Celerra Ease-of-Use Capabilities

Celerra Monitoring

At-a-glance system status

Automated Volume Management

Provision file systems in four clicks

Celerra Manager

Intuitive Web-based management

Celerra SnapSure

Simple snaps

Celerra StartupAssistant

Installation15 minutes power-up to production

Celerra Virtual Provisioning

Built-in thin provisioning

User B10 GB

User A10 GB

User C10 GB

Logical application and user view

Physical allocation

4 GB

2 GB2 GB

Physical consumed storage

= No charge


Celerra Built-in Advanced Functionality

= No charge

Multi-Path File System

Celerra Data Deduplication

Up to 50%savings

File-level deduplication and compression

Compressand dedupe

~ 500 GB

File data

Active Inactive

1 TB

Celerra Replicator

Simple business rule RPO

Production Local Site Remote Site

10-minute RPO 2-hour RPO

LAN WAN

Network

Snaps

FS/LUN

Network

Snaps

FS/LUN

Network

Snaps

FS/LUN

File-Level Retention

Write Once-Read Many (WORM)

Celerra Event Enabler

Integration with third-party anti-virus and quota management vendors

Anti-virus/QMserverUser

Celerra

Improved performance and scalabilityNS

Application

servers

Fibre

Channel

or iSCSI

IP

NAS

request

SAN

Delivery

Celerra FAST

Integration with Rainfinity File Management Appliance to provide FAST

File Management Appliance

Policy Engine


Unisphere: Simple, Consolidated Management

Single ‗pane of glass‘ Unifying Navisphere and Celerra Manager

Simple, Easy, Comprehensive

Application Centric provisioning

Automated Best Practices

Integrated Service & Support

Supports CLARiiON and Celerra systems

Available

Soon


EMC Celerra Plug-in for VMware

Provisioning– Automatically mounts created NFS FS to

ESX servers and clusters

– Automatically employ VMware and EMC best practices —ESX and Celerra (including Virtual Provisioning)

– Enlarge file system

Virtual machine cloning– FullClone (copy), FastClone (snap)

Virtual machine storage optimization

– Reduce the storage space for VMs through Celerra Data Deduplication

– Operate on host, cluster, data center, folder, or data store

– Uncompress VMs on demand

NFS data store management for the VMware Administrator

Celerra

vCenter Plug-in


Customer Deployment: Duke University

Brian BoydSenior Storage Network Administrator

Office of Information Technology

Duke University


Customer Deployment: Duke University Video


Duke University –Questions/Problems

Backups? What’s that?

Why can’t I go to Best Buy and buy 2 Terabytes for $199?

Hurricanes? Why should I be concerned with that?

What does this big red button in the datacenter do?

My desktop is just fine for storing things

I have 4 years of research data on my thumbdrive –

and now it’s not working anymore!

My laptop got lost/stolen/broken!


Duke University - Before

Decentralized Architecture

Several arrays, unique configurations, purposes

Service levels not defined, difficult to provision

Backup was fragmented

Growth Drove Purchases and consolidation

NAS & SATA requirements demand capacity

New Exchange requirements

Explosive Vmware growth

Storage growth overrunning departmental IT

EMC

CX3-80

Bronze Storage

Vendor

Array #1

Fuqua Replication

AIX admin

Other apps

Fibre Channel Disk

35 TB

SAN

Sun Mail Only

Fibre Channel Disk

35 TB

SAN

EMC

CX3-40

Bronze Storage Fuqua Replication

AIX admin

Other apps

SATA Disk

35 TB

SANVendor

Array #2

Silver Storage

AFS

Dcal

Novell

Other apps

Fibre Channel Disk

70 TB

SAN


Duke University – Solution Considerations

Standard Service Offerings

Standard Operating Systems

Standard Patch levels

Industry standard applications

Standard VMWare sizing

Standard Storage Hardware

Standard Storage Tiers

Standard Replication strategies

Standard Hardware

Use of best practices for

configuration of storage needs

Anticipated Benefits

Faster response to requests

Lower cost of administration

Better storage utilization

Faster provisioning


Duke University – Service Levels: Tier 1

Essential (tier 1) Structured Data (High end Databases, Business systems)

Mission critical to the operation of the University

Medical paging systems, Alert communications

High speed disk, failover capabilities with synchronous replication

Two Tiers – 1 (Essential) and 2 (Critical, Sensitive, Tolerant)


Duke University – Service Levels: Tier 2

Tolerant (tier 2 bronze) Fileshare systems

Typically on normal speed SATA disk.

Departmental storage

Lecture, Media capture and longer term archival

Sensitive (tier 2 silver) Course file storage

Student Email

General application storage

Not replicated but backed up via enterprise backup infrastructure

Critical (tier 2 gold) Learning & Identity management Systems

Microsoft Exchange Email, Security Video Feeds

Host application or array replication, not necessarily synchronous failover

Backed up via offsite tape for DR purposes

High speed FC disks


Duke University - Today

EMC NS-480

(150 TB FC/SATA)EMC NS-480

(105 TB FC/SATA)

EMC

MirrorView

- Gold/Silver/Bronze (Exchange,

VMWare, Lecture Capture,

Blackboard, SISS, etc.)

- Location: Datcenter A and B

- Drives: Fiber Channel & SATA

- Access SAN or NAS

- Expandable: Yes

Vendor Array #1

(35 TB FC)

- Currently Student Mail Only

-Drives: Fiber Channel

- Expandable: No

- Access: SAN only

- Standard Silver Storage

-(Legacy Applications)

-Drives: Fiber Channel

- Expandable: No

- Access SAN onlyVendor Array #2

(70 TB FC)

Tier 2 consolidation efforts• Departmental Storage – Primarily NAS/SATA

• Media Capture – Primarily NAS/SATA

• Microsoft Exchange – Primarily FC

• Vmware – 75% SATA/ 25% FC

• Replication – Standard Mirrorview or Host based

replication

• Most unstructured data now on unified platform with

standard offerings enabling flexibility and ease of

support


Duke University –Celerra Unified Storage Examples

Archive

Doc1Doc3 Doc1Doc3

Doc2PPT1 Doc2PPT1

Doc1Doc3 Doc1Doc3

Doc2PPT1 Doc2PPT1

NFS

FCCIFS

LAN

SAN

Celerra Unified

FTP

Consolidated servers and storage

Integrated VMware environment

Protected data

Increased efficiency

http://images.search.yahoo.com/search/images/view?back=http://images.search.yahoo.com/search/images?p=facebook&ei=UTF-8&fr=yfp-t-471&x=wrt&js=1&ni=18&w=225&h=268&imgurl=de.theinquirer.net/INQ_Facebook.jpg&rurl=http://de.theinquirer.net/2006/09/06/bei_facebook_braut_sich_was_zu.html&size=66.1kB&name=INQ_Facebook.jpg&p=facebook&type=jpeg&no=2&tt=185,219&oid=5626037df06711a0&ei=UTF-8

http://images.google.com/url?q=http://www.nurturingnetwork.org/images/collage.jpg&usg=AFQjCNGzU47VTwBqdsdy4dGm7Xt13moDRA

http://images.google.com/imgres?imgurl=http://tech.t2.com/wp-content/uploads/2007/05/streets.jpg&imgrefurl=http://www.t2.com/blog/2007/05/google-maps-street-view-doesnt-work-not-in-the-usa-answer-here/&h=370&w=450&sz=71&hl=en&start=22&tbnid=fP6wycnoLOQoOM:&tbnh=104&tbnw=127&prev=/images?q=maps+google&start=20&gbv=2&ndsp=20&hl=en&sa=N


EMC

MirrorView

Duke University – Future

EMC NS-480

(110 TB FC/SATA)

EMC NS-480

(100 TB FC/SATA)

EMC

MirrorView

Tier 2: Gold/Silver/Bronze - Primary Targets : MS Exchange,

Lecture Capture

- Drives: 70 TB FC, 140 TB SATA

- Access SAN or NAS

- Expansion: Yes

EMC NS-480

(65 TB FC/SATA)

EMC NS-480

(65 TB FC/SATA)

Tier 2: Gold/Silver/Bronze - Primary Targets: Departmental Growth,

Research Computing

- Drives: 30 TB FC, 100 TB SATA

- Access SAN or NAS

- Expansion: Yes


Duke University –Future Directions and Considerations


GatewayTake advantage of EMC SAN infrastrures to provide NAS services

Celerra Unified Storage Family

Unified StorageDedicated storage

Easy to deploy

Simple to manage

NX4 NS-120 NS-480 NS-960 NS-G2 NS-G8

Availability Failover FailoverAdvanced Failover (N+1/N+M)

Advanced Failover (N+1/N+M)

FailoverAdvanced Failover (N+1/N+M)

Number of X-Blades 1 or 2 1 or 2 2 or 4 2–8 1 or 2 2–8

Connectivity

NFS/CIFSiSCSI,Fibre Channel

NFS/CIFS MPFS,iSCSI,Fibre Channel





Storage Integrated Integrated Integrated IntegratedFibre Channel SAN (CLARiiON, Symmetrix)

Fibre Channel SAN (CLARiiON, Symmetrix)

Maximum usable IP storage capacity(X-Blade/system)

16 TB/32 TB

32 TB/64 TB

64 TB/192 TB

128 TB/896 TB

64 TB/128 TB

128 TB/896 TB


Win Iomega® Portable Hard Drive

Provide Feedback and Design with Us!

We are interested in feedback from

CLARiiON, Celerra & Centera customers.

Go to

www.emc.com/umsgsurveyfor a short survey.

One winner will be randomly selected for an Iomega portable

hard drive and select respondents will also get an opportunity to

participate in usability studies.

http://www.emc.com/umsgsurvey


Related EMC World SessionsKeynotes

Next Generation Datacenters - Building an Information Utility (Rich Napolitano, Tu@2p)

LecturesCelerra FAST Uncovered: Cloud Integration and Storage Efficiency (M@3:30p, Th@11:30a)

Celerra Unified Storage Architecture and Key Concepts (Tu@8a, W@2p)

Introducing Unisphere: the New Management UI for CLARiiON & Celerra (M@11a, Tu@11a)

Managing a Deduplicated World - Using EMC Data Protection Advisor with EMC Avamar and EMC Data Domain

(W@9:30a, Th@8:30a)

Simple and Cost Effective Exchange Archiving with Celerra Unified Storage and SourceOne (W@11a)

Unified Application Management: Ionix Application Stack Manager and Server Configuration Management

(M@11a, W@2p)

Hands-on WorkshopsCLARiiON and Celerra: Unisphere - Hands-on Workshop (M@11a, Tu@11a, Tu@3:30p, W@9:30a, W@3:30p)

Introduction to Celerra Administration - Hands-on Workshop (M@8a, Tu@5p, W@3:30p, Th@11:30a)

Birds-of-a-FeatherUnisphere - the New Common Celerra and CLARiiON Graphical User Interface (W@8a)

Midrange Storage Booth Demos[―Simple‖ kiosk]: Unisphere Demo

[―Efficient‖ kiosk]: FMA Archive to the Cloud & Virtual Archive

Please help us improve by filling out session evaluations!

NAS Meets SAN: An Introduction to Celerra Unified Storage

Rob Hazen (EMC), Brian Boyd (Duke University)

NAS Meets SAN - An Introduction to Unified Storage

Technology

Transcript of NAS Meets SAN - An Introduction to Unified Storage