EMC Isilon OneFS 7 · •Isilon OneFS: Seventh generation, industry-proven, innovative scale-out...

1 © Copyright 2012 EMC Corporation. All rights reserved.

EMC Isilon OneFS 7.0

Proven Professional Webcast

Brian Cox Nick Trimbee


OneFS 7.0: What’s New?

Summary

Why OneFS 7.0?

Isilon & OneFS Overview


0

10

20

30

40

50

60

70

80

90

2009 2010 2011 2012 2013 2014

Exabyte

s

The Big Data Challenge

In 2013, 80% of all storage capacity sold will be for file-based data Source: “Scale Out Storage in the Content Driven Enterprise: Unleashing the Value of Information Assets,” IDC White Paper (2010 Enterprise Disk Storage Consumption Model), June 2011

File based: 61.8% CAGR Block based: 23.7% CAGR

Media & Entertainment

Design & Simulation

Financial Services

Bioinformatics Oil & Gas File Shares &

Archives


Data intensive, HPC workflows

Big Data Apps Need Big Data Storage

Medical Imaging Gene Sequencing Seismic Exploration

Media & Entertainment Product Development Satellite Images


Typical enterprise IT workloads

Enterprise IT Needs Big Storage

LARGE-SCALE HOME DIRECTORIES LARGE-SCALE ARCHIVES

LARGE-SCALE VIRTUALIZATION LARGE-SCALE ANALYTICS


EMC Isilon Setting the standard for scale-out NAS

• Broad adoption across many markets

– High Performance Computing (HPC): Life Sciences, Oil & Gas, Electronic

Design Automation, Media & Entertainment, Financial Services

– Enterprise IT: Archive, Home Directories, File Shares, Virtualization,

Business Analytics

• Over 3,000 global customers

– Over 50% Y/Y growth rate

– EMC #1 NAS market*

• Isilon OneFS: Seventh generation, industry-proven, innovative

scale-out operating environment

*Source: “Market Share Analysis: Network-Attached Storage/Unified Storage, Worldwide, 2011,” Gartner, March 2012


Isilon Scale-Out NAS Architecture

OneFS Operating Environment

Intra-cluster Communication Layer

Servers

Client/Application Layer Ethernet Layer

Servers

Servers

Sin

gle

FS/V

olu

me SMB NFS

FTP HTTP

HDFS

iSCSI


Isilon Core Innovation OneFS scale-out operating system

Single File System Simplicity

Leadership Efficiency

High Performance

Easy Growth

Automated Tiering

Linear Scalability


Isilon Hardware Scale-out NAS product family

Linear Scaling of Performance and Capacity

Purpose-built for IOPS-intensive, random access,

file-based applications

Flexible solution for high concurrent and sequential throughput applications

Ideal for cost-effective, large-capacity storage

S-Series

X-Series

NL-Series


More scalable than traditional storage systems

Largest and Most Scalable File System

OneFS scales from 18 TB to more than 15 PB in a single file system, single volume

Scales from 3 node cluster

to 144 nodes

Add additional capacity

in under 60 seconds with no downtime


Isilon AutoBalance

Gain New Levels of Efficiency

• AutoBalance automatically moves content to new storage nodes while system is online and in production

• Eliminates “hot spots”

• Enables unmatched storage capacity utilization of more than 80%

AutoBalance Automated data balancing across nodes reduces costs, complexity, and risks for scaling storage

EMPTY

EMPTY

EMPTY

EMPTY

EMPTY

FULL

FULL

FULL

FULL

BALANCED

BALANCED

BALANCED

BALANCED

BALANCED


Isilon SmartPools

Optimize Resources with Automated Tiering

Single point of management

– Single file system/single volume

– Multiple performance tiers

Automatic data movement

– Policy-based tiering management

– Transparent reallocation

Optimize storage resources

– Automatically match storage resources with data requirements

– Eliminate data migration

S-Series Performance

NL-Series Active archives

X-Series Collaboration

Reduced c

ost/T

B

Files


SPECsfs2008 CIFS: aggregate vendor performance

World’s Fastest NAS

ISILON RECORD-BREAKING P E R F O R M A N C E

Huaw

ei

Sym

ante

c

EM

C

EM

C

EM

C

NetA

pp

NetA

pp

NetA

pp

NetA

pp

Apple

Silic

on

Gra

phic

s

Apple

Fujits

u

Apple

Fujits

u

Sie

mens

Fujits

u

Fujits

u

Sie

mens

Fujits

u

Sie

mens

Fujits

u

Sie

mens

NSPLab

Fujits

u

1,600,000

1,500,000

1,400,000

1,300,000

1,200,000

1,100,000

1,000,000

900,000

800,000

700,000

600,000

500,000

400,000

200,000

300,000

100,000

EM

C I

silo

n

CIFS

IO

PS

World Record 1.6 million CIFS OPS

126% increase over competition

Source: “All SPEC SPECsfs2008_cifs Results Published by SPEC,” October 3, 2012 (http://www.spec.org/sfs2008/results/sfs2008cifs.html)

http://www.spec.org/sfs2008/results/sfs2008cifs.html


SPECsfs2008 performance test results

Linear, Predictable Scalability

Predictable SLAs

7 14 28 56 140

1,800,000

1,600,000

1,400,000

1,200,000

1,000,000

800,000

600,000

400,000

200,000

Fil

e O

ps/

seco

nd

CIFS NFS


With N+2, N+3, and N+4 protection, data is 100% available if multiple drives or nodes fail

With N+1 protection, data is 100% available even if a single drive or node fails

Highly resilient, clustered architecture

Unmatched Data Protection and Availability

100%

100%

100%

100%

100%

100%

100%

100%

FAILED

FAILED

And with Isilon, the more nodes in the cluster, the faster drive rebuild time


Single storage pool for application consolidation

Isilon Scale-Out Innovation

Simple to scale – Manage 10’s of PBs like a 1 TB drive

Predictable performance – Grows linearly

Efficient to operate – Maximize utilization to 80%+

– Automate tiering

Highly resilient – Survives multiple failures

Enterprise proven – Management and protection

tools that customers expect

No data migrations



Summary

Why OneFS 7.0?



OPERATIONAL SIMPLICITY

RAPID GROWTH

MASSIVE CAPACITY

EXTREME PERFORMANCE

Big Data Storage World

BIG DATA


PREDICTABLE PERFORMANCE

INTEROPERABILITY DATA PROTECTION

SECURITY

Enterprise IT Storage World

Enterprise IT


Two Storage Worlds Converge…

Enterprise IT

BIG DATA

Enterprise SCALE-OUT


Delivering the Best of Big Data & Enterprise IT Storage

Introducing OneFS 7.0 OS

Massive Capacity Security

Extreme Performance

Data Protection

Predictable Performance

Interoperability Operational Simplicity

Rapid Growth Enterprise

SCALE-OUT



Summary

Why OneFS 7.0?



Robust Enterprise Security Options

Secure Role Separation

– Roles-based administration

– Administration and data access separated

Secure Isolation

– Authentication Zones

Secure WORM Data Protection

– Isilon SmartLock

– SEC 17a-4 Compliance option


Also called “Access Zones”

Authentication Zones

Associate the cluster with multiple authentication provider groups

Access Zones enable you to:

– Separate authentication providers into groups

– Limit data access based on access zone

– Perform storage consolidation with overlapping directory structures

Access Zone-1

System Zone

Access Zone-2

LDAP-1

Active Directory-2

LDAP-3 NIS

NIS

Group Database

Finance

Legal

LDAP-2

Active Directory-1

Group Database

SmartConnect Zone-1

SmartConnect Zone-2

IT


Multiple Authentication Sources

Authentication Zones

Internal Company Filer Consolidation

– Multiple departments or divisions

– Multiple authentication sources

– Overlapping home directory structures

Departmental Isolation

– Secure departmental data isolation

– Multiple authentication sources

Multiple Zones

Finance

Human Resources

Executive

Sales Engineering


Roles Based Administration

Define individual roles with right privileges

Each Role is associated with

– A list of users/groups

– A list of actions/privileges that the role

– is allowed

User can be part of many different roles:

– A “union” of all privileges defined for those roles is allowed for that user

Ability to define custom roles

RBAC Role

User (SnapAdmin)

Action (SnapIQ)


WORM Archive Protection

OneFS SmartLock

SmartLock provides cost-effective, efficient protection against accidental, premature or malicious data deletion or modification

SmartLock now has two operational modes

– Enterprise Mode

– Compliance Mode (meets SEC 17a-4)

Mix WORM and Non-WORM data

Integrate with OneFS:

– Located on any storage tier

– Integrated with Isilon SyncIQ

InfiniB

and C

ore

Netw

ork

S-Series Performance

X-Series Throughput

NL-Series Archive

SmartLock TM

Directory


New Snapshot Restore

Fast

Efficient

Simple

Lower Risk & Increased Availability for Critical Data

Scale-Out NAS Data Protection

ACCIDENTAL DELETE

VIRUSES

EMC Confidential


Lowers Risk For Business Critical Data

Scale-Out NAS Data Protection

New Fast and Simple Failover/Failback

SIMPLE


Interoperability for Operational Flexibility

Platform REST API

– Simplify management and integration

– Third-party application integration

VMware integration

– VAAI: vStorage APIs for array integration

– VASA: vSphere APIs for storage awareness

– Virtual Server writeable clones

Multi-protocol support

– Integrated support for industry-standard protocols

– Native HDFS support

CIFS NFS

FTP HTTP

HDFS for

Hadoop

VAAI VASA

OneFS API


API Architecture

Platform API

RBAC

LIB ISI_PAPI

APACHE

PAPI_D

GConfig

JSON

Snapshot scheduling via REST URI:

http://cluster:9443/1/snapshot/schedules/id_1

Platform API

• Full RESTful API • Automated Cluster

Management • Includes events,

statistics and data access

• Programmatic interface for WebUI and CLI

• RBAC Integration


VMware Integration - File Clones

• Clones are logical copies which share blocks with original file

• Clones are fast to create and consume less space

• Either original file or clone can be further cloned at any point

B 102

A 101

C 103

D 104

VMDK_1 FILE_1 FILE_1 CLONE

C1

115

B2

110

A1

121

C2

129


VMwareAPI Integration

VMware vSphere provides APIs and SDK to allow customers to enhance and extend the functionality of vSphere

For storage, the following APIs are provided: – VAAI – VMware vSphere APIs for Array

Integration which enables offloading of common specific tasks to storage systems

– VASA – VMware APIs for Storage Awareness enables storage systems to communicate the storage system’s available features and functionality to vSphere

vSphere 5.0 VAAI Block • Block Zeroing • Block Copying • Atomic Test and Swap • Thin provision stuns VAAI NAS • Full Copy • Extended Stats • Space reservation

Node Type

SSD Capability

SATA N Capacity

SATA Y Performance

SAS N Performance

SAS Y Ultra Performance

Mixed N Hybrid

Mixed Y Hybrid

VASA • Integration with vCenter • Insight into cluster

capabilities


Increase Productivity & Unlock New Opportunities

Scale-Out NAS Performance

50% Less Latency

724MB/s Single Stream

1.6M IO/s World’s Fastest NAS

106GB/s Concurrent

Big Data Performance

Throughput

Enterprise IT Performance

Random/IO Intensive


OneFS 7.0: Multi-threaded IO

Dramatic increase in concurrent random write

performance to large files.

Byte-range write locking

Improves latency.

Boosts performance for:

– VMDK files

– HPC Checkpoint Files

Multiple threads concurrently writing to a single file


SmartPools Automatic Provisioning Automated cluster protection

+2:1 FEC across Storage Pools

Improved disk utilization by up to 30%

Consistent MTTDL across all clusters:

– Capacity

– Node type

– Utilization



Summary

Why OneFS 7.0?



Isilon Scale-Out NAS Value

Scales to over 15 PB in a single file system

Single file system, single volume, global namespace

Efficient backup and recovery, reliable disaster recovery, and N+1 thru N+4 redundancy

More than 80% storage utilization, and automated storage tiering

Over 100 GB/s throughput, 1.6M SPECsfs ops

Integrated support for industry-standard protocols including NFS, SMB, HTTP, FTP, and HDFS; platform REST API; VMware integration

Roles-based administration; Authentication Zones; SEC 17a-4 compliant WORM data security


Questions and Answers

To type a question via WebEx, click on the Q&A tab

Please select “Ask: All Panelists”

to ensure your questions reach us. Thank you!


Resources / Next Steps • Visit our website:

– http://www.emc.com/storage/isilon/isilon.htm

• Analyst Video – ESG: How EMC Isilon OneFS 7.0 Addresses Big Data in the Enterprise

• Data Sheets – EMC Isilon OneFS Operating System

– EMC Isilon Scale-Out Platform Overview

– EMC Isilon SmartLock

– EMC Isilon SyncIQ

• White Papers – EMC Isilon OneFS – A Technical Overview

– High Availability & Data Protection with EMC Isilon Scale-Out NAS

http://www.emc.com/storage/isilon/isilon.htm

http://www.emc.com/storage/isilon/isilon.htm

http://www.emc.com/storage/isilon/isilon-onefs-operating-system.htm




http://www.emc.com/collateral/software/data-sheet/h10717-isilon-onefs-ds.pdf




http://www.emc.com/collateral/software/data-sheet/h10541-isilon-scale-out-storage-platform-ds.pdf



http://www.emc.com/collateral/software/data-sheet/h10718-isilon-smartlock-ds.pdf

http://www.emc.com/collateral/software/data-sheet/h10718-isilon-smartlock-ds.pdf

http://www.emc.com/collateral/hardware/data-sheet/h10586-isilon-synciq-ds.pdf

http://www.emc.com/collateral/hardware/data-sheet/h10586-isilon-synciq-ds.pdf

http://www.emc.com/collateral/hardware/white-papers/h10719-isilon-onefs-technical-overview-wp.pdf






http://www.emc.com/collateral/hardware/white-papers/h10588-isilon-data-availability-protection-wp.pdf




THANK YOU!

EMC Isilon OneFS 7 · •Isilon OneFS: Seventh generation, industry-proven, innovative scale-out...

Documents

Transcript of EMC Isilon OneFS 7 · •Isilon OneFS: Seventh generation, industry-proven, innovative scale-out...