Download - Sürat Teknoloji EMC Forum Isilon Sunumu

1© Copyright 2011 EMC Corporation. All rights reserved.

Isilon Scale-out StorageSmart Storage Made Simple

Murat Gunes, Senior Storage EngineerSurat Teknoloji

18th October 2012


File Size

Traditional Data Digital Content

E-mail Database File

Digital Camera Picture

Map

5KB

xMB 4MB

300MB

Cancer Research

60 GB

DigitalMusic

10MB

Video

50MB

Document

25KB

The Need for Isilon – A Micro View…

2000X in Size!

A 7 TB DNA Sequencing

File would be 140,000X THIS size!!

http://jayme.smugmug.com/photos/20050164-D.jpg


2009 2010 2011 2012 2013 20140

10

20

30

40

50

60

70

80

90

EX

AB

YTE

SBig Data is File & Unstructured Data

By 2012, 80% of all storage capacity sold will be for file-based data

Source: IDC

File Based: 60.7% CAGR Block Based: 21.8% CAGR


So, What is File-based, Unstructured Data?

Video & Graphics

Genetic Sequencing

Satellite Photos

ComputerModeling

Seismic Exploration Music / Audio PDFs

MedicalImaging


“Big Data” Challenge Driving Adoption of New Solutions

50%Increase in the amount of data on scale-out storage within the next 24 months.

84%Already using or planning to use scale-out within the next 24 months.

CIO Survey, October 2010

The #1 and #2 concerns of CIOs…

Scale-out NAS Market Survey, November, 2010

47%Data Growth

37%System Performance& Scalability

…are driving adoption of scale-out!

6© Copyright 2011 EMC Corporation. All rights reserved. Back to Navigation

Isilon Enables Success In…Media & Entertainment Research

GovernmentInternet/Cloud

6

http://www.isilon.com/customer/us-geological-survey-usgs


Isilon for Energy Workflows


Upstream Data ChallengesData Growth

Cost

Storage and Data Management Complexity

Traditional NAS

HEAD HEADCPU, Memory, Throughput

ClientsBottleneck

Scale-Out Clustered NAS

Clients

Symmetric Node CPU Memory Throughput

High Performance Backplane

Symmetric Node

Symmetric Node

Symmetric Node

Symmetric Node

Symmetric Node

CPU Memory Throughput





Technology Options


Enterprises Had Deployed a Scale-Up Strategy

netw

ork

serv

erst

orag

e

ScalabilityPerformanceManagementAvailabilityCost

SCALE UP


Enterprises are Transitioning to Scale-Out

netw

ork

serv

erst

orag

e

ScalabilityPerformanceManagementAvailabilityCost

SCALE OUT

CLUSTERED COMPUTING&

SERVER VIRTUALIZATION

10 GbENETWORK

10x PERFORMANCE

CLUSTERED STORAGE ARCHITECTURES


OneFS Traditional Single/Dual Controller

Architecture • Symmetric, Shared• Fully distributed OS

• Controller w/shelves• Legacy single server OS

Architecture

HeadHead

CPU, Memory, Throughput


Scalability & Performance

CAPACITY

PERF

ORM

ANCE

CAPACITY

PERF

ORM

ANCE

Scale-out Scale-up


Scalability • Scale-out• Performance, Capacity, Both

• Scale-up• Capacity only

Performance • True linear predictability • Degradation at scale


AvailabilityFigure 1: Topology: n-way resiliency


Availability• OneFS & FlexProtect (N+M)• 4+ node failures• 4+ drive failures

• HW RAID• Single head failure• 2 drive failures, slow rebuilds, controller busy

Node w/disk

Node w/disk Node w/disk

Node w/disk

Node w/disk


Management & Economics

RAID

Raid Groups

Volumes

File Systems


Management • 1 volume, 1 file system• Single volume up to 10PB

• MANY RAID, volumes, file systems• Less single volume

Economics• 80%+ utilization, <1FTE• Business agility• Investment protection

• 55-60% utilization, Multiple FTE’s• Silos, limitations• Forklift upgrades


Core Innovation…Isilon’s OneFS Scale-Out Operating System

• Single file system, single volume...up to 10+ PBs• >80% raw storage utilization• Highest performance, fully symmetric cluster• Easy to manage and simple to scale• Multi-tier single file system/single cluster • Single unified platform across all products



Architecture

• Symmetric, Shared• Fully distributed OS

• Controller w/shelves• Legacy single server OS

Scalability• Scale-out• Performance, Capacity, Both

• Scale-up• Capacity only

Performance • True linear predictability • Degradation at scale

Availability• OneFS & FlexProtect (N+M)• 4+ node failures• 4+ drive failures

• HW RAID• Single head failure• 2 drive failures

Management

• 1 volume, 1 file system• Single volume up to 10PB

• Multiple RAID, volumes, file systems•Less Volume

Economics• 80%+ utilization, <1FTE• Business agility• Investment protection

• 50-60% utilization, Multiple FTE’s• Silos, limitations• Forklift upgrades


Isilon Distributed File System


Isilon IQ Network Architecture

Isilon IQ Storage Layer

Intracluster Communication Infiniband

or GigE Layer

Servers

Client/Application Layer Standard Gigabit Ethernet Layer

(optional 2nd switch)

NFS, CIFS,FTP, HTTP, ISCSIServers

Servers


Load Balancing with Failover

Client Connection: Load balancing based on intelligent policiesRedundant: Dynamic failover of NFS client connections between

nodesPerformance: Zoning for priority user, group & application

optimization

SmartConnect Advanced software application provides seamless enterprise storage access to an

Isilon IQ cluster

Clie

nts

SmartConnect


Writing a File with Isilon IQ

Servers



Servers


Writing a File with Isilon IQ


Writing a File with Isilon IQReading a File with Isilon IQ

Servers



Servers


Servers



Servers

Reading a File with Isilon IQ


Largest and Most Scalable File System500X More Scalable than Traditional Storage Systems

OneFS™ can scale from 18TB to over 15,000 TB in a single file system• Under 60 seconds to scale with no downtime

• World’s fastest performance and capacity scaling


AutoBalanceAutomated data balancing across nodes reduces costs, complexity and risks for scaling storage

“Using Software to do Work Unfit for Humans”

• AutoBalance migrates content to new storage nodes while system is online and in production

• Requires NO manual intervention, NO reconfiguration, NO server or client mount point or application changes

• Eliminate “Hot Spots”EMPTY

EMPTY

EMPTY

EMPTY

EMPTY

FULL

FULL

FULL

FULL

BALANCED

BALANCED

BALANCED

BALANCED

BALANCED


The Most Reliable Storage SystemBuilt-in high availability clustered architecture

100%

100%

100%

100%

100%

100%

100%

100%

FAILED

FAILED

And… Isilon IQ offers the industry’s fastest drive rebuild times —In less than an hour!

With N+2, N+3, and N+4 protection, data is 100% available if multiple drives or nodes fail

With N+1 protection,data is 100% available even if a single drive or node fails


The Most Available Storage System Virtual Hot Spares

• Harnesses all free space throughout entire cluster to rebuild data– Unlike traditional systems that are limited to volume/RAID

rebuilds

XFAILURE


Easiest Storage System to ManageSingle-level of Management

Manage a 18TB to 10PB single file system from one intuitive console

"Isilon has made some very bold claims with respect to its clustered storage products - not least the idea of genuinely revolutionizing the ease and speed with which mass storage - over 500 Terabytes - can be added and managed thereafter. We have conducted rigorous testing and unanimously agree with their assertions. This stuff is almost frighteningly simple to use.”

Steve Broadhead, Founder, Broadband-Testing Laboratories


Manage Data. Not Storage Environments

Simplifying storage management permits greater focus on enhancing your virtualized server environment• Acquire only the storage you need with on-demand scaling• Reduce administrative costs with simpler management• Increase efficiency and productivity with better utilization• Maximize capabilities with globally coherent cache and

load-balancing

Reduce OpEx by 30%

Reduce CapEx

by 85%

Achieve utilization

of 80%


Single File System for Multiple Tiers

Infin

iban

d Co

re N

etw

ork

DATASET

DATASET

MB/

sAr

chiv

eI/O

ps

Single Point of Management

Single File SystemSingle VolumeTiers of Performance

Automatic Data MovementPolicy-Based MovementTransparent ReallocationNO application-changes

File-Level GranularityPerformance/LayoutProtection Settings

Technical Innovation

“ With Isilon’s SmartPools, we’ll be able to eliminate tedious, manual data migration tasks and better utilize our existing storage --The cost-savings potential is significant.”─ Nick Bali, Senior Engineer, Sony Pictures Imageworks


SMARTPOOL I/O POLICY PROTECTION POLICY

G

loba

lly C

oher

ent C

ache

VDMK DataLatency

G

loba

lly C

oher

ent C

ache

Single File System for All Big DataSSD Support for Data and Meta Data

S20 Random +1

X200 Sequential +2

NL Inherited +4

HPC DataI/Ops

File DataMB/s

Archive

Select Select Select

S200-SSDS200-SASX200NL

I/Os

Throughput

Archive

RandomSequential Inherited

+1 +2+3+42x

S200-SSD Random 2x

File DataMB/s

File DataMB/s

File DataMB/s


InsightIQ Industry Leading Scale-Out Storage Analytics


• Snapshots only changed files • No pre-allocated reserve space

• Easy and Flexible• Managed at directory level - no volumes or limits on

snapshots• Integrates with VMware and Microsoft VSS

– Enables single VM restore


VMware-Integrated Data Protection

Technical Benefits

Flexible Data Protection

Warm, Cold, or Hot SnapshotPower-On After Restore

iSCSI and NFS Datastores

Simple Web Interface

Integrated with vCenter

Virtual ApplianceLeverages VMware APIsUtilizes Isilon Platform APIAvailability: OneFS 6.0.2


Asynchronous Replication

LAN/ WAN

connection

Additional cluster

Additional cluster

Additional cluster

SyncIQ is a software application that delivers asynchronous replication for DR, D2D backup and

distributed workflow. O/S version 5.5 and newer support block-based replication for fast, low overhead transfers.

Enterprise-wide: One-to-many replication locations throughout enterprise

Flexible: Choose what/when content to replicate based on policy engine

Intelligent: Cluster-aware design delivers unmatched performance

Primary source cluster


• True Directory quotas across Single Namespace– Over-subscribe storage resources– Partition and control shared usage for many customers

• Cluster, directory, subdirectory; user and group• Hard, Soft, and Advisory thresholds• Includes snapshot space

• Reporting & accounting infrastructure built-in


Isilon Scale-out NAS Benefits

• Consolidate and accelerate• Focus on business needs• Adapt to changing

requirements• Reduce risk of over and

under-provisioning

• Start small and pay as you grow

• Manage one file system regardless of size

• Maintain Industry-leading utilization (>80%)

• One volume, scalable to 15.5PB

• Performance, throughput and archive tiers in one volume

• Non-disruptive performance and capacity scaling

ComplexUnpredictable UnmanageableRobustManageableScalable


QUESTIONS ?

Murat Güneş[email protected]