Sürat Teknoloji EMC Forum Isilon Sunumu
Click here to load reader
-
Upload
suerat-teknoloji -
Category
Technology
-
view
1.320 -
download
0
Transcript of Sürat Teknoloji EMC Forum Isilon Sunumu
1© Copyright 2011 EMC Corporation. All rights reserved.
Isilon Scale-out StorageSmart Storage Made Simple
Murat Gunes, Senior Storage EngineerSurat Teknoloji
18th October 2012
2© Copyright 2011 EMC Corporation. All rights reserved.
File Size
Traditional Data Digital Content
E-mail Database File
Digital Camera Picture
Map
5KB
xMB 4MB
300MB
Cancer Research
60 GB
DigitalMusic
10MB
Video
50MB
Document
25KB
The Need for Isilon – A Micro View…
2000X in Size!
A 7 TB DNA Sequencing
File would be 140,000X THIS size!!
3© Copyright 2011 EMC Corporation. All rights reserved.
2009 2010 2011 2012 2013 20140
10
20
30
40
50
60
70
80
90
EX
AB
YTE
SBig Data is File & Unstructured Data
By 2012, 80% of all storage capacity sold will be for file-based data
Source: IDC
File Based: 60.7% CAGR Block Based: 21.8% CAGR
4© Copyright 2011 EMC Corporation. All rights reserved.
So, What is File-based, Unstructured Data?
Video & Graphics
Genetic Sequencing
Satellite Photos
ComputerModeling
Seismic Exploration Music / Audio PDFs
MedicalImaging
5© Copyright 2011 EMC Corporation. All rights reserved.
“Big Data” Challenge Driving Adoption of New Solutions
50%Increase in the amount of data on scale-out storage within the next 24 months.
84%Already using or planning to use scale-out within the next 24 months.
CIO Survey, October 2010
The #1 and #2 concerns of CIOs…
Scale-out NAS Market Survey, November, 2010
47%Data Growth
37%System Performance& Scalability
…are driving adoption of scale-out!
6© Copyright 2011 EMC Corporation. All rights reserved. Back to Navigation
Isilon Enables Success In…Media & Entertainment Research
GovernmentInternet/Cloud
6
8© Copyright 2011 EMC Corporation. All rights reserved.
Isilon for Energy Workflows
9© Copyright 2011 EMC Corporation. All rights reserved.
Upstream Data ChallengesData Growth
Cost
Storage and Data Management Complexity
Traditional NAS
HEAD HEADCPU, Memory, Throughput
ClientsBottleneck
Scale-Out Clustered NAS
Clients
Symmetric Node CPU Memory Throughput
High Performance Backplane
Symmetric Node
Symmetric Node
Symmetric Node
Symmetric Node
Symmetric Node
CPU Memory Throughput
CPU Memory Throughput
CPU Memory Throughput
CPU Memory Throughput
CPU Memory Throughput
Technology Options
10© Copyright 2011 EMC Corporation. All rights reserved.
Enterprises Had Deployed a Scale-Up Strategy
netw
ork
serv
erst
orag
e
ScalabilityPerformanceManagementAvailabilityCost
SCALE UP
11© Copyright 2011 EMC Corporation. All rights reserved.
Enterprises are Transitioning to Scale-Out
netw
ork
serv
erst
orag
e
ScalabilityPerformanceManagementAvailabilityCost
SCALE OUT
CLUSTERED COMPUTING&
SERVER VIRTUALIZATION
10 GbENETWORK
10x PERFORMANCE
CLUSTERED STORAGE ARCHITECTURES
12© Copyright 2011 EMC Corporation. All rights reserved.
OneFS Traditional Single/Dual Controller
Architecture • Symmetric, Shared• Fully distributed OS
• Controller w/shelves• Legacy single server OS
Architecture
HeadHead
CPU, Memory, Throughput
13© Copyright 2011 EMC Corporation. All rights reserved.
Scalability & Performance
CAPACITY
PERF
ORM
ANCE
CAPACITY
PERF
ORM
ANCE
Scale-out Scale-up
OneFS Traditional Single/Dual Controller
Scalability • Scale-out• Performance, Capacity, Both
• Scale-up• Capacity only
Performance • True linear predictability • Degradation at scale
14© Copyright 2011 EMC Corporation. All rights reserved.
AvailabilityFigure 1: Topology: n-way resiliency
OneFS Traditional Single/Dual Controller
Availability• OneFS & FlexProtect (N+M)• 4+ node failures• 4+ drive failures
• HW RAID• Single head failure• 2 drive failures, slow rebuilds, controller busy
Node w/disk
Node w/disk Node w/disk
Node w/disk
Node w/disk
15© Copyright 2011 EMC Corporation. All rights reserved.
Management & Economics
RAID
Raid Groups
Volumes
File Systems
OneFS Traditional Single/Dual Controller
Management • 1 volume, 1 file system• Single volume up to 10PB
• MANY RAID, volumes, file systems• Less single volume
Economics• 80%+ utilization, <1FTE• Business agility• Investment protection
• 55-60% utilization, Multiple FTE’s• Silos, limitations• Forklift upgrades
16© Copyright 2011 EMC Corporation. All rights reserved.
Core Innovation…Isilon’s OneFS Scale-Out Operating System
• Single file system, single volume...up to 10+ PBs• >80% raw storage utilization• Highest performance, fully symmetric cluster• Easy to manage and simple to scale• Multi-tier single file system/single cluster • Single unified platform across all products
17© Copyright 2011 EMC Corporation. All rights reserved.
OneFS Traditional Single/Dual Controller
Architecture
• Symmetric, Shared• Fully distributed OS
• Controller w/shelves• Legacy single server OS
Scalability• Scale-out• Performance, Capacity, Both
• Scale-up• Capacity only
Performance • True linear predictability • Degradation at scale
Availability• OneFS & FlexProtect (N+M)• 4+ node failures• 4+ drive failures
• HW RAID• Single head failure• 2 drive failures
Management
• 1 volume, 1 file system• Single volume up to 10PB
• Multiple RAID, volumes, file systems•Less Volume
Economics• 80%+ utilization, <1FTE• Business agility• Investment protection
• 50-60% utilization, Multiple FTE’s• Silos, limitations• Forklift upgrades
18© Copyright 2011 EMC Corporation. All rights reserved.
Isilon Distributed File System
19© Copyright 2011 EMC Corporation. All rights reserved.
20© Copyright 2011 EMC Corporation. All rights reserved.
Isilon IQ Network Architecture
Isilon IQ Storage Layer
Intracluster Communication Infiniband
or GigE Layer
Servers
Client/Application Layer Standard Gigabit Ethernet Layer
(optional 2nd switch)
NFS, CIFS,FTP, HTTP, ISCSIServers
Servers
21© Copyright 2011 EMC Corporation. All rights reserved.
Load Balancing with Failover
Client Connection: Load balancing based on intelligent policiesRedundant: Dynamic failover of NFS client connections between
nodesPerformance: Zoning for priority user, group & application
optimization
SmartConnect Advanced software application provides seamless enterprise storage access to an
Isilon IQ cluster
Clie
nts
SmartConnect
22© Copyright 2011 EMC Corporation. All rights reserved.
Writing a File with Isilon IQ
Servers
(optional 2nd switch)
NFS, CIFS,FTP, HTTP, ISCSIServers
Servers
23© Copyright 2011 EMC Corporation. All rights reserved.
Writing a File with Isilon IQ
24© Copyright 2011 EMC Corporation. All rights reserved.
Writing a File with Isilon IQReading a File with Isilon IQ
Servers
(optional 2nd switch)
NFS, CIFS,FTP, HTTP, ISCSIServers
Servers
25© Copyright 2011 EMC Corporation. All rights reserved.
Servers
(optional 2nd switch)
NFS, CIFS,FTP, HTTP, ISCSIServers
Servers
Reading a File with Isilon IQ
26© Copyright 2011 EMC Corporation. All rights reserved.
Largest and Most Scalable File System500X More Scalable than Traditional Storage Systems
OneFS™ can scale from 18TB to over 15,000 TB in a single file system• Under 60 seconds to scale with no downtime
• World’s fastest performance and capacity scaling
27© Copyright 2011 EMC Corporation. All rights reserved.
AutoBalanceAutomated data balancing across nodes reduces costs, complexity and risks for scaling storage
“Using Software to do Work Unfit for Humans”
• AutoBalance migrates content to new storage nodes while system is online and in production
• Requires NO manual intervention, NO reconfiguration, NO server or client mount point or application changes
• Eliminate “Hot Spots”EMPTY
EMPTY
EMPTY
EMPTY
EMPTY
FULL
FULL
FULL
FULL
BALANCED
BALANCED
BALANCED
BALANCED
BALANCED
28© Copyright 2011 EMC Corporation. All rights reserved.
The Most Reliable Storage SystemBuilt-in high availability clustered architecture
100%
100%
100%
100%
100%
100%
100%
100%
FAILED
FAILED
And… Isilon IQ offers the industry’s fastest drive rebuild times —In less than an hour!
With N+2, N+3, and N+4 protection, data is 100% available if multiple drives or nodes fail
With N+1 protection,data is 100% available even if a single drive or node fails
29© Copyright 2011 EMC Corporation. All rights reserved.
The Most Available Storage System Virtual Hot Spares
• Harnesses all free space throughout entire cluster to rebuild data– Unlike traditional systems that are limited to volume/RAID
rebuilds
XFAILURE
30© Copyright 2011 EMC Corporation. All rights reserved.
Easiest Storage System to ManageSingle-level of Management
Manage a 18TB to 10PB single file system from one intuitive console
"Isilon has made some very bold claims with respect to its clustered storage products - not least the idea of genuinely revolutionizing the ease and speed with which mass storage - over 500 Terabytes - can be added and managed thereafter. We have conducted rigorous testing and unanimously agree with their assertions. This stuff is almost frighteningly simple to use.”
Steve Broadhead, Founder, Broadband-Testing Laboratories
31© Copyright 2011 EMC Corporation. All rights reserved.
Manage Data. Not Storage Environments
Simplifying storage management permits greater focus on enhancing your virtualized server environment• Acquire only the storage you need with on-demand scaling• Reduce administrative costs with simpler management• Increase efficiency and productivity with better utilization• Maximize capabilities with globally coherent cache and
load-balancing
Reduce OpEx by 30%
Reduce CapEx
by 85%
Achieve utilization
of 80%
32© Copyright 2011 EMC Corporation. All rights reserved.
Single File System for Multiple Tiers
Infin
iban
d Co
re N
etw
ork
DATASET
DATASET
MB/
sAr
chiv
eI/O
ps
Single Point of Management
Single File SystemSingle VolumeTiers of Performance
Automatic Data MovementPolicy-Based MovementTransparent ReallocationNO application-changes
File-Level GranularityPerformance/LayoutProtection Settings
Technical Innovation
“ With Isilon’s SmartPools, we’ll be able to eliminate tedious, manual data migration tasks and better utilize our existing storage --The cost-savings potential is significant.”─ Nick Bali, Senior Engineer, Sony Pictures Imageworks
33© Copyright 2011 EMC Corporation. All rights reserved.
SMARTPOOL I/O POLICY PROTECTION POLICY
G
loba
lly C
oher
ent C
ache
VDMK DataLatency
G
loba
lly C
oher
ent C
ache
Single File System for All Big DataSSD Support for Data and Meta Data
S20 Random +1
X200 Sequential +2
NL Inherited +4
HPC DataI/Ops
File DataMB/s
Archive
Select Select Select
S200-SSDS200-SASX200NL
I/Os
Throughput
Archive
RandomSequential Inherited
+1 +2+3+42x
S200-SSD Random 2x
File DataMB/s
File DataMB/s
File DataMB/s
34© Copyright 2011 EMC Corporation. All rights reserved.
InsightIQ Industry Leading Scale-Out Storage Analytics
35© Copyright 2011 EMC Corporation. All rights reserved.
• Snapshots only changed files • No pre-allocated reserve space
• Easy and Flexible• Managed at directory level - no volumes or limits on
snapshots• Integrates with VMware and Microsoft VSS
– Enables single VM restore
36© Copyright 2011 EMC Corporation. All rights reserved.
VMware-Integrated Data Protection
Technical Benefits
Flexible Data Protection
Warm, Cold, or Hot SnapshotPower-On After Restore
iSCSI and NFS Datastores
Simple Web Interface
Integrated with vCenter
Virtual ApplianceLeverages VMware APIsUtilizes Isilon Platform APIAvailability: OneFS 6.0.2
37© Copyright 2011 EMC Corporation. All rights reserved.
Asynchronous Replication
LAN/ WAN
connection
Additional cluster
Additional cluster
Additional cluster
SyncIQ is a software application that delivers asynchronous replication for DR, D2D backup and
distributed workflow. O/S version 5.5 and newer support block-based replication for fast, low overhead transfers.
Enterprise-wide: One-to-many replication locations throughout enterprise
Flexible: Choose what/when content to replicate based on policy engine
Intelligent: Cluster-aware design delivers unmatched performance
Primary source cluster
38© Copyright 2011 EMC Corporation. All rights reserved.
• True Directory quotas across Single Namespace– Over-subscribe storage resources– Partition and control shared usage for many customers
• Cluster, directory, subdirectory; user and group• Hard, Soft, and Advisory thresholds• Includes snapshot space
• Reporting & accounting infrastructure built-in
39© Copyright 2011 EMC Corporation. All rights reserved.
Isilon Scale-out NAS Benefits
• Consolidate and accelerate• Focus on business needs• Adapt to changing
requirements• Reduce risk of over and
under-provisioning
• Start small and pay as you grow
• Manage one file system regardless of size
• Maintain Industry-leading utilization (>80%)
• One volume, scalable to 15.5PB
• Performance, throughput and archive tiers in one volume
• Non-disruptive performance and capacity scaling
ComplexUnpredictable UnmanageableRobustManageableScalable