Post on 19-Jul-2015
© Copyright IBM Corporation 2015
Technical University/Symposia materials may not be reproduced in whole or in part without the prior written permission of IBM.
sSS0886
The Pendulum Swings Back –
Understanding Converged and Hyperconverged EnvironmentsTony Pearson
Master Inventor and Senior IT Specialist
IBM Corporation
© Copyright IBM Corporation 2015
Abstract
In the early days of IT, storage was internal to its server, over time, storage outgrew its container, and we started have externally attached storage, and benefits like RAID and clustered servers for high availability. Then, SANs, LANs and WANs took the main stage, allowing for greater connectivity and distance.
But now, it seems the
pendulum is swinging back with converged and
hyperconverged systems.
This session will provide the motivations, advantages
and disadvantages of these new configurations.
1
© Copyright IBM Corporation 2015
This week with Tony Pearson
2
Day Time Topic
Monday 10:30am Software Defined Storage -- Why? What? How? (repeats Tuesday)
03:00pm IBM's Cloud Storage Options (repeats Wednesday)
04:30pm Data Footprint Reduction – Understanding IBM Storage Efficiency Options
Tuesday 10:30am Software Defined Storage -- Why? What? How?
12:30pm What Is Big Data? Architectures and Practical Use Cases
01:45pm IBM Smarter Storage Strategy (repeats Wednesday)
Wednesday 09:00am New Generation of Storage Tiering: Less Management Lower Investment and Increased Performance
10:30am IBM Smarter Storage Strategy
12:30pm IBM's Cloud Storage Options
01:45pm IBM Spectrum Scale (Elastic Storage) Offerings
Thursday 12:30pm The Pendulum Swings Back -- Understanding Converged and Hyperconverged Environments
Friday 09:00am IBM Spectrum Storage Integration with OpenStack
© Copyright IBM Corporation 2015
The Pendulum Swings on Infrastructure Design
Internal Storage
• Personal Information
Managers (PIM)
• Mainframe
• AS/400
Advantages
� Simple, self-contained
Disadvantages
• Simple, self-contained
• Scalability limited to what can fit inside the hardware container
• Single Point of Failure (SPOF)
(unless you keep 2 or more copies of data across
independent systems)
• Backups, Security and other Policy enforcement is done on a
system-by-system basis individually
3
© Copyright IBM Corporation 2015
The Pendulum Swings to External Storage
External Storage
• Mainframe
• AS/400
• Linux, UNIX, Windows
Advantages
� Two or more servers can directly
attach to external storage
� High-availability clusters
� RAID for data protection and
performance
� Shared Cache
� More room for storage growth
� Centralize features, snapshots and
tape drives for backups
Disadvantages
• Scalability limited to number of
hosts attached
• Limited distance for external cables
4
© Copyright IBM Corporation 2015
IBM Entry-Level And Midrange Storage Positioning
5
DCS3700 Performance
• Host: FC, SAS, iSCSI
• 360 SAS, NL-SAS, SSD
• DCS3700 Expansion
DCS3860
• Host: SAS
• 360 SAS, NL-SAS, SSD
• DCS3860 Expansion
DCS3700
• Host: FC, SAS, iSCSI
• 180 SAS, NL-SAS, SSD
• DCS3700 Expansion
Storwize V5000
• Host: FC, FCoE, SAS, iSCSI
• 960 SAS, NL-SAS, SSD
• Storwize Expansion
Storwize V3700
• Host: FC, FCoE, SAS, iSCSI
• 240 SAS, NL-SAS, SSD
• Storwize Expansion
Random workloads Sequential workloads
Deep Computing Storage (DCS)Storwize family built with IBM Spectrum Virtualize™
12 or 24 drivesin 2U rack space
60 drivesin 4U rack space
© Copyright IBM Corporation 2015
The Pendulum Swings to Networked Storage
SAN
LAN
Advantages
� Many more hosts can be attached
� Greater distances enables Disaster
Recovery
� Fewer, larger systems like Tape Libraries easier to manage
Disadvantages
• SANs and LANs requires different
skill sets
• OS-specific and device-specific management tools
Networked Storage
• SAN and NAS attached
storage systems
• IBM Spectrum Scale
6
© Copyright IBM Corporation 2015
The Problem: Islands of SAN, File and Object level data
SAN-level Storage
� OS-specific file systems on direct -attach or SAN-based devices
� Sharing requires file transfers
� Provides “Context” for Analytics of Social and Mobile transactions
File-level Storage
� NAS encourages sharing across social networks
� Desire for file sync-and-share across desktops and mobile
� HDFS requires transfer (ingest) from other sourcesJFS2
EXT4
NTFS
CIFS
HDFS
NFS
Object-level Storage
� New Web and Mobile apps prefer Object-level access
Amazon S3
OpenStackSwift
7
© Copyright IBM Corporation 2015
Spectrum Scale – Flexible File and Object Storage
FS1FS256. . .
Exabyte-Scale,
Global
Namespace
One big file system or divide into as many as
256 smaller file systems
Each file system can be further
divided into fileset
containers
Flash and Disk LUNs
are called Network Shared Disks (NSD) Metadata can be separated
to its own Pool or intermixed with data
Files can be
migrated to Tape
8
© Copyright IBM Corporation 2015
IBM Spectrum Scale™ – Supported Topologies
Twin-tailed
SAN
Internal, Direct-Attach
Shared PoolsFPO Pools
NSD Servers
� Access files on direct, twin-tailed or SAN attached disk
� Can export files to application nodes
File Placement Optimization (FPO) Servers
� Access files on direct attached disk
� Exports files to other FPO servers
External Clients
� Access files via file and object protocols over IP network
TCP/IP
9
NSD Clients
� Access files via SAN, TCP/IP or RDMA
TCP/IP or RDMA network
© Copyright IBM Corporation 2015
IBM Spectrum Scale™ replaces other POSIX file systems
SAN
Direct-Attach
SAN-level Storage
JFS2
EXT4
NTFS
• Works like OS-specific file systems
• No file transfers required between OS
• Linux on x86, POWER and z Systems
TCP/IP or RDMA Network
Twin-tailed
10
© Copyright IBM Corporation 2015
IBM Spectrum Scale™ – More than just a file system!
11
ROBO
Other NFS
Other Datacenters
Scale
Active File
Management
(AFM) caches
data to where it is
needed, can be
used to migrate
from other NFS
Information Lifecycle
Management (ILM) moves data across tiers of
flash and disk
Hierarchical Storage
Management (HSM) migrates infrequently
accessed files to tape,
automatically recalls back
when accessed
Local Read-Only Cache
(LROC) caches the busiest
blocks of files on local flash
Disaster Recovery
(DR) asynchronously
mirrors data to remote
locations
Migrate/Recall Tape
NSD Client
© Copyright IBM Corporation 2015
SAN
Twin-tailed
Protocol Servers
NFS, CIFS
AIX, Linux,Mac OS X, Windows, VMware,
z/OS
� Feature of Spectrum Scale
on Linux
� Share files with clients
using NFS, CIFS and Object
protocols
� All nodes can share the
same data
� If Protocol Server Node
fails client connections are
moved to another server
� Protocol Server Node(s)
need “NSD Server” License
� External Clients need no
Spectrum Scale License
Clustered Protocol Servers
12
TCP/IP
OpenStack