Post on 30-Aug-2018
IBM System Storage
© 2007 IBM Corporation
Virtualisation, tiered storage, space managementHow does it all fit together?
Dr Axel KoesterSenior Consultant, Enterprise Storageaxel.koester@de.ibm.com
Luxembourg Storage Seminar, 09.05.2007
2
IBM System Storage
axel.koester@de.ibm.com © 2007 IBM Corporation
50505050 Years of Disk Storage: 1956 First Disk System
IBM System 350 + RAMAC 305 Disk IBM System 350 + RAMAC 305 Disk StorageStorage
5 MB, 50.000 US$5 MB, 50.000 US$
RAMAC: Random Access Method for Accounting and Control
3
IBM System Storage
axel.koester@de.ibm.com © 2007 IBM Corporation
Magnetic Drum 13“diam,42 ft. 5MB =
940 pages single-spaced5MB =
2000 ft. tape (200 char/“)5MB =
60K 80-column punched cards5MB =
RAMAC capacity compared
Average 500ms, max. 750msAccess time
Max. 100 bits/inch, min. 55 bits/inchRecording density
100, with 500 8bit-charactersTracks/disk-surface
61cmDiameter
50Number of Disks
5MB ("Mega-Characters")Capacity
RAMAC Storage: For Accounting and Control – only!
4
IBM System Storage
axel.koester@de.ibm.com © 2007 IBM Corporation
33 Years of tiered Storage: Speed versus Capacity
1970
IBM 3420
IBM 3850 Mass Storage System (1974)
472 Billion472 BillionCharactersCharacters
IBM 3850 Cartridges (19,5m)with Staging-Disk IBM 3336
IBM 3420 Tape
5
IBM System Storage
axel.koester@de.ibm.com © 2007 IBM Corporation
Information Management Software since ~20 years
� Data Facility Systems Managed Storage (DFSMS) since 1988
� Tivoli Storage Manager (TSM / ADSM) since 1993
� Content management & discovery software ContentMgr, Commonstore, Filenet, Productivity Center, …
6
IBM System Storage
axel.koester@de.ibm.com © 2007 IBM Corporation
The Landscape Today
VirtualisationVirtualisation
Tiered StorageTiered Storage
Space ManagementSpace ManagementServer Virtualisation
SAN Virtualisation - SVC
File Virtualisation - GPFS
Tape Virtualisation
Tivoli Storage Manager
HSM Space Manager
Productivity Center
DFSMS
FC / SATA / Tape
Tivoli Storage Manager
Policy-based Migration
7
IBM System Storage
axel.koester@de.ibm.com © 2007 IBM Corporation
Goals of Virtualization
� Server Virtualization:– Efficient usage of resources
– Less hardware / floorspace
– Still: Administrative effort per partition/OS
� Storage Virtualization:– Efficient usage of resources
– (Somewhat) less hardware
– Reduce admin effort: Manage pools, not racks
SystemP5
SystemZ9
~95%
8
IBM System Storage
axel.koester@de.ibm.com © 2007 IBM Corporation
Goals of Tiered Storage
1. Provide storage at the appropriate cost level per application
2. Provide recovery capabilities as required per application
� Enablers for tiered storage:– Online application migration capabilities (SVC)
– Pool management
– Resource usage monitoring (TPC)
9
IBM System Storage
axel.koester@de.ibm.com © 2007 IBM Corporation
Goals of Space Management
1. Minimize highest storage tier costs
2. Automate placement of application data, reduce admin effort
3. Optimize application restore capabilities
� Enablers for space management:– Policy-based automation (HSM, FS)
– Transparent resource usage (TPC)
10
IBM System Storage
axel.koester@de.ibm.com © 2007 IBM Corporation
Space Management
11
IBM System Storage
axel.koester@de.ibm.com © 2007 IBM Corporation
Space Management with Tivoli HSM
� For Windows, Unix, or Linux
� Inactive data is transparently migrated by process rules, while remaining accessible
12
IBM System Storage
axel.koester@de.ibm.com © 2007 IBM Corporation
Tivoli Hierarchical Storage Management
85% fill grade: Delete
50% fill grade: Pre-migrate
Migration rule (s)
for inactive data
Disk cache Tape
»
Recall rules & quotas
TSM Repository
13
IBM System Storage
axel.koester@de.ibm.com © 2007 IBM Corporation
Fast Application Restore with Tivoli HSM
Logical disk size unchanged but physical disk size reduced to size of one disk cluster
After a disaster, only 4kB have to be restored to make this application startable
14
IBM System Storage
axel.koester@de.ibm.com © 2007 IBM Corporation
Elements required with Tivoli HSM
� TSM server (the one used for standard backup/restore/archive)
� TSM client software ( " )
� Enable client-side HSMMigrate
Recall
TSM Client HSM
TSM Server
15
IBM System Storage
axel.koester@de.ibm.com © 2007 IBM Corporation
Resource Management
16
IBM System Storage
axel.koester@de.ibm.com © 2007 IBM Corporation
Administrator's Swiss Army Knife
� One application for:
– Data and storage management (cross-vendor)
– Performance statistics
– Analysis, reporting, quota violations
– Prediction
– Avoiding out-of-space conditions (e.g. trigger provisioning)
– Error detection & correlation
– Topology browsing
– Chargeback/billing …
17
IBM System Storage
axel.koester@de.ibm.com © 2007 IBM Corporation
� Storage Resource Management Tool
� Relates the application view with the system view on data
� Correlation Engine
� Storage Esperanto: SMI-S / GS3
TotalStorage Productivity Center TPC
�
Applikation? User? Share? LUN? WWN? Path? Container?
18
IBM System Storage
axel.koester@de.ibm.com © 2007 IBM Corporation
TotalStorage Productivity Center TPC
IBM TotalStorage Productivity Center
Standard Edition
Limited Edition (limit = 2TB)
Productivity Center For Data
Productivity Center For Fabric
Productivity Center For Disk
Productivity Center For Replication
Limited Edition ships for free with every IBM storage Elements can be ordered separately
19
IBM System Storage
axel.koester@de.ibm.com © 2007 IBM Corporation
20
IBM System Storage
axel.koester@de.ibm.com © 2007 IBM Corporation
21
IBM System Storage
axel.koester@de.ibm.com © 2007 IBM Corporation
Resource Virtualisation
22
IBM System Storage
axel.koester@de.ibm.com © 2007 IBM Corporation
Block-based Storage Virtualisation
� Benefits:– Homogeneous administration
– Migrate while online
– Increased storage fill grade
– Balanced performance
– Isolate non-interoperable systems
– Less specialized staff required
– Heterogeneous distant replication
– Substantial software licenses economies
SANVolume Controller
SAN
23
IBM System Storage
axel.koester@de.ibm.com © 2007 IBM Corporation
Why did we chose in-band Storage Virtualisation?
Host
Zone
Storage
Zone Storage
Zone
Host
Zone
Host
Zone
Storage
Zone
In-band Appliance Array Based Intelligent Switch
SAN Volume Controller HDS TagmaStore EMC Invista
Control
Path
MetaDataFast Path
Intelligent
Blades
24
IBM System Storage
axel.koester@de.ibm.com © 2007 IBM Corporation
Why did we chose in-band Storage Virtualisation?
Host
Zone
Storage
Zone Storage
Zone
Host
Zone
Host
Zone
Storage
Zone
In-band Appliance Array Based Intelligent Switch
SAN Volume Controller HDS TagmaStore EMC Invista
Control
Path
MetaDataFast Path
Intelligent
Blades
No storage poolNo storage poolconcept. No stripingconcept. No striping
ImageImage --mode mode pass throughpass throughaccess only.access only.
VirtualisationVirtualisationas migration toolas migration tool
No cachingNo cachingconcept. Reliesconcept. Relieson subsystemon subsystemfunctions forfunctions for
Replication etcReplication etc
ExpensiveExpensiveswitchswitch
hardwarehardware
PerformancePerformance ……??SPC benchmark?SPC benchmark?
25
IBM System Storage
axel.koester@de.ibm.com © 2007 IBM Corporation
SAN Volume Controller: #1 in official SPC benchmarks
� SPC = official benchmark for storage, compare to "TPC" for servers
� SPC-1™ measures random access performance in database environments whereas SPC-2™ measures sequential throughput
� SPC-2 focuses on file serving in a real-word environment– Not the ideal 100%-cache-hit peak number
– Benefits of read prefetch mechanism
– Benefits of sequential IO detection
�All numbers circa +20% for current SVC 4.1
To-be-announced SVC 4.2 is expected to exceed 6000 MB/s in SPC-2 benchmark.
http://www.storageperformance.org
26
IBM System Storage
axel.koester@de.ibm.com © 2007 IBM Corporation
File Virtualisation
27
IBM System Storage
axel.koester@de.ibm.com © 2007 IBM Corporation
IBM Storage Tank Technology
� Goal: Let the system assign resources (DFSMS-like)
1. Define classes of IT projects with policies & rules
2. Associate new projects with a class of policies
3. See how everything finds its most-suitable place by itself, over time, without human interaction
28
IBM System Storage
axel.koester@de.ibm.com © 2007 IBM Corporation
IBM Storage Tank Technology
� Examples of policy-driven data placement:
Storage Pool
Storage Pool
Storage Pool
Storage Tank Policies
Place new files on fast reliable storage, migrate as they age
Place temp files on non-mirrored non-backed storage
Keep related files together�
�
�
29
IBM System Storage
axel.koester@de.ibm.com © 2007 IBM Corporation
IBM Storage Tank Technology now in GPFS 3.1
1. Policy driven data movement between all storage classes including full box migration.
2. Single point management across all storage classes including snapshot.
3. Isolation of storage configuration and effective application used storage.
4. Scalability from ThinkPad to BlueGene.
5. SAP certified with DB2 and Oracle Databases.
GPFS 2.x: thousands of satisfied customers worldwide
GPFS 3.1 + Policies
30
IBM System Storage
axel.koester@de.ibm.com © 2007 IBM Corporation
How they fit together:
VirtualisationVirtualisation
Tiered StorageTiered Storage
Space ManagementSpace ManagementServer Virtualisation
SAN Virtualisation - SVC
File Virtualisation - GPFS
Tape Virtualisation
Tivoli Storage Manager
HSM Space Manager
Productivity Center
DFSMS
FC / SATA / Tape
Tivoli Storage Manager
Policy-based Migration
31
IBM System Storage
axel.koester@de.ibm.com © 2007 IBM Corporation
DisclaimersNo part of this document may be reproduced or trans mitted in any form without written permission from I BM Corporation.
Product data has been reviewed for accuracy as of t he date of initial publication. Product data is su bject to change without notice. This information c ould include technical inaccuracies or typographical err ors. IBM may make improvements and/or changes in th e product(s) and/or program(s) at any time without notice. Any statements regarding IBM's fut ure direction and intent are subject to change or wi thdrawal without notice, and represent goals and objectives only.
The performance data contained herein was obtained in a controlled, isolated environment. Actual resu lts that may be obtained in other operating environments may vary significantly. While IBM has reviewed each item for accuracy in a specific situ ation, there is no guarantee that the same or simil ar results will be obtained elsewhere. Customer exper iences described herein are based upon information and opinions provided by the customer. The same results may not be obtained by every user.
Reference in this document to IBM products, program s, or services does not imply that IBM intends to m ake such products, programs or services available i n all countries in which IBM operates or does busines s. Any reference to an IBM Program Product in this document is not intended to state or imply that only that program product may be used. Any functio nally equivalent program, that does not infringe IB M's intellectual property rights, may be used instead. It is the user's responsibility to evalua te and verify the operation on any non-IBM product, program or service.
THE INFORMATION PROVIDED IN THIS DOCUMENT IS DISTRIBUTED "AS IS" WITHOUT ANY WARRANTY, EITHER EXPRESS O R IMPLIED. IBM EXPRESSLYDISCLAIMS ANY WARRANTIES OF MERCHANTABILITY, FITNES S FOR A PARTICULAR PURPOSE OR INFRINGEMENT. IBM sh all have no responsibilityto update this information. IBM products are warra nted according to the terms and conditions of the a greements (e.g. IBM Customer Agreement, Statement of Limited Warranty, International Progra m License Agreement, etc.) under which they are pro vided. IBM is not responsible for the performance or interoperability of any non-IBM prod ucts discussed herein.
Information concerning non-IBM products was obtaine d from the suppliers of those products, their publi shed announcements or other publicly available sources. IBM has not tested those products in conn ection with this publication and cannot confirm the accuracy of performance, compatibility or any other claims related to non-IBM products. Question s on the capabilities of non-IBM products should b e addressed to the suppliers of those products.
The providing of the information contained herein i s not intended to, and does not, grant any right or license under any IBM patents or copyrights. Inqu iries regarding patent or copyright licenses should be ma de, in writing, to:
IBM Director of LicensingIBM CorporationNorth Castle DriveArmonk, NY 10504-1785USA
32
IBM System Storage
axel.koester@de.ibm.com © 2007 IBM Corporation
TrademarksThe following terms are trademarks or registered trademarks of the IBM Corporation in either the United States, other countries or both.
Linear Tape-Open, LTO, LTO Logo, Ultrium logo, Ultrium 2 Logo and Ultrium 3 logo are trademarks in the United States and other countries of Certance, Hewlett-Packard, and IBM.
Java and all Java-based trademarks are trademarks of Sun Microsystems, Inc. in the United States and/or other countries.
Microsoft, Windows, Windows NT, and the Windows logo are trademarks of Microsoft Corporation in the United States and/or other countries.
Intel, Intel Inside (logos), MMX and Pentium are trademarks of Intel Corporation in the United States and/or other countries.
UNIX is a registered trademark of The Open Group in the United States and other countries.
Linux is a trademark of Linus Torvalds in the United States and other countries.
Other company, product, or service names may be trademarks or service marks of others.
�ServerProven�System z9�System p5�System Storage�Tivoli�TotalStorage�TotalStorage Proven�TPF�Virtualization Engine�X-Architecture�xSeries�z/OS�z/VM�zSeries
�ON (button device)�On demand business�OnForever�OpenPower�OS/390�OS/400�Parallel Sysplex�POWER�POWER5�Predictive Failure Analysis�pSeries�S/390�Seascape
�eServer�FICON�FlashCopy�GDPS�Geographically Dispersed Parallel Sysplex
�HiperSockets�i5/OS�IBM�IBM eServer�IBM logo�iSeries�Lotus
�AIX�AIX 5L�BladeCenter�Chipkill�DB2�DB2 Universal Database�DFSMSdss�DFSMShsm�DFSMSrmm�Domino�e-business logo�Enterprise Storage Server�ESCON
33
IBM System Storage
axel.koester@de.ibm.com © 2007 IBM Corporation