Disk_Magic_Basics_042015.pdf

Technical University/Symposia materials may not be reproduced in whole or in part without the prior written permission of IBM.9.0

Copyright IBM Corporation 2015

sPE1482Disk Magic Version 9.20.0 BasicsGetting Started with Disk Magic

Joe Bacco ([email protected])WW Storage Sales Accelerator Tools SupportIBM - Tucson

2 Copyright IBM Corporation 20142

Agenda

Getting Started with Disk Magic Setting expectations - when to use the tool and when to not Tool Support Data collection

Different data inputs Selecting modeling inputs

Importance of Calibration Interpreting and documenting results Disk Magic analysis and modeling


Getting Started with Disk Magic Disk Magic is a pre-sales sizing tool that predicts storage

service times Input from existing workloads Input for future workloads (ie from WLE and SAP sizer, etc) Start with the Disk Magic Quick Start Guide The Disk Magic Learning Guide, which is available for download with Disk

Magic, offers walk-throughs and examples of modeling new and existing SVC environments, as well as instructions on data collection methods and options.

Validate proposed hardware solution Iterative process to size the correct configuration

Output to graphs Compare different solutions

Growth projections Future proof your configuration Understand potential bottlenecks in proposed solution


Setting Expectations when to use the tool and when to not

GIGO Garbage In = Garbage Out Disk Magic assumes an evenly spread workload across assigned

resources.

Not intended to determine source of performance issues Not intended to be used to debug performance issues

Focus is on specific interval vs. entire workload Several intervals may be used for analysis (ie Peak IO, Peak Write MBs

or Peak Total MBs) but in each incidence it is just the one interval Assumes implementation with best practices Disk Magic is used to determine if current workload can be run on new

IBM storage hardware with equal or better performance Compare different solution configurations for new hardware Size IBM solutions to replace competitive environments Combine multiple workloads on to new hardware Show growth capability with new hardware

Note: Peak implies that the Workload is representative and none of the components are being stressed. Then Disk Magic can be used to determine the performance during Peak intervals.


Setting Expectations when to use the tool and when to not

Following items are not supported Flashcopy/Snapshot impacts Nseries workloads iSCSI (except for V7000) DS3000 Specifying Extent size, strip size, or similar types of implementation

settings Volume level quality of service implementation settings Events type modeling, e.g. Data migration Some combinations of host/OS type and subsystem/capability, eg.

Power i and SVC, Power i and Easy Tier, etc. Batch run-time improvement

Sometimes new product enhancements lag support in Disk Magic Goal is to provide support at announce


Where to get Disk Magic

IBMers: (980) http://w3.ibm.com/sales/support/ShowDoc.wss?docid=SSPQ048068H83479I86 Disk Magic, RMF Magic, Capacity Magic, Batch Magic, Mainframe

Tape Tools, ProtecTIER Planner and TCOnow from CIOview: Business Partners: (1254)

http://www.ibm.com/partnerworld/wps/servlet/ContentHandler/SSPQ048068H83479I86

Disk Magic, Capacity Magic, Batch Magic, Mainframe Tape Tools, ProtecTIER Planner and TCOnow from CIOview

Note: Do not bookmark the individual tools. The direct links have brokenin the past and old versions of the programs were returned.


IBM Portal


Business Partner Portal on IBM PartnerWorld


Disk Magic download page


Disk Magic Start Menu (W7)


Disk Magic HELP (printed help)

There are 747 pages of HELP text.Please take advantage of this!


Disk Magic HELP

How to procedures for the many Controllers and Servers


Disk Magic HELP

Disk Magic HELP (Release History)


Disk Magic Decimal vs Binary


Note: All capacity inputs to Disk Magic are decimal.Difference between 1 TB and 1TiB is 99,511,627,776 bytes (99.5 GB)


Data Collection Before starting a study determine if you have usable data. GIGO Data Input Types (Two Flavors) (Disk Magic help text contains full

description) Server Level (iostat, perfmon, PT Reports) Storage Controller Level (DS Storage Manager, TPC Disk) If using automated input, try to pull a weeks worth of data representing

heavy time frame e.g. month end in 15 minute intervals. Selecting modeling inputs selecting peaks and noticing anomalies Regardless of the data type there are critical physical disk counters

you need. Read IO Write IO Total IO Read Cache Hits Read xFer size(KB) Write xFer size(KB) Average xFer size(KB)

Refer to General Disk Magic data input requirements.

16


Importance of Calibration Base vs. Solve Creating the baseline model (Base button) enables the

dependent proposed hardware models to be calibrated Mandatory for System z and System i models Not mandatory for open systems modeling

Highly recommended if you have measured cache hit statistics

Create Base ONCE, then use Solve for subsequent what-if scenarios

17

If you learn nothing else in this class learn this:Create Base ONCE, then use Solve for subsequent scenarios


Interpreting and Documenting ResultsGeneral Remarks Document your assumptions. Charts will be generated in Excel, but you can extract them

to include in Powerpoint presentations, etc. Make the graphs your own. You can change labels, colors,

add pictures, manipulate the axis. Try not to document too many proposed solution options. Its

better to stay with as few options as possible and focus on documenting the best one for your customer.

If you get unexpected results, investigate before finalizing documentation.

18


Interpreting and Documenting Results Response Time Components Bar Graph

19

Response Time Components Bar Graph What are we looking for? Equivalent or better response time projections on the proposed options vs current measured.

Interpreting and Documenting Results


Interpreting and Documenting ResultsResponse Time Projections with Increasing IO Line Graph


Response/Service Time with Increasing IO Line Graph What are we looking for? Response/Service time sensitivity at different IO loads. For current peak IO/s load, we want to land in the flat part of the theoretical performance curve.


Interpreting and Documenting Results Response Time Projections with Increasing IO Line Graph

22

FC Adapter Util >100%

HDD Util >100%

Response/Service Time with Increasing IO Line Graph What are we looking for? Response/Service time sensitivity at different IO loads. For current peak IO/s load, we want to land in the flat part of the theoretical performance curve.


Disk Magic Overview

Disk Magic Welcome Screen


Disk Magic - Right-click Options


Disk Magic Welcome Selection


SONAS sizing requires special keyobtained from [email protected]

Disk Magic Project Selection


Disk Magic Open (Easy Tier setting and Hardware Details)


HELP Easy Tier


HELP Easy Tier (Base Calibration)


Easy Tier Base calibration for IBM I coming soon

HELP Real-time Compression


Disk Magic analysis auto input (TPC)


1 Start Disk Magic2 Select New SAN Project

and Press OK



Read the TPC reports (csv)

Select TPC Reports and Press OK



Place TPC data in a Folder - Set Folders and Data locations then Start



The same selection page is presented for the other forms of Automated input.

Disk Magic analysis auto input (TPC) (Excel)


I/O Rate

0.0

5000.0

10000.0

15000.0

20000.0

25000.0

30000.0

J

a

n

/

1

6

/

2

0

1

2

0

0

:

0

0

:

0

0

J

a

n

/

1

6

/

2

0

1

2

0

8

:

0

0

:

0

0

J

a

n

/

1

6

/

2

0

1

2

1

6

:

0

0

:

0

0

J

a

n

/

1

7

/

2

0

1

2

0

0

:

0

0

:

0

0

J

a

n

/

1

7

/

2

0

1

2

0

8

:

0

0

:

0

0

J

a

n

/

1

7

/

2

0

1

2

1

6

:

0

0

:

0

0

J

a

n

/

1

8

/

2

0

1

2

0

0

:

0

0

:

0

0

J

a

n

/

1

8

/

2

0

1

2

0

8

:

0

0

:

0

0

J

a

n

/

1

8

/

2

0

1

2

1

6

:

0

0

:

0

0

J

a

n

/

1

9

/

2

0

1

2

0

0

:

0

0

:

0

0

J

a

n

/

1

9

/

2

0

1

2

0

8

:

0

0

:

0

0

J

a

n

/

1

9

/

2

0

1

2

1

6

:

0

0

:

0

0

J

a

n

/

2

0

/

2

0

1

2

0

0

:

0

0

:

0

0

J

a

n

/

2

0

/

2

0

1

2

0

8

:

0

0

:

0

0

J

a

n

/

2

0

/

2

0

1

2

1

6

:

0

0

:

0

0

J

a

n

/

2

1

/

2

0

1

2

0

0

:

0

0

:

0

0

J

a

n

/

2

1

/

2

0

1

2

0

8

:

0

0

:

0

0

J

a

n

/

2

1

/

2

0

1

2

1

6

:

0

0

:

0

0

J

a

n

/

2

2

/

2

0

1

2

0

0

:

0

0

:

0

0

J

a

n

/

2

2

/

2

0

1

2

0

8

:

0

0

:

0

0

J

a

n

/

2

2

/

2

0

1

2

1

6

:

0

0

:

0

0

J

a

n

/

2

3

/

2

0

1

2

0

0

:

0

0

:

0

0

Interval Time

I/O Rate

Total MB/s

0.0

100.0

200.0

300.0

400.0

500.0

600.0

700.0

800.0

900.0

J

a

n

/

1

6

/

2

0

1

2

0

0

:

0

0

:

0

0

J

a

n

/

1

6

/

2

0

1

2

0

8

:

0

0

:

0

0

J

a

n

/

1

6

/

2

0

1

2

1

6

:

0

0

:

0

0

J

a

n

/

1

7

/

2

0

1

2

0

0

:

0

0

:

0

0

J

a

n

/

1

7

/

2

0

1

2

0

8

:

0

0

:

0

0

J

a

n

/

1

7

/

2

0

1

2

1

6

:

0

0

:

0

0

J

a

n

/

1

8

/

2

0

1

2

0

0

:

0

0

:

0

0

J

a

n

/

1

8

/

2

0

1

2

0

8

:

0

0

:

0

0

J

a

n

/

1

8

/

2

0

1

2

1

6

:

0

0

:

0

0

J

a

n

/

1

9

/

2

0

1

2

0

0

:

0

0

:

0

0

J

a

n

/

1

9

/

2

0

1

2

0

8

:

0

0

:

0

0

J

a

n

/

1

9

/

2

0

1

2

1

6

:

0

0

:

0

0

J

a

n

/

2

0

/

2

0

1

2

0

0

:

0

0

:

0

0

J

a

n

/

2

0

/

2

0

1

2

0

8

:

0

0

:

0

0

J

a

n

/

2

0

/

2

0

1

2

1

6

:

0

0

:

0

0

J

a

n

/

2

1

/

2

0

1

2

0

0

:

0

0

:

0

0

J

a

n

/

2

1

/

2

0

1

2

0

8

:

0

0

:

0

0

J

a

n

/

2

1

/

2

0

1

2

1

6

:

0

0

:

0

0

J

a

n

/

2

2

/

2

0

1

2

0

0

:

0

0

:

0

0

J

a

n

/

2

2

/

2

0

1

2

0

8

:

0

0

:

0

0

J

a

n

/

2

2

/

2

0

1

2

1

6

:

0

0

:

0

0

J

a

n

/

2

3

/

2

0

1

2

0

0

:

0

0

:

0

0

Interval Time

Total MB/s

Write MB/s

0.0

50.0

100.0

150.0

200.0

250.0

J

a

n

/

1

6

/

2

0

1

2

0

0

:

0

0

:

0

0

J

a

n

/

1

6

/

2

0

1

2

0

8

:

0

0

:

0

0

J

a

n

/

1

6

/

2

0

1

2

1

6

:

0

0

:

0

0

J

a

n

/

1

7

/

2

0

1

2

0

0

:

0

0

:

0

0

J

a

n

/

1

7

/

2

0

1

2

0

8

:

0

0

:

0

0

J

a

n

/

1

7

/

2

0

1

2

1

6

:

0

0

:

0

0

J

a

n

/

1

8

/

2

0

1

2

0

0

:

0

0

:

0

0

J

a

n

/

1

8

/

2

0

1

2

0

8

:

0

0

:

0

0

J

a

n

/

1

8

/

2

0

1

2

1

6

:

0

0

:

0

0

J

a

n

/

1

9

/

2

0

1

2

0

0

:

0

0

:

0

0

J

a

n

/

1

9

/

2

0

1

2

0

8

:

0

0

:

0

0

J

a

n

/

1

9

/

2

0

1

2

1

6

:

0

0

:

0

0

J

a

n

/

2

0

/

2

0

1

2

0

0

:

0

0

:

0

0

J

a

n

/

2

0

/

2

0

1

2

0

8

:

0

0

:

0

0

J

a

n

/

2

0

/

2

0

1

2

1

6

:

0

0

:

0

0

J

a

n

/

2

1

/

2

0

1

2

0

0

:

0

0

:

0

0

J

a

n

/

2

1

/

2

0

1

2

0

8

:

0

0

:

0

0

J

a

n

/

2

1

/

2

0

1

2

1

6

:

0

0

:

0

0

J

a

n

/

2

2

/

2

0

1

2

0

0

:

0

0

:

0

0

J

a

n

/

2

2

/

2

0

1

2

0

8

:

0

0

:

0

0

J

a

n

/

2

2

/

2

0

1

2

1

6

:

0

0

:

0

0

J

a

n

/

2

3

/

2

0

1

2

0

0

:

0

0

:

0

0

Interval Time

Write MB/s


Disk Magic analysis auto input (TPC) Did the Autoload of the TPC data work properly?

The charts below are generated (save the Excel file)



Select the desired interval, Add Model, repeat, Finish



And now you are ready to providethe Hardware, Interface, Disk andWorkload information not providedin the Automated input.

The purpose of this study is to document expected performance behavior of the IBM Storwize V3700 storage solutions intended to replace an existing DS4800 storage controller.

Performance statistics from the existing storage controller was provided by customer personnel, using the DS4800 storage manager. 24 hours of data was collected in 96 samples of 15 minutes each for the existing DS4800 controllers. Peak (representative) IOPS and MBs were analyzed.

Solution Options Modeled.

For the database solution, DS4800 4803 peak workloads are modeled on the following configuration: Storwize V3700, single controller, 16 800GB SSD drives (including spares), RAID-5.

Model presumed use of 8 8Gbit/sec FC interfaces41 Copyright IBM Corporation 2014

41

Disk Magic analysis replace DS4800 with Storwize




Synchronize is very powerfuloption which provides same changes to each DSS with the same name.



Synchronize is very powerfuloption which provides same changesto each DSS with the same name.



The Hardware, Interface, Disk andWorkload information are providedand verified. Now select Base.



Synchronize created a Base for both intervals!

Disk Magic analysis replace DS4800 with StorwizeExisting Workload

Peak Workload details 4803 Peak IOPS Peak MBs

Date/ Time of peak Tue Feb 04 03:05:13 2014 Tue Feb 04 02:50:13 2014IOs /sec 3392 2641.2Service time 2 2.01Read % 96.1% 68.1%Write % 3.9% 31.9%Read Hit % 68.2% 42.5%MiB/sec 104.73 184.42Transfer Size Avg (KiB) 31.62 71.5KiB per read IO 31.62 71.5KiB per write IO 31.62 71.5Read Sequential % 40.0% 90.0%Write Sequential % 40.0% 90.0%Write Sequential (Back-End) % 50.6% 93.3%Write Efficiency 21.0% 3.5%Seek % 33.3% 33.3%


This is produced by the Graph Function Workload Overview



Create the Base ONE Time and then all changes are SOLVEs

Go Back to the General tab



General tabChange Hardware Type to IBM V3700Trb (7.3)Go to Interfaces tab



Interfaces tabMake changes if necessaryGo to Open Disk tab



Open Disk tabMake changes if necessaryGo to Open Disk tab



Open Disk tabDisk Magic selected 300 GB RAID 5Notice: 32 drives for similar capacityGo to Open Workload tab



Open Workload tabSelect Solve



After SolveService time is about the samebut has half as many drivesSelect Utilization



All are GreenSelect OK



Customer wants to improve theService TimeGo to Open Disk tab and try SSD



Edit 300GB drives to 800GB SSDSolve



Now the Service Time is .39 ms



HistoryAfter each Base or SolveI renamed the History entry



Document the resultsReport Graph



When Graphing you can use theHistory to graph multiple modelsat the same time.


Disk Magic analysis replace DS4800 with StorwizeDocumenting the results

These are the utilizations This is produced by the Graph Function Utilization Overview

Utilization OverviewConfigurations

IOPS MBS

Utilizations AmberThresholdRed

ThresholdBase # 1 - DS4800 mod80 (DS4803)

S # 1 - V3700 Trb (7.3) 300 GB 8TB (DS4803)

S #2 - V3700 Trb (7.3) 800GB SSD (DS4803)

Base # 1 - DS4800 mod80 (DS4803)

Solve # 1 - V3700 Trb (7.3) (DS4803)

Solve # 1 - V3700 Trb (7.3) (DS4803)

Average SMP 60% 80% 3.6% 7.3%Processor (for I/O) 60% 80% 2.4% 2.4% 2.4% 2.4%Processor (for Compression) 60% 80% 0.0% 0.0% 0.0% 0.0%Average Bus 60% 80% 6.8% 2.9% 2.9% 15.4% 8.0% 8.0%Highest Drive 60% 80% 12.0% 16.0% 1.5% 11.5% 13.4% 3.4%Highest SSD 60% 80% 0.0% 1.5% 0.0% 3.4%Highest HDD (SAS 15k) 60% 80% 16.0% 0.0% 13.4% 0.0%Highest HDD (SAS 10k) 60% 80% 0.0% 0.0% 0.0% 0.0%Highest HDD (SATA/NLSAS) 60% 80% 0.0% 0.0% 0.0% 0.0%Average HA 60% 80% 1.6% 1.6% 2.7% 2.7%Back End Interface 60% 80% 6.8% 2.7% 2.7% 27.5% 5.5% 5.5%Average Host Interface 60% 80% 8.2% 2.9% 2.9% 17.4% 3.8% 3.8%

Synchronize does not apply to renaming History items.


Disk Magic analysis replace DS4800 with StorwizeDocumenting the results


Good Customer Disk Magic (Documenting Results)Comparing Service Times with increasing Workload

Good CustomerService Times with Increasing I/O Rate

0

5

10

15

20

25

30

2000

030

000

4000

050

000

6000

070

000

8000

090

000

1000

0011

0000

1200

00

Total I/O Rate (I/Os per second)

S

e

r

v

i

c

e

T

i

m

e

i

n

m

s

(

O

p

e

n

)

Base # 1 - DS8300 Turbo(Customer DS8300)Service time (ms)DS8870 (8-core) 300GB/15k(Customer DS8300)Service time (ms)DS8870 (8-core) 400GB SSD ET(Customer DS8300)Service time (ms)

Copyright IBM Corporation 2015

Continue growing your IBM skills

ibm.com/training provides acomprehensive portfolio of skills and

careeraccelerators that are designed to

meet all your training needs.

Training in cities local to you - where and when you need it, and in the format you want Use IBM Training Search to locate public training classes

near to you with our five Global Training Providers Private training is also available with our Global Training Providers

Demanding a high standard of quality view the paths to success Browse Training Paths and Certifications to find the

course that is right for you

If you cant find the training that is right for you with our Global Training Providers, we can help. Contact IBM Training at [email protected]

68

Global Skills Initiative

Disk_Magic_Basics_042015.pdf

Documents

Transcript of Disk_Magic_Basics_042015.pdf