Post on 02-May-2018
Chris Churchey – Principal ATS Group, LLCchurchey@TheATSgroup.com (610-574-0207)October 2013
Exploit PowerVM Features to Maximize Performance & Efficiencies
© 2013 IBM Corporation
Exploit PowerVM Features to Maximize Performance & Efficiencies
Exploit PowerVM Features to Maximize
M lti l Sh d
Exploit PowerVM Features to Maximize Performance & Efficiencies
Multiple Shared Processor Pools (MSPP)
© 2013 IBM Corporation2
Exploit PowerVM Features to Maximize Performance & Efficiencies
What is MSPP?
Group of physical processors
Shared among multiple logical partitions
The sum of the assigned capacity for each LPAR cannot exceed the total capacity of the The sum of the assigned capacity for each LPAR cannot exceed the total capacity of the processor group
Applies to Power6 and above
© 2013 IBM Corporation3
Exploit PowerVM Features to Maximize Performance & Efficiencies
Why use MSPPs?
Reduce software license (e.g. # of cores) costs by placing LPAR(s) in their own pool
– Customers have reported saving $100K to >$8M a year
Share the software license across LPAR(s) by placing them in the same pool (e g Float Share the software license across LPAR(s) by placing them in the same pool (e.g. Float across Prod & Dev)
Limit a group of LPAR(s) to a combined MAX CPU consumption to protect others
– Example: Power 770 with 32 cores• Dev LPAR(s) pool Max CPU=5P d LPAR( ) l M CPU 32 (All)• Prod LPAR(s) pool Max CPU=32 (All)
© 2013 IBM Corporation4
Exploit PowerVM Features to Maximize Performance & Efficiencies
MSPP Analysis
1. Identify candidate LPAR(s)
– Software licensed by # of cores currently Dedicated or Capped, or license ALL cores on the server
2 C ll t h i l CPU f did t LPAR( )2. Collect physical CPU usage for candidate LPAR(s)
3. View the candidate LPAR(s) over a period of time
4. Determine usage mix and observed Peaks
– The pool’s Maximum Processing Units = “peak observed + projected growth + buffer”
NOTE: Galileo Performance Explorer makes this easy using Virtual Groups to view candidate LPAR(s)!
© 2013 IBM Corporation5
Exploit PowerVM Features to Maximize Performance & Efficiencies
MSPP Analysis
© 2013 IBM Corporation6
p795 with 23 LPARs, peaking 23 cores
Exploit PowerVM Features to Maximize Performance & Efficiencies
MSPP Analysis
© 2013 IBM Corporation7
Selected 7 Oracle LPARs, peaking 12 Cores
Exploit PowerVM Features to Maximize Performance & Efficiencies
MSPP Analysis
© 2013 IBM Corporation8
“What If” Shared Pool Analysis
Exploit PowerVM Features to Maximize Performance & Efficiencies
MSPP Analysis
© 2013 IBM Corporation9
Performance View of Pool 0 and Pool 1
Exploit PowerVM Features to Maximize Performance & Efficiencies
MSPP Analysis
© 2013 IBM Corporation10
Detailed Performance View of Pool 1 (Oracle Pool)
Exploit PowerVM Features to Maximize Performance & Efficiencies
MSPP Resources
IBM PowerVM Virtualization Introduction and Configuration
http://www.redbooks.ibm.com/abstracts/sg247940.html
Exploiting IBM PowerVM Virtualization Features with IBM Cognos 8 Business Intelligence
http://www.redbooks.ibm.com/abstracts/sg247842.html?Open
Try it! MSPP Pools can be dynamically created move LPAR(s) in & out and Try it! MSPP Pools can be dynamically created, move LPAR(s) in & out, and increase/decrease MAX
ATS can help analyze and implement MSPP
© 2013 IBM Corporation11
Exploit PowerVM Features to Maximize Performance & Efficiencies
Exploit PowerVM Features to Maximize
Sh d Eth t
Exploit PowerVM Features to Maximize Performance & Efficiencies
Shared Ethernet Adapters (SEA)p ( )
© 2013 IBM Corporation12
Exploit PowerVM Features to Maximize Performance & Efficiencies
What is a SEA?
Group Virtual I/O Server component that bridges a physical Ethernet adapter and Ethernet d tadapters
LPAR(s) on the virtual network can share access to the physical network
LPAR(s) on the virtual network can communicate with stand-alone servers and logical partitions on other systems
Eliminates the need for each client logical partition to a dedicated physical adapter
© 2013 IBM Corporation13
Exploit PowerVM Features to Maximize Performance & Efficiencies
Why use SEAs?
Required for Live Partition Mobility (LPM)
Eliminate dedicated adapters to LPARs
Reduce network switches ports and cabling Reduce network switches, ports and cabling
Reduce # of adapters, thus reduce slots/IO-drawers
Share network bandwidth across LPARs
Balance CPU load across VIO’s (1 often 100% Busy)
Maximize network throughput using ALL adapters
© 2013 IBM Corporation14
Exploit PowerVM Features to Maximize Performance & Efficiencies
SEA Options SEA-NIB (Network Interface Backup) + vSwitches
– (2) Virtual Ethernet adapters per LPAR– EtherChannel used on Client LPAR to designate Primary VIO
S i t t b l E /Odd LPAR t i E /Odd VIO– Script to balance Even/Odd LPAR to primary Even/Odd VIO– Preferred for Max Network Throughput and Availability– Multiple VLANs NOT required
SEA-HA (High Availability)– (1) Virtual Ethernet adapter per LPAR– All LPAR(s) network goes through 1 VIO w/failover to 2nd VIO– 2nd VIO Ethernet ports idle, unused performance
SEA-HA Load Sharing (aka Load Balancing)R i lti l VLAN hi h b l d b t VIO’– Requires multiple VLANs which are balanced between VIO’s
– It chooses which VLANs go to which VIO’s– Requires manual ‘chdev’ to restart if failover
© 2013 IBM Corporation15
Exploit PowerVM Features to Maximize Performance & Efficiencies
SEA Architecture – NIB w/vSwitches
1Gb (80-100MB/s) + 1Gb (80-100MB/s)Load Balance=200MB/s
© 2013 IBM Corporation16
Exploit PowerVM Features to Maximize Performance & Efficiencies
SEA Architecture – HA
1Gb (80-100MB/s) 1Gb (80-100MB/s)Backup-Wasted
© 2013 IBM Corporation17
Exploit PowerVM Features to Maximize Performance & Efficiencies
SEA Architecture – HA Load Sharing
1Gb (80-100MB/s) + 1Gb (80-100MB/s)Load Sharing=200MB/s
© 2013 IBM Corporation18
g
Exploit PowerVM Features to Maximize Performance & Efficiencies
SEA Analysis
1. Collect physical CPU and SEA usage for VIO LPARs
View VIO LPARs over a period of time– View VIO LPARs over a period of time
2. Look for:
– 1 VIO with high/max CPU and other minimal– 1 VIO SEA at max throughput (flat line) and other minimal
3. If using SEA-NIB today, balance script on all LPARs
4. If using SEA-HA today, use Load Sharing feature
– NOTE: Galileo Performance Explorer can display this performance information quickly and easily!
© 2013 IBM Corporation19
Exploit PowerVM Features to Maximize Performance & Efficiencies
SEA Analysis - NIB
Host SEA Network Packet Send & Receive Throughput
Host Physical CPU Utilization Summary
© 2013 IBM Corporation20
Exploit PowerVM Features to Maximize Performance & Efficiencies
SEA Analysis - HA Host SEA Network Packet Send & Receive
Throughput Host Physical CPU Utilization Summary
© 2013 IBM Corporation21
Exploit PowerVM Features to Maximize Performance & Efficiencies
Exploit PowerVM Features to Maximize
NPIV SCSI
Exploit PowerVM Features to Maximize Performance & Efficiencies
NPIV vs. vSCSIPerformance
© 2013 IBM Corporation22
Exploit PowerVM Features to Maximize Performance & Efficiencies
What is NPIV and vSCSI?
NPIV Allows a single HBA to register multiple
vSCSI A SCSI disk, or a volume or file in a VIO g g p
WWPNs Each virtual server presents a different
WWPN to the SAN Each virtual server will see its own
,Server that is exported to a virtual IO client LUNs implement a sub-set of the SCSI
protocol Each virtual server will see its own unique storage
protocol
© 2013 IBM Corporation23
Exploit PowerVM Features to Maximize Performance & Efficiencies
Why NPIV over vSCSI?
Higher throughput from client LPAR
Higher IOps from client LPAR
Better hdisk Service Time from client LPAR
Less CPU usage by the VIO LPAR
Load Balance IO across HBAs from client LPAR
© 2013 IBM Corporation24
Exploit PowerVM Features to Maximize Performance & Efficiencies
NPIV vs. vSCSI Architecture
© 2013 IBM Corporation25
Exploit PowerVM Features to Maximize Performance & Efficiencies
NPIV/vSCSI Test configuration
AIX LPAR (gvicaix71-10) on a p700 blade and IVM
– (2) 8Gb HBA to V7000• (4) 100GB vdisks (LUNs) created…same mdisk/array group
(vSCSI) =(2) 100GB LUNs mapped to VIO mkvdev to AIX LPAR– (vSCSI) =(2) 100GB LUNs mapped to VIO, mkvdev to AIX LPAR
• hdisk3 and hdisk4 on gvicaix71-10
– (vfc) =(2) 100GB LUNs mapped to (2) wwpn’s on AIX LPAR
• hdisk1 and hdisk2 on gvicaix71-10
ndisk64 Seq./Random Read/Write 4K/256K tests
© 2013 IBM Corporation26
Exploit PowerVM Features to Maximize Performance & Efficiencies
NPIV/vSCSI Test configuration
© 2013 IBM Corporation27
Exploit PowerVM Features to Maximize Performance & Efficiencies
NPIV vs. vSCSI IOps
NPIV: Over 500 more IOps!
SCSNPIV vSCSI
© 2013 IBM Corporation28
Exploit PowerVM Features to Maximize Performance & Efficiencies
NPIV vs. vSCSI Read Service-Times
NPIV: 0.75msfaster!
NPIV vSCSI
© 2013 IBM Corporation29
Exploit PowerVM Features to Maximize Performance & Efficiencies
NPIV vs. vSCSI Write Service-Times
NPIV: 0.50msfaster!
NPIV vSCSI
© 2013 IBM Corporation30
Exploit PowerVM Features to Maximize Performance & Efficiencies
Questions and AnswersQuestions and Answers
© 2013 IBM Corporation31
Exploit PowerVM Features to Maximize Performance & Efficiencies
We can help analyze and implement. Contact us!
Check-out Galileo Performance Explorer™
– Visit our booth for a hands-on demoComplimentary* no strings attached 6 months use for Conference attendees– Complimentary* no-strings attached 6 months use for Conference attendees
– Budget-friendly subscription pricing request
www.GalileoSuite.com
© 2013 IBM Corporation32
* First time Galileo user
Exploit PowerVM Features to Maximize Performance & Efficiencies
Referenced Material
IBM PowerVM Virtualization Introduction and Configurationhttp://www.redbooks.ibm.com/abstracts/sg247940.htmlhttp://www.redbooks.ibm.com/abstracts/sg247842.html (Managing and Monitoring)
SEA‐NIB vs. SEA‐HA vs. SEA‐HA‐Load Sharinghttps://www.ibm.com/developerworks/mydeveloperworks/blogs/aixpert/entry/shared_ethernet_adapter_sea_failover_with_load_balancing198?lang=enhttps://www ibm com/developerworks/mydeveloperworks/blogs/AIXDownUnder/entry/shared ethernet adapter load sharinhttps://www.ibm.com/developerworks/mydeveloperworks/blogs/AIXDownUnder/entry/shared_ethernet_adapter_load_sharing_and_virtual_switches133?lang=en
SEA‐NIB‐vSwitcheshttp://www‐03.ibm.com/support/techdocs/atsmastr.nsf/fe582a1e48331b5585256de50062ae1c/81c729a840b213b98625779e000722f4/$FIppLE/PowerVM‐VirtualSwitches‐091010.pdfhttp://ibmsystemsmag.blogs.com/aixchange/2011/09/higher‐availability‐for‐vio‐clients‐an‐alternative.html
NPIVhttp://www.ibm.com/developerworks/aix/library/au‐NPIV/index.html
Galileo Performance Explorerhttp://www.galileosuite.com
© 2013 IBM Corporation33
* First time Galileo user