© 2008 IBM Corporation

Considerations for Managing Resource Pools

Michael HooIBM BladeCenter Technology EvangelistFeb 2009

© 2008 IBM Corporation

HW HW HW HW HW

HW HW HW HW HW

HW HW

HW HW

HW

HW

HWHW

Capacity Management Transformed

VIRTUALIZEDPHYSICAL POOLED

Logical Resource Pools (RP)

Distributed Resource Scheduler (DRS)

© 2008 IBM Corporation

HW HW HW HW HW

HW HW HW HW HW

HW HW

HW HW

HW

HW

HWHW

Capacity Management Transformed

POOLED

Logical Resource Pools (RP)

Distributed Resource Scheduler (DRS)

© 2008 IBM Corporation

HW HW HW HW HW

HW HW HW HW HW

HW HW

HW HW

HW

HW

HWHW

POOLED

Capacity Management Transformed

RP1

RP2

Logical Resource Pools (RP)

Distributed Resource Scheduler (DRS)

© 2008 IBM Corporation

HW HW HW HW HW

HW HW HW HW HW

HW HW

HW HW

HW

HW

HWHW

Capacity Management Transformed

POOLED

RP1

RP2

Logical Resource Pools (RP)

Distributed Resource Scheduler (DRS)

© 2008 IBM Corporation

Defining a Compute Resource

Compute Resource is the aggregation of computing powers from a set of hosts.

– Special case: a Compute Resource with only one host is a standalone compute resource.

– Compute Resource with multiple hosts is a cluster.

– Currently, only cpu + memory are available as aggregations.

ClusterStand-alone host

orComputeResource:

© 2008 IBM Corporation

ClustersThe Power of Many Hosts, the Simplicity of One

� Reduce management complexity by combining stand-alone hosts into clusters for higher availability and more flexible resource controls

Stand-alone hosts

CPU = aMem = x

CPU = bMem = y

CPU = cMem = z

Cluster

Pooled ResourcesCPU = a+b+cMem = x+y+z

AvailabilityTransparent failover

© 2008 IBM Corporation

Clusters are..Collection of ESX Hosts and VMs

� Hosts resources become part of cluster resource

� Shared resources with a shared managed interface

� Enabled for DRS, HA or both

Cluster

Pooled ResourcesCPU = a+b+cMem = x+y+z

AvailabilityTransparent failover

© 2008 IBM Corporation

Copyright

©

2006

VMware,

Inc.

All

rights

res

Distributed Resource Scheduling

�Global scheduler– Automates initial virtual machine placement

– Uses VMotion to continuously optimize based on current workload

– Reacts to adding or removing hosts from the cluster

�Achieve >80% utilization

VM VM VM

ESX Server

VM VM

ESX Server

VM VM VM

ESX Server

VirtualCenter

Cluster

Global Scheduler

Local Scheduler Local Scheduler Local Scheduler

VMVM VMVM

© 2008 IBM Corporation

What does DRS do? 1

� Initial placement – When you first power on a virtual machine in the cluster

• Output is recommended host list (prioritized list)

• Manual Mode

> Recommends placement. Admin chooses.

• Partially Automated Mode and Fully Automated:

> Places VM on host. No recommendations.

�Runtime operations– Load Balancing

• Manual Mode and Partially Automated Mode

> Recommends placement. Admin chooses.

• Fully Automated:

> Migrates VMs as required. No recommendations.

Distributed Resource Scheduling

© 2008 IBM Corporation

Resource Pools

Resource Pools subdivide computing resources in a cluster

� Virtual machines draw resources from their resource pools

� Resource allocations can be changed dynamically

� Resource pools can be nested

Cluster capacity:5 x (4.8 GHz, 4 GB)= (24 GHz, 20 GB)

Floating capacity:5 GHz, 5 GB

Resource Pool 1(CPU = 16 GHz, Mem = 12 GB)

VM VM VM VM

Resource Pool 2(3 GHz, 3 GB)

VM VM VM

© 2008 IBM Corporation

Resource Pools

Virtual Machine Containers with Assigned Resources

� With resource pools you can…

– Let a user create and run as many virtual machines as desired while limiting the total resources used

– Instantly add extra resources to an enterprise application

– Delegate control over assigning resources to virtual machines while maintaining complete control over hardware

Resource Pool(CPU= 8 GHz, Mem = 6 GB)

VM VM VM VM

© 2008 IBM Corporation

� Note: Virtual Machines resources cannot be run across two or more physical hosts

Virtual Machine Constraints

*http://www.vmware.com/pdf/vi3_35/esx_3/r35u2/vi3_35_25_u2_config_max.pdf

VM

© 2008 IBM Corporation

� Virtual Machines can only run on ONE host at any given time

� Virtual Machines cannot aggregate resources across standalone hosts or hosts in a cluster

Virtual Machine Constraints

VM VM VMVM VM VMVM

X

© 2008 IBM Corporation

ESX Host Constraints

*http://www.vmware.com/pdf/vi3_35/esx_3/r35u2/vi3_35_25_u2_config_max.pdf

© 2008 IBM Corporation

2009

Storage

Networking

Virtual Machines

CPU

Memory

Highest Single ServerResource Efficiency

128 cores and 512 GB of physical RAM�Hardware Scale Out

Lowest CPU overhead � HW Assist� Purpose Built Scheduler

Maximum memory efficiency

� HW Assist� Page Sharing� Ballooning

Wirespeed (9Gb today) network access

�VMDirectPath�Offload

Greater than 200k iopsper second

Lower than 2ms latency

�VMDirectPath�Para-virtualized SCSI

ESX Server

App

OS

App

OS

App

OS

App

OS

App

OS

8-way vSMP and 256 GB of RAM per VM

�Virtual hardware scale out

vCompute

© 2008 IBM Corporation

Perfect for:

XpandOnDemandXpandOnDemand™™ ScalabilityScalability

Modular Building-block Scalability eliminates the need for fork-life upgrades and provides an easier growth path to

larger, scale-up high-performance SMP configurations

Leadership Scaling Solution…

x3850M2, 2w-4w •Single Chassis•Up to 24 cpu cores •Up to 256GB Memory

x3850M2 + ScaleXpander+ x3950M2•Two Chassis 8-way•Up to 48 cpu cores•Up to 512GB Memory

x3850M2 + ScaleXpander+ 3*x3950M2•Four Chassis 16-way•Up to 96 cpu cores•Up to 1TB Memory

ScaleXpander

x3850M2 + ScaleXpander+ 2* x3950M2•Three Chassis 12-way•Up to 72 cpu cores•Up to 768GB Memory

© 2008 IBM Corporation

18

IBM X-Architecture Building proven IBM enterprise capability into the industry standard space

A design blueprint for building proven IBM enterprise capability into the industry-standard product line

IBM System zIBM System pIBM System i

IBM System x

IBM BladeCenter

Ease of use Industry standard

technologies

Availability

Manageability

Clustering

Scalability

Solutions

Performance

© 2008 IBM Corporation

Enhanced VMotion Compatibility (EVC)VM running on server esx01 to be moved to esx02

Provision VM on esx02, pre-copy memory & CPU state from esx01 to esx02, log changes to a bitmap

Delete virtual machine from esx01VMotion Successfully Completed…

1

2 5

Suspend the VM on esx01 and copy changed memory to esx023

Resume VM on esx024

Memory and CPU State copied to the target host!

Requirement: Source and destination hosts must have compatible CPU models

© 2008 IBM Corporation

EVC Requirements - Summary

�All hosts in the cluster should have ESX3.5 U2

�Intel VT and Execute Disable (XD) flag needs to be enabled in BIOS for systems in EVC enabled clusters

�Hosts should have Intel® Xeon® 3200, Intel® Xeon®

5300, Intel® Xeon® 7300 or later processors

�No VMs should be active on a host when being added to the EVC cluster

�EVC can be enabled/disabled from Virtual Center.

�Need the latest version of Virtual Center (VC2.5 U2) to enable EVC

© 2008 IBM Corporation

Planning Tips - Cluster

© 2008 IBM Corporation

�Hosts must have sufficient resources:

– Aggregate unreserved capacity

– Per-core capacity

�Enable DRS Cluster Automation

– Let DRS autonomously manage most VMs:

• Use manual mode for critical VMs if conservative

• Use automated for non-critical VMs

• But base it on your comfort level –environment, experience etc.

� Larger servers will be able to provide CPU cycles and cater to spikes more effectively

Planning Tips - Cluster

© 2008 IBM Corporation

� Tedious to manage resources on VM level.

� Leverage on resource pools to manage groups of VMs instead of individual VMs.

�Use Fixed Reservation for parent resource pool.

�Plan for Nested Resource Pools effectively.

�Set appropriate shares for Prod vs Dev RPs.

Planning Tips – Resource Pools

© 2008 IBM Corporation

Dynamically Manage Resources- Not a Server, It’s a Pool of Resources

OS

App

OS

App

OS

App

OS

App

OS

App

OS

App

OS

App

OS

App

OS

App

Virtualized SAN and Network InfrastructureVirtualized SAN and Network Infrastructure

OS

App

X

OS

App

OS

App

OS

App

OS

App

© 2008 IBM Corporation25

IBM provides an integrated solution to help simplify IT Operations – IBM® Systems Director 6.1

Reducing complexity with integrated platform and enterprise service management

Deploying and managing virtual servers to control data center space

Managing energy usage helps meet “green”initiatives and cost objectives

IBM Systems Director – at the core of an

IT management strategy – can reduce

the costs of IT service delivery, improve

business resiliency and security, and

help meet energy usage requirements

IBM System x and BladeCenter

© 2008 IBM CorporationIBM Systems Director 6.126

IBM Offers End-to-

End Management

Hardware

Other Systems Management Software

Ac

tiv

e E

nerg

y M

an

ag

er

$$

Imag

e M

an

ag

em

en

t

$$

TP

MfO

SD

$$

Automation

Status

Configuration

Discovery

Update

Remote Access

Virtualization Core Director Services

Configuration

System x & Blade Center

System z

Power Systems

Storage Configuration

$$

Ad

dit

ion

al P

lug

-In

s

Ad

dit

ion

al P

lug

-In

s

Ad

dit

ion

al P

lug

-In

s

Ad

dit

ion

al P

lug

-In

s

BO

FM

$$

Serv

ice a

nd

Su

pp

ort

M

an

ag

er

Ad

dit

ion

al P

lug

-In

s

$$

Managed virtual and physical environments

Resource Management

Base Systems Director Managers & HardwarePlatform Managers

Enterprise ServiceManagement

Advanced Managers&Priced Plug-Ins

IBM and non-IBM hardware

© 2008 IBM Corporation

New in IBM® Systems Director 6.1� Simplified Getting Started

– Start, Manage, Learn

� Focus on Health, Automation

– Health Summary

– Monitors, Thresholds, Updates

– Automation Plans

� Easy to Navigate Web-based UI

– Intuitive drilldown and Views

– Topology map

� Integrated Management of Virtual Resources

– Create virtual server

– Edit virtual resources

– Relocate

– Deploy Images*

� Plug-Ins for advanced platform management*

27

* Staged Features

© 2008 IBM Corporation28

Virtualization Manager Portal

• View problems with virtual servers

• Install virtualization sub-agents for use with Director

• Create virtual servers

• Create virtual Farms

• Relocate virtual servers

• Quick navigation to virtual servers and hosts

© 2008 IBM Corporation29

Virtualization Resources – Resource View

VM Host

Guest VM’s

Power State Resource Utilization

Resource Allocation

© 2008 IBM Corporation30

Virtualization Interface Launch in Context – VI3 & MSVS

© 2008 IBM Corporation31 31

Virtualization Resources – Map View

© 2008 IBM Corporation

IBM and VMware enables the

“Virtual SMB DataCenter in a Box”

© 2008 IBM Corporation

� Manually balance

compute workloads

� Zero Downtime

maintenance

The power of BladeCenter S with VMware VMotion technology

� Storage migration

and flexibility with

storage VMotion

No downtime for your OS and Applications

33

© 2008 IBM Corporation

With an all-in-one approach, an entire VMware stack (servers, networking, storage), can all be

installed in one BladeCenter S chassis, all without having to cable up anything but the power!

The BladeCenter S full-featured SAN

Fully enables VMware and VMotion

Full report on RSSM on the VMware Hardware Compatibility List: click on VMware HCL*

*http://www.vmware.com/resources/compatibility/search.php?action=search&deviceCategory=san&

productId=1&keyBasic=RAID&maxDisplayRows=50&key=&release%5b%5d=-1&datePosted=-134

© 2008 IBM Corporation

– Simplifies and automates disaster recovery workflows:

• Setup, testing, failover

– Turns manual recovery runbooks into automated recovery plans

– Provides central management of recovery plans from VirtualCenter

Introducing VMware Site Recovery Manager

Works with VMware Infrastructure to make disaster recovery rapid, reliable, manageable, affordable

Site Recovery Manager leverages VMware Infrastructure to deliver

advanced disaster recovery management and automation

© 2008 IBM Corporation

Protected

Site

Recovery

Site

VirtualCenter Site Recovery Manager

VirtualCenter Site Recovery Manager

Datastore Groups

Array Replication

Datastore Groups

Site Recovery Manager At A GlanceSite A Site B

© 2008 IBM Corporation

Protected

Site

Recovery

Site

VirtualCenter Site Recovery Manager

VirtualCenter Site Recovery Manager

Datastore Groups

Array Replication

Datastore Groups

Protected VMs

Protected VMs

online in Protected Site

offline

Site A Site BSite Recovery Manager At A Glance

© 2008 IBM Corporation

Protected

Site

Recovery

Site

VirtualCenter Site Recovery Manager

VirtualCenter Site Recovery Manager

Datastore Groups

Array Replication

Datastore Groups

Protected VMs

Protected VMs

become unavailable

Site A Site BSite Recovery Manager At A Glance

© 2008 IBM Corporation

Protected

Site

Recovery

Site

VirtualCenter Site Recovery Manager

VirtualCenter Site Recovery Manager

Datastore Groups

Array Replication

Datastore Groups

Protected VMs

Protected VMs powered on

become unavailable

Site A Site B

Recovery

Site

Protected

Site

SRM Supports

bi-directional

Site protection

Site Recovery Manager At A Glance

© 2008 IBM Corporation

IBM Certified Storage Replication Adapters: SVC, DS4000, DS5000, DS8000, N-Series

Servers

Storage Certification Update for SRM

VMware Infrastructure

Virtual Machines

VirtualCenterSite

Recovery Manager

Servers

VMware Infrastructure

VirtualCenterSite

Recovery Manager

Partner Replication

Site Recovery Manager

Protected virtual machines

Virtual Machines

Production Disaster Recovery

Servers

Storage

SVC

.

DS4000

DS8000DS5000

Storage

.

DS4000SVC

DS8000

DS5000

Partner Replication

New!

© 2008 IBM Corporation41

IBM Virtualized Systems Infrastructure

IBM Systems Director

IBM TotalStorageProductivity Center

IBM Tivoli Service Management Family

Applications

Service Management

Platform management tools

ServerVirtualization

StorageVirtualization

Disk, File & Tape

Hardware

Virtualization Software

Operating Systems

IBM Systems

Director Family

IBM

TotalStorage

Productivity

Center

© 2008 IBM Corporation

Thank You