OpenStack on IBM Z Update with focus on DPM · Client library written in Python for easy...

© 2018 IBM Corporation

OpenStack on IBM Z

Update with focus on DPM

Andreas [email protected]

03/2018

© 2018 IBM Corporation4

IBM Z

IaaS Model vs. Traditional IT Model

IaaS Traditional IT

Consumption Model On Demand Self Service Request to Resource Owner

Scaling out up

Life Cycle “Cattle” “Pets”

Hardware cost optimized premium

Applications expect HW outage rely on HW HA

Reliability via software via hardware (+ firmware)

Note: The table shows the extremes, real life is more „mixed“...


IBM Z

Why run IaaS apps on IBM Z / LinuxONE?

● Linux application needs data from z/OS

● Enjoy IaaS benefits when application is not „born in the cloud“

● Benefit from mature Z operations model for IaaS apps

● Exploit Z specific features for IaaS apps

● Secure Service Containers● Vertical Scaling● Crypto● Hipersockets


IBM Z

Why use OpenStack for existing Z Linux apps?

● Improve operational efficiency by applying IaaS model

● Provide self-service to users

● Use SW orchestration products that consume OpenStack (e.g. IBM Cloud Private, VMware vRealize Automation)

● Hide complexity of Z platform from users, but provide its benefits under the covers

● Use cross-platform applications with the same control plane

● Modernize the operations model and IT skills

● Buy vs. Make for customer-developed automation tooling


IBM Z

OpenStack abstracts platform resources

OpenStack provides abstract resources to users:

● Servers● Logical Networks● Volumes (Block Storage)● Object Storage

OpenStack users● Manage abstract resources● Does not need to understand the Z

platform

OpenStack admin● Maps OpenStack resource

abstractions to platform resources● Has to understand the Z platform

API / CLI / GUI

IBMSystem

Storage®IBM Z®

OpenStack AdminOpenStack Users

ManageAbstractResources

ManagesOpenStack

Physical Networks

Logical Networks VolumesServers


IBM Z

SAHARAElastic Map Reduce

NOVACompute

NEUTRONNetworking

CINDERBlockStorage

SWIFTObjectStorage

KEYSTONEIdentity

GLANCEImage

Core Services „Big Tent“

ZAQARMessaging Service

HEATOrchestration

CONGRESSGovernance Service

MAGNUMContainer Service

MANILAShared Filesystems

CEILOMETERTelemetry

IRONICBare-Metal Provisioning

HORIZONDashboard

MURANOApplication Catalog

MISTRALWorkflow Service

DESIGNATEDNS Service

TROVEDatabase

BARBICANKey Management

OpenStack Project Navigator: https://www.openstack.org/software/project-navigator/

Projects within OpenStack

AND MANY MORE...


IBM Z

Adoption of OpenStack releases (4/2017)

Source: https://www.openstack.org/assets/survey/April2017SurveyReport.pdf


IBM Z

OpenStack on Z and LinuxONE

Hypervisor OpenStack release

OpenStack products

z/VM >= Liberty CMA(1)SUSE OpenStack Cloud

KVM >= Mitaka Ubuntu OpenStack

PR/SM (DPM mode) >= Ocata upstream(2)

(1) CMA: „Cloud Manager Appliance“, a component of IBM z/VM 6.3 or higher, can be used with SUSE OpenStack Cloud or standalone.http://www.vm.ibm.com/sysman/osmntlvl.html

(2) Community support


IBM Z

Community Support of Upstream OpenStack

● 2 stable releases + “master” branch are supported

● => EOL at ~12 months after release

● OpenStack products are typically supported for a longer period

Source: https://releases.openstack.org/

https://www.openstack.org/software/project-navigator/


IBM Z

Ubuntu OpenStack support periods

Source: https://www.ubuntu.com/info/release-end-of-life

KVM on Z


IBM Z

Introducing: Dynamic Partition Manager

KVM z/VM

PR/SM

SE HMC

DPM

SE SEBuilt-inHCD

SSC


IBM Z

Introducing DPM

● A new administrative mode, IBM Dynamic Partition Manager (DPM), was introduced for Linux-only systems starting with IBM z13 and LinuxONE

● A system can be configured in either DPM mode or Standard mode. The mode is enabled prior to system power-on reset (POR)

● DPM mode provides dynamic I/O management capabilities using the Hardware Management Console (HMC)


IBM Z

Re-thinking mainframe mgmt jointly with our users

● Dynamic mainframe infrastructure management including dynamic I/O management allowing for end-to-end automation.

● Integrated workflow by replacing existing tooling that today is spread across multiple management end points.

● Simplified and consumable mainframe experience reducing the barriers of adoption for new and existing clients.

● User experience is inspired by industry standard methodology and terminology.

● Design team using Design Thinking and interaction with Z customers.

https://www.openstack.org/assets/survey/April2017SurveyReport.pdf


IBM Z

Result: Integrated & Consistent User Experience


IBM Z

The Power of DPM

● Creation of partitions:

● Several days —> 10 minutes● Several System Administrators —> Single System Administrator

● Modify resources:

● Several hours —> minutes● Several System Administrators —> Single System Administrator

● Gain Insights:

● Monitoring data —> Insights over time


IBM Z

● Not overcommitting memory is sometimes a benefit

● Large database installations

● Reduced virtualization overhead

● Particularly important for production workloads

● Better I/O performance

● For I/O critical workloads (especially true for PCI devices and DASD)

● Better SMT performance

● PR/SM uses real SMT, KVM uses SMT via logical CPUs

● SW licencing cost

● Partitions provide isolation that can fence SW license cost

● Secure Service Containers

● Only supported in partitions (DPM and Standard mode)

Why supporting DPM for OpenStack?


IBM Z

OpenStack Compute Node

OpenStack for DPM: Topology

CPC

HMC

OpenStack Compute Node(for DPM)

Web Services API

OpenStack Controller Node

Horizon UI

Neutron Nova

zhmcclient

Neutron

Glance Cinder

Nova

Horizon Keystone

Guests:RHEL 7SLES 12Ubuntu 16

SE CPCSE

OpenStack Compute Node

http://www.vm.ibm.com/sysman/osmntlvl.html


IBM Z

OpenStack for DPM: CPC subsetting

● OpenStack manages the compute resources:

● You give compute HW to OpenStack● OpenStack uses all of it for hosting virtual servers

● OpenStack for DPM supports „CPC subsetting“

● Give only a portion of a CPC to OpenStack● OpenStack treats each CPC subset as a hypervisor host

● CPC subsets are defined by OpenStack configuration

https://releases.openstack.org/


IBM Z

OpenStack for DPM: Guest Operating Systems

● Guest operating systems:

● SLES 12● RHEL 7● Ubuntu 16● KVM for IBM z Systems (EOM)● Any Linux on s390x with cloudinit (e.g. Fedora, CentOS)

https://www.ubuntu.com/info/release-end-of-life


IBM Z

OpenStack releases supporting DPM - Roadmap

OpenStack Ocata (2/2017):

● Initial release for DPM, with limitations● Requires DPM rel.1 (introduced with z13 GA2) or higher

OpenStack Pike (8/2017):

● Requires DPM rel.2 (z13 post GA2 level from 04/2017) or higher

OpenStack Queens (2/2018):

● Requires DPM rel.2 as minimum, and exploits DPM rel.3 (z14 GA1) if present

OpenStack Rocky (8/2018):

● Requires DPM rel.2 as minimum, and exploits new DPM features in z14 if present

2017 2018

Ocata Pike Queens Rocky

DPMrel.1

DPMrel.2

DPMrel.3

2019


IBM Z

OpenStack for DPM Documentation

• Documentation is hosted on:http://nova-dpm.readthedocs.io/en/latest/

http://networking-dpm.readthedocs.io/en/latest/


IBM Z

zhmcclient

● Client library written in Python for easy consumption of the HMC Web Services API

● Encapsulates REST over HTTPS and JMS protocols

● Supports CPCs in DPM mode and in Standard mode

● Initiated as part of the OpenStack for DPM work

● Useable in a broad context beyond OpenStack:

● Scripting for operational tasks● Your own automation tools● Metal-as-a-Service● Automation with Ansible, Salt, Chef, Puppet, ...

● Includes a CLI

● Download and try today: https://github.com/zhmcclient


IBM Z

zhmcclient: Topology

CPC

HMC

Web Services API

zhmcclient (Python library)

CPCs can be in standard mode or in DPM mode

SE CPCSE

zhmc (CLI)

Shell Scripts

Python Apps

z/OS z/VM z/VSE

Customerwritten

zhmcclientproject

Ansible playbooks

zhmc Ansible module


IBM Z

Summary

● IaaS model vs Traditional IT model

● Brief overview on OpenStack in general and on Z

● Brief introduction of DPM on Z

● OpenStack for DPM

● zhmcclient for Python

OpenStack on IBM Z Update with focus on DPM · Client library written in Python for easy...

Documents

Transcript of OpenStack on IBM Z Update with focus on DPM · Client library written in Python for easy...