Download - AMI Automatic Mainframe Intelligence: a Self-Managing ... is BMC AMI - NEDBUG final.pdf · • AMI Data Extractor for IMS available now • More AMI Data Extractors coming in 1H 2019

Transcript
Page 1: AMI Automatic Mainframe Intelligence: a Self-Managing ... is BMC AMI - NEDBUG final.pdf · • AMI Data Extractor for IMS available now • More AMI Data Extractors coming in 1H 2019

1© Copyright 12/6/2018 BMC Software, Inc. - BMC Confidential—Internal Use Only

Shery LarsenWorldwide Db2 Z Solutions,

BMC Software

AMI – Automatic Mainframe Intelligence: a Self-Managing Mainframe

© Copyright 2018 BMC Software, Inc

Page 2: AMI Automatic Mainframe Intelligence: a Self-Managing ... is BMC AMI - NEDBUG final.pdf · • AMI Data Extractor for IMS available now • More AMI Data Extractors coming in 1H 2019

Pressures Must be Overcome for Business Success

ITOM Executives

Business & IT Architects

BUSINESS

PRESSURE

Customer Experience

Security &

Data Protection

IoTRegulatoryCompliance

New Technology

Skills

Hybrid Multi-cloud

Transaction & Data Growth

Speed &Agility

Cost Efficiency

© Copyright 2018 BMC Software, Inc

Page 3: AMI Automatic Mainframe Intelligence: a Self-Managing ... is BMC AMI - NEDBUG final.pdf · • AMI Data Extractor for IMS available now • More AMI Data Extractors coming in 1H 2019

KEEP CONFIDENTIAL

You need:

Intelligent software with domain expertise

Proactive early warning

Degradation analysis

Problem remediation, with trusted automation

Mainframe organizations must

take a new approach aimed at self-managing IT.

The Changing Mainframe IT Operations Landscape

© Copyright 2018 BMC Software, Inc

Page 4: AMI Automatic Mainframe Intelligence: a Self-Managing ... is BMC AMI - NEDBUG final.pdf · • AMI Data Extractor for IMS available now • More AMI Data Extractors coming in 1H 2019

4© Copyright 12/6/2018 BMC Software, Inc. - BMC Confidential—Internal Use Only 4© Copyright 2018 BMC Software, Inc.

AI will be Pervasive by 2020

By 2020, 30% of data centers that fail to

apply AI and machine learning effectively in support of enterprise business will cease to be operationally and economically viable.

Gartner Report: The IT Implications of the 2018 CIO Survey for I&O LeadersBy Dave Russell, Hank Marquis Published: 8 March 2018

Key Technology - AI and Machine Learning

Page 5: AMI Automatic Mainframe Intelligence: a Self-Managing ... is BMC AMI - NEDBUG final.pdf · • AMI Data Extractor for IMS available now • More AMI Data Extractors coming in 1H 2019

5© Copyright 12/6/2018 BMC Software, Inc. - BMC Confidential—Internal Use Only 5© Copyright 2018 BMC Software, Inc

Key Technology – Machine LearningMachine learning (ML) is a field of computer science that gives computer systems the ability to "learn" (i.e., progressively improve performance on a specific task) with data, without being explicitly programmed.

- Wikipedia

Artificial intelligence (AI) is the intelligence exhibited by machines or software. It is also the name of the academic field of study which studies how to create computers and computer software that are capable of intelligent behavior.

- Wikipedia

Page 6: AMI Automatic Mainframe Intelligence: a Self-Managing ... is BMC AMI - NEDBUG final.pdf · • AMI Data Extractor for IMS available now • More AMI Data Extractors coming in 1H 2019

6© Copyright 12/6/2018 BMC Software, Inc. - BMC Confidential—Internal Use Only 6© Copyright 12/6/2018 BMC Software, Inc. - BMC Confidential—Internal Use Only

Looking Across Other Industries

Financial Services• “Robo-advisors” in Portfolio

Management• Algorithmic Trading• Fraud Detection

Manufacturing• QA using ML is finding

90% more defects• Reducing supply chain

errors by 50%

Logistics• Lane planning with analytics

on weather or traffic • Natural Language Processing

saves data entry time

Page 7: AMI Automatic Mainframe Intelligence: a Self-Managing ... is BMC AMI - NEDBUG final.pdf · • AMI Data Extractor for IMS available now • More AMI Data Extractors coming in 1H 2019

7© Copyright 12/6/2018 BMC Software, Inc. - BMC Confidential—Internal Use Only 7© Copyright 2018 BMC Software, Inc

Key Technology – Intelligent Alarms

In data mining, anomaly detection (also outlier detection) is the identification of items, events or observations which do not conform to an expected pattern or other items in a dataset. ... Anomalies are also referred to as outliers, novelties, noise, deviations and exceptions.

- Wikipedia

Page 8: AMI Automatic Mainframe Intelligence: a Self-Managing ... is BMC AMI - NEDBUG final.pdf · • AMI Data Extractor for IMS available now • More AMI Data Extractors coming in 1H 2019

The Answer is a Self-Managing MainframeThat Adopts New Key Technologies

• Artificial Intelligence• Machine Learning• Intelligent Automation• Domain Expertise• Out-of-the-Box value

© Copyright 2018 BMC Software, Inc

Page 9: AMI Automatic Mainframe Intelligence: a Self-Managing ... is BMC AMI - NEDBUG final.pdf · • AMI Data Extractor for IMS available now • More AMI Data Extractors coming in 1H 2019

9© Copyright 12/6/2018 BMC Software, Inc. - BMC Confidential—Internal Use Only

AMI’s Advantage BMC• Drive a modern, agile business with AI, machine

learning, predictive analytics, and intelligent automation

• Manage, diagnose, heal, and optimize without manual intervention

We Beat the Competition with a Unique Value Proposition

Super Metrics

Multiple Data Sources

Multiple Products

Multivariate Processing

CLARITY

Page 10: AMI Automatic Mainframe Intelligence: a Self-Managing ... is BMC AMI - NEDBUG final.pdf · • AMI Data Extractor for IMS available now • More AMI Data Extractors coming in 1H 2019

10© Copyright 12/6/2018 BMC Software, Inc. - BMC Confidential—Internal Use Only

Components of a Self-Managing Mainframe

Real-Time Automated Mainframe Intelligence

Embedded Domain Expertise

EnterpriseConnectors

© Copyright 2018 BMC Software, Inc

Page 11: AMI Automatic Mainframe Intelligence: a Self-Managing ... is BMC AMI - NEDBUG final.pdf · • AMI Data Extractor for IMS available now • More AMI Data Extractors coming in 1H 2019

11© Copyright 12/6/2018 BMC Software, Inc. - BMC Confidential—Internal Use Only 11© Copyright 2018 BMC Software, Inc

That can Enable Business Outcomes

Seeing Around the Corner, Preventing a Full System Outage

Detecting and Stopping a Security Threats in Real-Time Saving Money with Real-Time Cost Management

Speeding Application Deployments Safely and Securely

z/OS

IMSDB2

Network

Systems

Machine Learning

(MVP)

User account requires

investigation and activity halting

Prescribed Remediation

Users account revoked

and alert raised. In flight FTP cancelled

Intelligent

Automation

User activity profile

does not match normal

Behavioral

Analysis

Privileged user logs on from

unusual IP address and looks to download data

Intelligent Alarms

CICSMQ

Storage

BMC Automated Mainframe Intelligence

z/OS

IMSDB2

Network

Systems

Machine Learning

(MVP)

Fix index access path

Prescribed

Remediation

Automated SQL tuning

prior to system outage

Intelligent Automation

Access path changes causing

increased get pages

Problem Determination

TranATranB

TranC

KPI1 KPI2 KPI3 KPI4

ü

ü ü

üüPredicted to impact

Production on Monday

Predictive Analysis

TranAApplication is changed over

weekend – CPU usage increase

Intelligent Alarms

TranA

CICSMQ

Storage

BMC Automated Mainframe Intelligence

z/OS

IMSDB2

Network

Systems

Machine Learning

(MVP)

Cap test batch LPARs

Prescribed

Remediation

Automated Cap

adjustment to avoid unexpected jump in

monthly MLC bill

Intelligent Automation

Excessive/unexpected batch

testing is driving higher 4HRA

Problem Determination

Predicted to create

new/higher peak 4-hour rolling avg

Predictive Analysis

4-hour rolling avg approaching

new peak for the month

Intelligent Alarms

CICSMQ

Storage

BMC Automated Mainframe Intelligence

z/OS

IMSDB2

Network

Systems

Machine Learning

(MVP)

User account requires

investigation and activity halting

Prescribed Remediation

Users account revoked

and alert raised. In flight FTP cancelled

Intelligent

Automation

User activity profile

does not match normal

Behavioral

Analysis

Privileged user logs on from

unusual IP address and looks to download data

Intelligent Alarms

CICSMQ

Storage

BMC Automated Mainframe Intelligence

Page 12: AMI Automatic Mainframe Intelligence: a Self-Managing ... is BMC AMI - NEDBUG final.pdf · • AMI Data Extractor for IMS available now • More AMI Data Extractors coming in 1H 2019

12© Copyright 12/6/2018 BMC Software, Inc. - BMC Confidential—Internal Use Only 12© Copyright 2018 BMC Software, Inc

“See Around the Corner”Avoid Full System Outage

Monitor

DB2

IMS

Systems

Network

Machine Learning

Fix index access path

Prescribed Remediation

Automated SQL tuning prior to system outage

Intelligent Automation

Banking application Is changed over weekend – CPU usage increase

Intelligent Alarms

TranA

Predicted to impact Production on Monday

Predictive Analysis

TranA

Access path changes causing increased get pages

Problem Determination

TranA

TranB

TranC

KPI1 KPI2 KPI3 KPI4

✓ ✓

✓✓

Page 13: AMI Automatic Mainframe Intelligence: a Self-Managing ... is BMC AMI - NEDBUG final.pdf · • AMI Data Extractor for IMS available now • More AMI Data Extractors coming in 1H 2019

13© Copyright 12/6/2018 BMC Software, Inc. - BMC Confidential—Internal Use Only 13© Copyright 2018 BMC Software, Inc

Business Agility

DBA Review / Approve

Compare to Production

Build Change File

Meet Best Practice Standards?

Notify of non-compliance

Change Manager

Yes

No

Ap

plic

atio

n D

eve

lop

me

nt

Orc

he

stra

tio

nJI

RA

, ISP

W, J

enki

ns,

BM

C R

LM

Page 14: AMI Automatic Mainframe Intelligence: a Self-Managing ... is BMC AMI - NEDBUG final.pdf · • AMI Data Extractor for IMS available now • More AMI Data Extractors coming in 1H 2019

14© Copyright 12/6/2018 BMC Software, Inc. - BMC Confidential—Internal Use Only 14© Copyright 2018 BMC Software, Inc

Foundation of a Self-Managing Mainframe

Deep and Broad

Data Sources

Built-in Domain Expertise

Multivariate AnalysisOut of the Box

Intelligence

Page 15: AMI Automatic Mainframe Intelligence: a Self-Managing ... is BMC AMI - NEDBUG final.pdf · • AMI Data Extractor for IMS available now • More AMI Data Extractors coming in 1H 2019

Out-of-the-Box Value

Taking the Burden Off of You and Your Teams

or

© Copyright 2018 BMC Software, Inc

Page 16: AMI Automatic Mainframe Intelligence: a Self-Managing ... is BMC AMI - NEDBUG final.pdf · • AMI Data Extractor for IMS available now • More AMI Data Extractors coming in 1H 2019

Deep and Broad Data Sources

• Different products• Db2• CICS• z/OS• IMS• MQ• Network• Etc …

• Different types• MainView• SMF• Recovery logs• Console logs• Logrec

Depth & Breadth of Data

• Baselining• Predictive analysis• Root cause analysis• Model training

Drives ML and AI effectiveness

© Copyright 2018 BMC Software, Inc

Page 17: AMI Automatic Mainframe Intelligence: a Self-Managing ... is BMC AMI - NEDBUG final.pdf · • AMI Data Extractor for IMS available now • More AMI Data Extractors coming in 1H 2019

The Advantage of Domain Expertise

• Machine learning is not magic

• Data science can lead to unintended correlations that are believable

• You need Domain Expertise

© Copyright 2018 BMC Software, Inc

Page 18: AMI Automatic Mainframe Intelligence: a Self-Managing ... is BMC AMI - NEDBUG final.pdf · • AMI Data Extractor for IMS available now • More AMI Data Extractors coming in 1H 2019

18© Copyright 12/6/2018 BMC Software, Inc. - BMC Confidential—Internal Use Only 18© Copyright 2018 BMC Software, Inc.

Multivariate Analysis

Multivariate statistics is a subdivision of statisticsencompassing the simultaneous observation and analysis of more than one outcome variable.

Multivariate statistics concerns understanding the different aims and background of each of the different forms of multivariate analysis, and how they relate to each other.

The ability to watch many different metrics from many different data sources

© Copyright 2018 BMC Software, Inc

Page 19: AMI Automatic Mainframe Intelligence: a Self-Managing ... is BMC AMI - NEDBUG final.pdf · • AMI Data Extractor for IMS available now • More AMI Data Extractors coming in 1H 2019

Rules vs. Machine Learning

19

Rules

• Learned one outage at a time• Too little too late • Too much to watch - Excessive

amount of KPIs mean data overload and inability to reduce data input

• Root cause still unclear

Machine Learning

• Ability to monitor the systems/transactions in a more efficient way

• More sensitivity to data characteristics• Unearth hidden patterns from the data• Build in domain expertise up front relieves

lack of domain expertise on staff• Intelligent models that self assess and allow

automatic retraining to find a new “normal”

© Copyright 2018 BMC Software, Inc

Page 20: AMI Automatic Mainframe Intelligence: a Self-Managing ... is BMC AMI - NEDBUG final.pdf · • AMI Data Extractor for IMS available now • More AMI Data Extractors coming in 1H 2019

Training, Deployment, Scoring

Historical Data

Feature Engineering

Train Evaluate Deploy

New data Score Feedback ReevaluateNew

Historical data

© Copyright 2018 BMC Software, Inc

Page 21: AMI Automatic Mainframe Intelligence: a Self-Managing ... is BMC AMI - NEDBUG final.pdf · • AMI Data Extractor for IMS available now • More AMI Data Extractors coming in 1H 2019

Creating & Using Baseline Models

• Gathers historical data to understand normal - baseline

• Learns special time series data (weekday, weekend, month end , quarter end, “black Friday”.)

• Defines the red, yellow and green range for metrics

• With the baseline, models can now detect anomalies

© Copyright 2018 BMC Software, Inc

Page 22: AMI Automatic Mainframe Intelligence: a Self-Managing ... is BMC AMI - NEDBUG final.pdf · • AMI Data Extractor for IMS available now • More AMI Data Extractors coming in 1H 2019

22© Copyright 12/6/2018 BMC Software, Inc. - BMC Confidential—Internal Use Only

Real Life Scenario Today

Completely Avoidable Complete System Outage

App rebound

•Access path changed

•Tablespace scan

Application Problems

•Uses extra GetPages

•No extra I/O

Extra CPU

•High priority workload

•ALL applications are effected

Peak Production Workload Arrives

•No CPU available

More Threads Allocated

•Cause MORE Contention

•More CPU & Storage

System Runs out of Storage

•Complete system outage

•$$$M

© Copyright 2018 BMC Software, Inc

Page 23: AMI Automatic Mainframe Intelligence: a Self-Managing ... is BMC AMI - NEDBUG final.pdf · • AMI Data Extractor for IMS available now • More AMI Data Extractors coming in 1H 2019

23© Copyright 12/6/2018 BMC Software, Inc. - BMC Confidential—Internal Use Only

Same Scenario Tomorrow

100% Detectable & Avoidable

Application Rebound at weekend

•Access path changes

• Tablespace scan

Pages Loaded Correctly

•No extra I/O

Application Corrected

•Hours in Advance

•Saves $$$M

All the pain is gone!

© Copyright 2018 BMC Software, Inc

Page 24: AMI Automatic Mainframe Intelligence: a Self-Managing ... is BMC AMI - NEDBUG final.pdf · • AMI Data Extractor for IMS available now • More AMI Data Extractors coming in 1H 2019

24© Copyright 12/6/2018 BMC Software, Inc. - BMC Confidential—Internal Use Only 24© © Copyright 2018 BMC Software, Inc

DevOps Drives your Digital Business

Improving Speed is a High Priority

of IT leaders say speed of application/product delivery is a critically or very important KPI

76%

67%

Velocity Gap Slowing Customers Down

of IT leaders say improving the speed of development cycles is a critical or high priority

Page 25: AMI Automatic Mainframe Intelligence: a Self-Managing ... is BMC AMI - NEDBUG final.pdf · • AMI Data Extractor for IMS available now • More AMI Data Extractors coming in 1H 2019

25© Copyright 12/6/2018 BMC Software, Inc. - BMC Confidential—Internal Use Only 25© © Copyright 2018 BMC Software, Inc

PROD

App Dev Orchestration

• JIRA• ISPW• JENKINS• BMC RLM

Database changes

Change Manager

Compare to Production

CHG FILE

Start over if not compliant

Discuss Changes After

Testing

Review Changes for Compliance

SQL Performance

Start over if performance Issue

Today’s Velocity Gap is Inefficient

Application Developer

DBA

Page 26: AMI Automatic Mainframe Intelligence: a Self-Managing ... is BMC AMI - NEDBUG final.pdf · • AMI Data Extractor for IMS available now • More AMI Data Extractors coming in 1H 2019

26© Copyright 12/6/2018 BMC Software, Inc. - BMC Confidential—Internal Use Only 26© Copyright 2018 BMC Software, Inc

Automate Database Changes in DevOps

DBA Review / Approve

Compare to Production

Build Change File

Meet Best Practice Standards?

Notify of non-compliance

Change Manager

Yes

No

Ap

plic

atio

n D

eve

lop

me

nt

Orc

he

stra

tio

nJI

RA

, ISP

W, J

enki

ns,

BM

C R

LM

Page 27: AMI Automatic Mainframe Intelligence: a Self-Managing ... is BMC AMI - NEDBUG final.pdf · • AMI Data Extractor for IMS available now • More AMI Data Extractors coming in 1H 2019

27© Copyright 12/6/2018 BMC Software, Inc. - BMC Confidential—Internal Use Only 27© Copyright 2018 BMC Software, Inc

External: What is AMI?

BMC AMI Enterprise ConnectorsGetting your Z information connected to the rest of your enterprise• AMI Data Extractor for IMS available now• More AMI Data Extractors coming in 1H 2019

BMC AMI Autonomous Solutions*

Intelligent, policy driven, integrated solutions to power self-managing mainframes• AMI Security management• AMI DevOps • AMI Performance and Availability management• AMI Cost and Capacity management

*Multiple products releasing over the next five quarters

Advanced Solutions and Capabilities in the BMC Z Portfolio that Incorporate Automation, Machine Learning, Analytics, and Artificial Intelligence

Page 28: AMI Automatic Mainframe Intelligence: a Self-Managing ... is BMC AMI - NEDBUG final.pdf · • AMI Data Extractor for IMS available now • More AMI Data Extractors coming in 1H 2019

28© Copyright 12/6/2018 BMC Software, Inc. - BMC Confidential—Internal Use Only 28© © Copyright 2018 BMC Software, Inc

Current Capabilities

✓ Intrusion detection✓Automatic tracing✓ Threshold analytics✓ Smart Alarms✓Performance predictions✓ SQL workbench✓ One-button IPL✓ Secure HMC management✓ Dynamic capping✓ IMS scheduling wizard

✓ Transaction details✓MainView - IMS log integration✓Automated reorg✓Online reorg✓MLC peak reporting✓ MLC predictions✓ Automatic restart✓ Subsystem redundancy✓ NGT SmartSwitch

Page 29: AMI Automatic Mainframe Intelligence: a Self-Managing ... is BMC AMI - NEDBUG final.pdf · • AMI Data Extractor for IMS available now • More AMI Data Extractors coming in 1H 2019

© Copyright 2018 BMC Software, Inc.