Unleashing the power of machine learning for it ops management

29
Unleashing the Power of Machine Learning Faster, More Accurate IT Operations Analytics Jason Bloomberg President [email protected] @theebizwizard

Transcript of Unleashing the power of machine learning for it ops management

Page 1: Unleashing the power of machine learning for it ops management

Unleashing the Power of Machine Learning

Faster, More Accurate IT Operations Analytics

Jason BloombergPresident

[email protected]

@theebizwizard

Page 2: Unleashing the power of machine learning for it ops management

Copyright © 2015, Intellyx, LLC2

About Jason Bloomberg

• President of industry analyst firm Intellyx

• Agile digital transformation thought leader

• Write for Forbes, several blogs, biweekly newsletter the Cortex

• Buy my latest book, The Agile Architecture Revolution

Page 3: Unleashing the power of machine learning for it ops management

3

What is Digital?

Customer preferences & behaviordrive technology choices

Range of technology touchpoints is exploding

Copyright © 2015, Intellyx, LLC

Phot

o Cr

edit:

Rev

ol W

eb h

ttps:

//www

.flick

r.com

/pho

tos/

revo

lweb

/

Page 4: Unleashing the power of machine learning for it ops management

Copyright © 2015, Intellyx, LLC4

Customer Needs Begin with the Device

• Enterprises must connect devices to back-end technology

• Must perform every time, in real-time

Everything is in flux Phot

o Cr

edit:

Willi

am M

urph

y ht

tps:/

/www

.flick

r.com

/pho

tos/

info

mat

ique

/

Page 5: Unleashing the power of machine learning for it ops management

Copyright © 2015, Intellyx, LLC5

IT Ops – The Good Old Days

• Physical servers, networks, and everything else

• Well-defined perimeters• Fixed, tightly coupled

integrations• Infrequent, carefully

planned changes• Formal processes• Centrally managed,

internal ops teams

Phot

o Cr

edit:

Sea

ttle

Mun

icipa

l Arc

hive

s http

s://w

ww.fl

ickr.c

om/p

hoto

s/se

attle

mun

icipa

larc

hive

s/

Page 6: Unleashing the power of machine learning for it ops management

Copyright © 2015, Intellyx, LLC6

Welcome to Today’s Digital World!

• Virtual, software-defined everything– Servers, networks, etc.

• “Borderless” applications– Perimeters of little use

• Integration via loosely-coupled APIs

• Frequent, “continuous” change

• Velocity trumps formal processes• DevOps driving cross-organizational team

structures

Phot

o Cr

edit:

Hig

hway

s Eng

land

http

s://w

ww.fl

ickr.c

om/p

hoto

s/hig

hway

sage

ncy/

Page 7: Unleashing the power of machine learning for it ops management

The Frictionless Enterprise

• Technology extends beyond the corporate perimeter

• Customers demand high-performance, end-to-end capabilities

• Business and technology ecosystems become central organizing principle

Copyright © 2015, Intellyx, LLC7

Reducing friction for borderless enterprises

Phot

o Cr

edit:

RyA

weso

me

http

s://w

ww.fl

ickr.c

om/p

hoto

s/ry

awes

ome/

Page 8: Unleashing the power of machine learning for it ops management

Copyright © 2015, Intellyx, LLC8

IT Operations Management Challenges

• Digital performance is an end-to-end, top-to-bottom challenge

• Network, hardware, physical & virtual infrastructure, containers/runtime, and applications must all perform

• Everything is always subject to change

Manage all the Things!

Phot

o Cr

edit:

Inte

l Fre

e Pr

ess h

ttps:

//www

.flick

r.com

/pho

tos/

inte

lfree

pres

s/

Page 9: Unleashing the power of machine learning for it ops management

Copyright © 2015, Intellyx, LLC9

Traditional Ops Management Falls Short

• Static thresholds– Unrealistic, lead to

alert storms• Siloed management

– Leads to war room fingerpointing, long delays

• “What changed” root cause analysis– Doesn’t work in

environments of frequent, rapid change

Phot

o Cr

edit:

Lad

y Dr

agon

fly h

ttps:

//www

.flick

r.com

/pho

tos/

lady

drag

onfly

herw

orld

/

Page 10: Unleashing the power of machine learning for it ops management

Copyright © 2015, Intellyx, LLC10

Machine Learning

• Recognize complex patterns of behavior that evolve over time

• Increasingly intelligent anomaly detection

Phot

o Cr

edit:

Pau

l Ink

les h

ttps:

//www

.flick

r.com

/pho

tos/

dum

fsta

r/

Price of Admission for Modern IT Ops Management

Page 11: Unleashing the power of machine learning for it ops management

Copyright © 2015, Intellyx, LLC11

SIOS iQ’s Innovative Approach:Graph Technology & Topological

Behavioral Analysis

• Correlate data across large numbers of nodes

• Cascading dependencies

• Sophisticated recommendations for addressing complex issues

Phot

o Cr

edit:

Noa

h Su

ssm

an h

ttps:

//www

.flick

r.com

/pho

tos/

thef

angm

onst

er/

Page 12: Unleashing the power of machine learning for it ops management

Jason BloombergPresident, Intellyx

[email protected]

@theebizwizard

Send email NOW to [email protected] to download this presentation

Thank You!

Page 13: Unleashing the power of machine learning for it ops management

http://us.sios.com

SIOS iQ™IT Operations Analytics Platform

for Virtualized Environments

Jim Shocrylas, Director, Product Manager

SIOS Technology Corp.

Copyright @ 2015 SIOS Technology Corp. All rights reserved.

Page 14: Unleashing the power of machine learning for it ops management

http://us.sios.com

Understanding and Managing Complex Virtual and Cloud Environments

• Identifying performance root cause• Predicting the impact of change • Maintaining resilience• Planning for growth

14

High complexity imposed by hidden inter-relationships of a large number

of objects & shared resources

Significant Challenges Exist

Copyright @ 2015 SIOS Technology Corp. All rights reserved.

Page 15: Unleashing the power of machine learning for it ops management

http://us.sios.comCopyright @ 2015 SIOS Technology Corp. All rights reserved.

15

Too Much Data, Not Enough Insight

• Key Information Lost in Noise‒ Alert storms, unnecessary data‒ Too many false positives‒ Subtle issues go unnoticed

• Limited Insights‒ Lacking automated integration and

synthesis of broad data sources‒ Finger pointing across domains

• Falls Short of Root Cause Identification‒ Misses correlation of events to behavior to

identify or predict “real” reason for bad behavior‒ No holistic recommendations for correction

• Too Many Different Answers in Too Many Places‒ Conflicting answers to problems across multiple

domains and tools

Reports, Management Tools, Application Monitoring

• ALERT

Data “Noise”

Page 16: Unleashing the power of machine learning for it ops management

http://us.sios.com

What are Customers Doing Today?

• “Siloed” view‒ Misses complex relationships ‒ Requires multiple tools

• Complex, manual ‒ Difficult setup‒ Significant training‒ Deliver data not intelligence‒ Require ongoing manual threshold

adjustment

• Require specialized skills‒ Highly skilled IT staff to

interpreting results & implement a solution

Copyright @ 2015 SIOS Technology Corp. All rights reserved.16

Monitoring & Reporting

Applicat-ion

Monitoring

Host Monitoring

Network Monitoring

Storage Monitoring

Page 17: Unleashing the power of machine learning for it ops management

http://us.sios.com

SIOS iQ: One Touch to Clarity

• A Next Generation IT Analytics Platform‒ Consolidates IT Data Sources‒ Provides Critical Intelligence

and Information at a Glance‒ Industry Leading Simplicity

• Reducing Time to Issue Resolution

• Proactively Identify Issues Before They Become Problems

• Answering Difficult Questions in Complex Environments

Copyright @ 2015 SIOS Technology Corp. All rights reserved.17

IT Operations Analytics for Virtualized Environments

Page 18: Unleashing the power of machine learning for it ops management

http://us.sios.com

SIOS iQ Machine Learning-based Platform

Copyright @ 2015 SIOS Technology Corp. All rights reserved.18

Simple Intelligence for Virtual Environments

Page 19: Unleashing the power of machine learning for it ops management

http://us.sios.com

What makes SIOS iQ so powerful?

• SIOS vGraph TechnologyAutomatically discovers complex and hidden relationships between all objects

• SIOS Machine Learning EngineDerives actionable insights‒ Performs Topological Behavioral Analysis‒ Detects anomalies‒ Recommends optimal solutions‒ Simulates effects of changes

• SIOS PERC DashboardPresents the knowledge and advice in an easy-to-use, easy-to-access format

Copyright @ 2015 SIOS Technology Corp. All rights reserved.19

Patented Technologies

SIOS Machine Learning Engine

SIOS PERC Dashboard ™

SIOS vGraph™

Page 20: Unleashing the power of machine learning for it ops management

http://us.sios.com20

SIOS PERC Analytics Dashboard™

Copyright @ 2015 SIOS Technology Corp. All rights reserved.

Actionable Along 4 Key Quality of Service Dimensions

PERFORMANCE EFFICIENCY RELIABILITY CAPACITY

Page 21: Unleashing the power of machine learning for it ops management

http://us.sios.com

IT Operations Analytics Is A Big Data Problem

Copyright @ 2015 SIOS Technology Corp. All rights reserved.21

Noise

Application Host Network Storage Other

Page 22: Unleashing the power of machine learning for it ops management

http://us.sios.com

SIOS iQ – Applying Big Data Principles Topological Behavior Analysis

Copyright @ 2015 SIOS Technology Corp. All rights reserved.22

Data Noise Topology Individual Object and Measurement Pattern

Multidimensionalbehavior analysis of

related measurement)

e.g.: latency and IOPS

Page 23: Unleashing the power of machine learning for it ops management

http://us.sios.com

SIOS iQ vROps Integration

Copyright @ 2015 SIOS Technology Corp. All rights reserved. 23

Page 24: Unleashing the power of machine learning for it ops management

http://us.sios.comCopyright @ 2015 SIOS Technology Corp. All rights reserved. 24

Use Case: SIOS iQ

• Quickly Explore the Environment State

• One Click to Identify and Define Issues, Severity, Effected Objects‒ Application Compute Contention ‒ Notes issue severity‒ Lists associated host and all effected objects

• Immediately Understand Root Cause‒ Noisy neighbor identified as “ashley” (a VM)

• Recommendations for Correction‒ SIOS iQ recommends “ashley” storage

reconfiguration or load rebalancing

Deep Root Cause Analysis: Application Performance Issue

Page 25: Unleashing the power of machine learning for it ops management

http://us.sios.comCopyright @ 2015 SIOS Technology Corp. All rights reserved. 25

Use Case: SIOS iQ

• Identify Ideal candidate VMs for Host Based Caching• Recommends cache block size & how much cache to use

for each VM• Predicts the resulting cache hit rate, IOPs improvements, and

potential latency improvement for each of the VMs

Application Performance - Host Based Caching

Page 26: Unleashing the power of machine learning for it ops management

http://us.sios.com

SIOS iQ: Key Use Cases

Noisy NeighborInfrastructure PerformanceApplication PerformanceResource EfficiencyFlash Optimization VMware HA Analysis vROPS Deep Insight

Application Compute

Contention

Application Storage

Contention

Application Network

Contention

DataStore Contention

Compute Contention

Application Impact

Host Based Caching Idle VMs SnapShot

Waste

Undersized VMs

HA Reliability

vROPS Advanced Pack

Copyright @ 2015 SIOS Technology Corp. All rights reserved.

Page 27: Unleashing the power of machine learning for it ops management

http://us.sios.com

SIOS iQ: One Touch to Clarity

27

• Simplicity‒ OneTouch to Root Cause‒ Self Learning and Adjusting‒ Intuitive, Natural Touch-enabled Interface

• Accuracy‒ Increased Signal to Noise Ratio‒ Added Dimensions‒ More Granular Data Analysis‒ Streaming Analysis of Data Flows

• Proactive, Early Issue Identification– Discover Subtle Indicators of Potential Issues

• Automated Issue Triage‒ Information, Warning, Severe

• Comprehensive Recommendations for Resolution• Scalable & Extensible

‒ Spans every tier across hundreds of thousands of objects

Page 28: Unleashing the power of machine learning for it ops management

http://us.sios.com

Who is SIOS?• Founded in 1999

‒ Formerly Steeleye Technology

• Headquarters in San Mateo, CA‒ Offices across the US, UK and Japan

• Recognized Experts in Application Availability

• Extensive Machine Learning Expertise

• Partners are Industry Leaders

Copyright @ 2015 SIOS Technology Corp. All rights reserved.28

Page 29: Unleashing the power of machine learning for it ops management

Learn More about SIOS iQ

www.us.sios.com/iqTel: 866.318.0108

@SIOSTechEmail: [email protected]

29Copyright @ 2015 SIOS Technology Corp. All rights reserved.

Start a Free 30-Day Trial of SIOS iQ

http://us.sios.com/iq/cta/free-edition/