Next-Generation Data- Driven Monitoring and Analytics ... Yeung.pdf · ([email protected]) What is...
Transcript of Next-Generation Data- Driven Monitoring and Analytics ... Yeung.pdf · ([email protected]) What is...
![Page 1: Next-Generation Data- Driven Monitoring and Analytics ... Yeung.pdf · (kyeung@splunk.com) What is IT Operations? 2 Keep an Eye on All Systems Figure Out when things break Fix Them.](https://reader033.fdocuments.us/reader033/viewer/2022042200/5e9f229d58266a5b043b9d48/html5/thumbnails/1.jpg)
Copyright © 2015 Splunk Inc.
Next-Generation Data-
Driven Monitoring and
Analytics Platform with
Splunk IT Service Splunk IT Service
Intelligence
Kelvin Yeung, Splunk
![Page 2: Next-Generation Data- Driven Monitoring and Analytics ... Yeung.pdf · (kyeung@splunk.com) What is IT Operations? 2 Keep an Eye on All Systems Figure Out when things break Fix Them.](https://reader033.fdocuments.us/reader033/viewer/2022042200/5e9f229d58266a5b043b9d48/html5/thumbnails/2.jpg)
What is IT Operations?
2
Keep an Eye on
All Systems
Figure Out when
things break
Fix Them
![Page 3: Next-Generation Data- Driven Monitoring and Analytics ... Yeung.pdf · (kyeung@splunk.com) What is IT Operations? 2 Keep an Eye on All Systems Figure Out when things break Fix Them.](https://reader033.fdocuments.us/reader033/viewer/2022042200/5e9f229d58266a5b043b9d48/html5/thumbnails/3.jpg)
Paradigm Shift in IT Operation Management
First Age (~1988)
Little Data
Faults Only
Amount of Data
What’s Measured
Next Generation
Big (Lots of) Data
Everything
3
Components Level
Extreme
You Name Them!
Monitor Focus
Skill Required
Tools
Service (Every) Level
Reasonable
Splunk ITSI
![Page 4: Next-Generation Data- Driven Monitoring and Analytics ... Yeung.pdf · (kyeung@splunk.com) What is IT Operations? 2 Keep an Eye on All Systems Figure Out when things break Fix Them.](https://reader033.fdocuments.us/reader033/viewer/2022042200/5e9f229d58266a5b043b9d48/html5/thumbnails/4.jpg)
First Age: Focus on Components
4
![Page 5: Next-Generation Data- Driven Monitoring and Analytics ... Yeung.pdf · (kyeung@splunk.com) What is IT Operations? 2 Keep an Eye on All Systems Figure Out when things break Fix Them.](https://reader033.fdocuments.us/reader033/viewer/2022042200/5e9f229d58266a5b043b9d48/html5/thumbnails/5.jpg)
We’ve monitored our cars in the same way
5
![Page 6: Next-Generation Data- Driven Monitoring and Analytics ... Yeung.pdf · (kyeung@splunk.com) What is IT Operations? 2 Keep an Eye on All Systems Figure Out when things break Fix Them.](https://reader033.fdocuments.us/reader033/viewer/2022042200/5e9f229d58266a5b043b9d48/html5/thumbnails/6.jpg)
We’ve monitored our cars in the same way
6
![Page 7: Next-Generation Data- Driven Monitoring and Analytics ... Yeung.pdf · (kyeung@splunk.com) What is IT Operations? 2 Keep an Eye on All Systems Figure Out when things break Fix Them.](https://reader033.fdocuments.us/reader033/viewer/2022042200/5e9f229d58266a5b043b9d48/html5/thumbnails/7.jpg)
First Age: Focus on Faults
Ignore all the good things,
Focus on only the bad things,
7
Ignore all the good things,
Focus on only the bad things,
Just like Dad
![Page 8: Next-Generation Data- Driven Monitoring and Analytics ... Yeung.pdf · (kyeung@splunk.com) What is IT Operations? 2 Keep an Eye on All Systems Figure Out when things break Fix Them.](https://reader033.fdocuments.us/reader033/viewer/2022042200/5e9f229d58266a5b043b9d48/html5/thumbnails/8.jpg)
The New Age of IT Operation ManagementThe New Age of IT Operation Management
DATA CENTRICDATA CENTRIC
APPROACHAPPROACH
DATA CENTRICDATA CENTRIC
APPROACHAPPROACH
TECHNOLOGY
DRIVEN
TECHNOLOGY
DRIVEN
NOT GOOD
ENOUGH
NOT GOOD
ENOUGH
![Page 9: Next-Generation Data- Driven Monitoring and Analytics ... Yeung.pdf · (kyeung@splunk.com) What is IT Operations? 2 Keep an Eye on All Systems Figure Out when things break Fix Them.](https://reader033.fdocuments.us/reader033/viewer/2022042200/5e9f229d58266a5b043b9d48/html5/thumbnails/9.jpg)
Just Not Good Enough
9
Component-level Health without
Service Context (“Big Picture”)The ”Big Pictures” without
Correlation to Component-level
details
![Page 10: Next-Generation Data- Driven Monitoring and Analytics ... Yeung.pdf · (kyeung@splunk.com) What is IT Operations? 2 Keep an Eye on All Systems Figure Out when things break Fix Them.](https://reader033.fdocuments.us/reader033/viewer/2022042200/5e9f229d58266a5b043b9d48/html5/thumbnails/10.jpg)
Reality Check: Cutting Edge Technologies
Identity
VPN
IP Phone
HR
Finance
App Svr
DB
Web Svr SaaS/PaaS
10
SERVERS STORAGE NETWORKING
VIRTUALIZATION
INFRASTRUCTUREAPPLICATIONS
PACKAGED APPLICATIONS
CUSTOM APPLICATIONS
VPN Email DB
IaaS
![Page 11: Next-Generation Data- Driven Monitoring and Analytics ... Yeung.pdf · (kyeung@splunk.com) What is IT Operations? 2 Keep an Eye on All Systems Figure Out when things break Fix Them.](https://reader033.fdocuments.us/reader033/viewer/2022042200/5e9f229d58266a5b043b9d48/html5/thumbnails/11.jpg)
Visibility Across All Layers
Correlations & Drill Down Capability AppsServersNetwork
of Your Application and Technology Stack
Application-
Based Silos
NetworkStorage
Zones of Virtualization Private Cloud Hybrid Cloud
![Page 12: Next-Generation Data- Driven Monitoring and Analytics ... Yeung.pdf · (kyeung@splunk.com) What is IT Operations? 2 Keep an Eye on All Systems Figure Out when things break Fix Them.](https://reader033.fdocuments.us/reader033/viewer/2022042200/5e9f229d58266a5b043b9d48/html5/thumbnails/12.jpg)
Traditional Approach: Collect Only Required
CPU Utilization
HTTP Status
12
Web Server Memory
Consumption
Access Count
Service
Up/Down
![Page 13: Next-Generation Data- Driven Monitoring and Analytics ... Yeung.pdf · (kyeung@splunk.com) What is IT Operations? 2 Keep an Eye on All Systems Figure Out when things break Fix Them.](https://reader033.fdocuments.us/reader033/viewer/2022042200/5e9f229d58266a5b043b9d48/html5/thumbnails/13.jpg)
Data Centric Approach: Collect Everything
CPU Utilization
HTTP Status
13
Web Server Memory
Consumption
Access Count
Service
Up/Down
Bad URL Access
Is the Data
Available or
Flexible to
Monitor?
![Page 14: Next-Generation Data- Driven Monitoring and Analytics ... Yeung.pdf · (kyeung@splunk.com) What is IT Operations? 2 Keep an Eye on All Systems Figure Out when things break Fix Them.](https://reader033.fdocuments.us/reader033/viewer/2022042200/5e9f229d58266a5b043b9d48/html5/thumbnails/14.jpg)
Data Centric Approach: Big Data Analytics
● Hard-coded creates false positive (For Example: > 85% CPU
Utilization = Not Normal always)
● Collect, ingest historical and current data to learn the Normal of
your business14
![Page 15: Next-Generation Data- Driven Monitoring and Analytics ... Yeung.pdf · (kyeung@splunk.com) What is IT Operations? 2 Keep an Eye on All Systems Figure Out when things break Fix Them.](https://reader033.fdocuments.us/reader033/viewer/2022042200/5e9f229d58266a5b043b9d48/html5/thumbnails/15.jpg)
The Next Generation
A Few Metric from Brittle Instrumentation
15
Look at “Bad News” Data
Focus on Up & Down
![Page 16: Next-Generation Data- Driven Monitoring and Analytics ... Yeung.pdf · (kyeung@splunk.com) What is IT Operations? 2 Keep an Eye on All Systems Figure Out when things break Fix Them.](https://reader033.fdocuments.us/reader033/viewer/2022042200/5e9f229d58266a5b043b9d48/html5/thumbnails/16.jpg)
The Next Generation
A Few Metric from Brittle Instrumentation
LOTS of Metrics from Machine Data
Look at “Bad News” Data
16
Look at “Bad News” Data
Look at Everything (and Behavior)
Focus on Up & Down
Focus on Normal vs Not Normal
![Page 17: Next-Generation Data- Driven Monitoring and Analytics ... Yeung.pdf · (kyeung@splunk.com) What is IT Operations? 2 Keep an Eye on All Systems Figure Out when things break Fix Them.](https://reader033.fdocuments.us/reader033/viewer/2022042200/5e9f229d58266a5b043b9d48/html5/thumbnails/17.jpg)
Data-driven service insights
for root-cause isolation and improved service operations
![Page 18: Next-Generation Data- Driven Monitoring and Analytics ... Yeung.pdf · (kyeung@splunk.com) What is IT Operations? 2 Keep an Eye on All Systems Figure Out when things break Fix Them.](https://reader033.fdocuments.us/reader033/viewer/2022042200/5e9f229d58266a5b043b9d48/html5/thumbnails/18.jpg)
Turning Machine Data Into Business Value
Index Untapped Data: Any Source, Type, Volume
Online
ServicesWeb
Services
ServersSecurity
GPS
LocationPackaged
On-
Premises
Ask Any Question
Application Delivery
IT Operations
18
StorageDesktops
Networks
Packaged
Applications
Custom
ApplicationsMessaging
TelecomsOnline
Shopping
Cart
Web
Clickstreams
Databases
Energy
Meters
Call Detail
Records
Smartphones
and Devices
RFID
Private
Cloud
Public
Cloud
Security, Compliance, and Fraud
Business Analytics
Industrial Data andthe Internet of Things
![Page 19: Next-Generation Data- Driven Monitoring and Analytics ... Yeung.pdf · (kyeung@splunk.com) What is IT Operations? 2 Keep an Eye on All Systems Figure Out when things break Fix Them.](https://reader033.fdocuments.us/reader033/viewer/2022042200/5e9f229d58266a5b043b9d48/html5/thumbnails/19.jpg)
Splunk IT Service IntelligenceData-driven service monitoring and analytics
Dynamic Service Models
Dynamic ThresholdsMachine Learning
Root Cause Deep Dive Analysis
Simplified Incident Workflows
19
SPLUNK IT SERVICE INTELLIGENCE
Time-Series Index
Platform for Machine Data
Schema-on-Read Data ModelCommon
Information Model
![Page 20: Next-Generation Data- Driven Monitoring and Analytics ... Yeung.pdf · (kyeung@splunk.com) What is IT Operations? 2 Keep an Eye on All Systems Figure Out when things break Fix Them.](https://reader033.fdocuments.us/reader033/viewer/2022042200/5e9f229d58266a5b043b9d48/html5/thumbnails/20.jpg)
Achieve Service Visibility Faster
Service Analyzer
High-level view of services and composite health scores
Glass Tables
Personalized visualizations of your services
Deep Dives
Organized view of performance indicators across silos
Multi KPI Alerts
Correlation rules to generate notable events
Notable Events
Easy-to-understand report on results of correlation searches
Anomaly Detection and Adaptive Thresholds
Machine learning to baseline normal operations and
identify anomalous behavior
20
![Page 21: Next-Generation Data- Driven Monitoring and Analytics ... Yeung.pdf · (kyeung@splunk.com) What is IT Operations? 2 Keep an Eye on All Systems Figure Out when things break Fix Them.](https://reader033.fdocuments.us/reader033/viewer/2022042200/5e9f229d58266a5b043b9d48/html5/thumbnails/21.jpg)
Copyright © 2015 Splunk Inc.
Demo
21
Demo
![Page 22: Next-Generation Data- Driven Monitoring and Analytics ... Yeung.pdf · (kyeung@splunk.com) What is IT Operations? 2 Keep an Eye on All Systems Figure Out when things break Fix Them.](https://reader033.fdocuments.us/reader033/viewer/2022042200/5e9f229d58266a5b043b9d48/html5/thumbnails/22.jpg)
Paradigm Shift in IT Operation Management
First Age (~1988)
Little Data
Faults Only
Amount of Data
What’s Measured
Next Generation (Now)
Big (Lots of) Data
Everything
22
Components Level
Extreme
You Name Them!
Monitor Focus
Skill Required
Tools
Service (Every) Level
Reasonable
Splunk ITSI
![Page 23: Next-Generation Data- Driven Monitoring and Analytics ... Yeung.pdf · (kyeung@splunk.com) What is IT Operations? 2 Keep an Eye on All Systems Figure Out when things break Fix Them.](https://reader033.fdocuments.us/reader033/viewer/2022042200/5e9f229d58266a5b043b9d48/html5/thumbnails/23.jpg)
23
![Page 24: Next-Generation Data- Driven Monitoring and Analytics ... Yeung.pdf · (kyeung@splunk.com) What is IT Operations? 2 Keep an Eye on All Systems Figure Out when things break Fix Them.](https://reader033.fdocuments.us/reader033/viewer/2022042200/5e9f229d58266a5b043b9d48/html5/thumbnails/24.jpg)
Thank YouThank You