Leveraging your machine data analytics to manage...
Transcript of Leveraging your machine data analytics to manage...
![Page 1: Leveraging your machine data analytics to manage ...aws-de-media.s3.amazonaws.com/images/AWS_Summit... · Leveraging your machine data analytics to manage, troubleshoot and secure](https://reader030.fdocuments.us/reader030/viewer/2022041016/5ec962cf8f6a78529a1d93f6/html5/thumbnails/1.jpg)
Leveraging your machine data analytics to manage, troubleshoot and secure your modern apps
Ben Newton & Colin Fernandes
AWS Berlin
![Page 2: Leveraging your machine data analytics to manage ...aws-de-media.s3.amazonaws.com/images/AWS_Summit... · Leveraging your machine data analytics to manage, troubleshoot and secure](https://reader030.fdocuments.us/reader030/viewer/2022041016/5ec962cf8f6a78529a1d93f6/html5/thumbnails/2.jpg)
2000+ Customers50,000+ Users
20+ Million Searches Daily
500+ Trillion Records Analyzed Daily
3 Continents6 AWS Regions
100+ PetaBytes of Machine Data Analyzed Daily
Multi-tenant, microservices-based
architecture
Who is Sumo Logic?
![Page 3: Leveraging your machine data analytics to manage ...aws-de-media.s3.amazonaws.com/images/AWS_Summit... · Leveraging your machine data analytics to manage, troubleshoot and secure](https://reader030.fdocuments.us/reader030/viewer/2022041016/5ec962cf8f6a78529a1d93f6/html5/thumbnails/3.jpg)
New Study: Business Value of Machine Data Analytics
“Businesses that are able to participate in
this analytics economy – translating their
data into valuable intelligence that gives
them competitive advantage – will survive
and thrive. Those that don’t will be left
behind.”451 Research
Using Machine Data Analytics to Gain
Advantage in the Analytics Economy
June 12: Download the Study at
sumologic.com
![Page 4: Leveraging your machine data analytics to manage ...aws-de-media.s3.amazonaws.com/images/AWS_Summit... · Leveraging your machine data analytics to manage, troubleshoot and secure](https://reader030.fdocuments.us/reader030/viewer/2022041016/5ec962cf8f6a78529a1d93f6/html5/thumbnails/4.jpg)
The Customer Experience Imperative
451 Research Voice of the Connected User Landscape: 1H 2017 US Corporate Mobility and Digital Transformation
![Page 5: Leveraging your machine data analytics to manage ...aws-de-media.s3.amazonaws.com/images/AWS_Summit... · Leveraging your machine data analytics to manage, troubleshoot and secure](https://reader030.fdocuments.us/reader030/viewer/2022041016/5ec962cf8f6a78529a1d93f6/html5/thumbnails/5.jpg)
The Drive for Convenience and Access
Catalog
ShoppingCenter
Super Store
E-Commerce
Personalization
![Page 6: Leveraging your machine data analytics to manage ...aws-de-media.s3.amazonaws.com/images/AWS_Summit... · Leveraging your machine data analytics to manage, troubleshoot and secure](https://reader030.fdocuments.us/reader030/viewer/2022041016/5ec962cf8f6a78529a1d93f6/html5/thumbnails/6.jpg)
ExperienceAlways-On
PersonalizedCommunity
CommodityHighly ProductiveLow CostsHigh Volume
Time
Co
st
High Costs
Low Costs
Co
nv
en
ien
ce
Scarce
Ubiquitous
A Shift from Commodity to Experience
![Page 7: Leveraging your machine data analytics to manage ...aws-de-media.s3.amazonaws.com/images/AWS_Summit... · Leveraging your machine data analytics to manage, troubleshoot and secure](https://reader030.fdocuments.us/reader030/viewer/2022041016/5ec962cf8f6a78529a1d93f6/html5/thumbnails/7.jpg)
ModernConstant Change
DistributedSmall Components
TraditionalStaticCentralizedLarge Components
Time
Com
pone
nt
Siz
e Syste
m S
cale
Mainframe
3-Tier
SOA
Microservices
Serverless
Functions
IoTSmall Scale
Massive Scale
Experience Focus Drives Technology Investments
![Page 8: Leveraging your machine data analytics to manage ...aws-de-media.s3.amazonaws.com/images/AWS_Summit... · Leveraging your machine data analytics to manage, troubleshoot and secure](https://reader030.fdocuments.us/reader030/viewer/2022041016/5ec962cf8f6a78529a1d93f6/html5/thumbnails/8.jpg)
!?
Data Overload
Companies are struggling with the changes
Legacy SilosGrowing Skills Gaps
Lack of Visibility
![Page 9: Leveraging your machine data analytics to manage ...aws-de-media.s3.amazonaws.com/images/AWS_Summit... · Leveraging your machine data analytics to manage, troubleshoot and secure](https://reader030.fdocuments.us/reader030/viewer/2022041016/5ec962cf8f6a78529a1d93f6/html5/thumbnails/9.jpg)
And they know it...
Cloud staff overloaded
Data Overload
Legacy SilosGrowing Skills Gaps
Lack of Visibility
Requires broader technical expertise
Legacy tools ineffective
Require greater collaboration
63%49% 51% 57%
2018 Global Security Trends in the Cloud - Sumo Logic
![Page 10: Leveraging your machine data analytics to manage ...aws-de-media.s3.amazonaws.com/images/AWS_Summit... · Leveraging your machine data analytics to manage, troubleshoot and secure](https://reader030.fdocuments.us/reader030/viewer/2022041016/5ec962cf8f6a78529a1d93f6/html5/thumbnails/10.jpg)
Machine Data Analytics is the secret sauce!
Q. How important is machine data to your company’s ability to meet its goals?
250 Companies Answered
451 Research: Using Machine Data Analytics to Gain Advantage in the Analytics Economy (June 2018)
![Page 11: Leveraging your machine data analytics to manage ...aws-de-media.s3.amazonaws.com/images/AWS_Summit... · Leveraging your machine data analytics to manage, troubleshoot and secure](https://reader030.fdocuments.us/reader030/viewer/2022041016/5ec962cf8f6a78529a1d93f6/html5/thumbnails/11.jpg)
What’s holding us back?
451 Research: Using Machine Data Analytics to Gain Advantage in the Analytics Economy (June 2018)
![Page 12: Leveraging your machine data analytics to manage ...aws-de-media.s3.amazonaws.com/images/AWS_Summit... · Leveraging your machine data analytics to manage, troubleshoot and secure](https://reader030.fdocuments.us/reader030/viewer/2022041016/5ec962cf8f6a78529a1d93f6/html5/thumbnails/12.jpg)
A Modern, Integrated Approach to Analytics
Monitor
Focus on User Impacting issues
Monitor
Focus on Data-Driven Improvement
Optimize
Focus on End-to-End Visibility
Investigate
![Page 13: Leveraging your machine data analytics to manage ...aws-de-media.s3.amazonaws.com/images/AWS_Summit... · Leveraging your machine data analytics to manage, troubleshoot and secure](https://reader030.fdocuments.us/reader030/viewer/2022041016/5ec962cf8f6a78529a1d93f6/html5/thumbnails/13.jpg)
Proactive Real-Time MonitoringMonitor
![Page 14: Leveraging your machine data analytics to manage ...aws-de-media.s3.amazonaws.com/images/AWS_Summit... · Leveraging your machine data analytics to manage, troubleshoot and secure](https://reader030.fdocuments.us/reader030/viewer/2022041016/5ec962cf8f6a78529a1d93f6/html5/thumbnails/14.jpg)
Effective Investigations Monitor
![Page 15: Leveraging your machine data analytics to manage ...aws-de-media.s3.amazonaws.com/images/AWS_Summit... · Leveraging your machine data analytics to manage, troubleshoot and secure](https://reader030.fdocuments.us/reader030/viewer/2022041016/5ec962cf8f6a78529a1d93f6/html5/thumbnails/15.jpg)
High-Impact Application OptimizationMonitor
![Page 16: Leveraging your machine data analytics to manage ...aws-de-media.s3.amazonaws.com/images/AWS_Summit... · Leveraging your machine data analytics to manage, troubleshoot and secure](https://reader030.fdocuments.us/reader030/viewer/2022041016/5ec962cf8f6a78529a1d93f6/html5/thumbnails/16.jpg)
Development /
EngineeringOps / DevOps
Development /
EngineeringOps / DevOps
Development /
Engineering
Product
Management
Customer
Success
Marketing /
Sales
Empower the People Powering your Business
Monitor
Focus on User Impacting Issues Focus on Data-Driven Improvement
Optimize
Focus on E2E Visibility
Investigate
Customer
SupportSecOps SecOps
![Page 17: Leveraging your machine data analytics to manage ...aws-de-media.s3.amazonaws.com/images/AWS_Summit... · Leveraging your machine data analytics to manage, troubleshoot and secure](https://reader030.fdocuments.us/reader030/viewer/2022041016/5ec962cf8f6a78529a1d93f6/html5/thumbnails/17.jpg)
![Page 18: Leveraging your machine data analytics to manage ...aws-de-media.s3.amazonaws.com/images/AWS_Summit... · Leveraging your machine data analytics to manage, troubleshoot and secure](https://reader030.fdocuments.us/reader030/viewer/2022041016/5ec962cf8f6a78529a1d93f6/html5/thumbnails/18.jpg)
Example: Sumo Logic Query Activity Log
2017-08-14 11:33:56,042 -0700 INFO
[LOGTYPE=TELEMETRY.CUSTOMER] [hostId=prod-search-xx]
[module=STREAM]
[logger=stream.internals.EttPlansCache$]
[thread=MTP-RawOutputProcessor-Session-
0.0456958503414473-192C3F406EA0B56D-1]
[auth=xxx:false:DefaultSumoSystemUser:5:UNKNOWN]
[sessionId=xxx] explainJsonPlan.ETT {"version" :
2.0, "customerId" : ”xx", "sessionId" : ”xx",
"isInteractiveQuery" : false, "exitCode" : 0,
"statusMessage" : "Finished successfully",
"isAggregateQuery" : true, "query" : "SOME QUERY"}
![Page 19: Leveraging your machine data analytics to manage ...aws-de-media.s3.amazonaws.com/images/AWS_Summit... · Leveraging your machine data analytics to manage, troubleshoot and secure](https://reader030.fdocuments.us/reader030/viewer/2022041016/5ec962cf8f6a78529a1d93f6/html5/thumbnails/19.jpg)
Example: User Query Execution over Time
_sourceCategory=*/stream AND explainJsonPlan.ETT
| parse "explainJsonPlan.ETT *" as json_explain
| json field=json_explain "executionStartTime" ,
"executionEndTime"
| (executionEndTime - executionStartTime) as query_time
| query_time/1000 as query_time
| timeslice 1m
| pct(query_time, 25,50,75), min(query_time),
pct(query_time, 90) as _max by _timeslice
Extract the JSON
Compute a
histogram
![Page 20: Leveraging your machine data analytics to manage ...aws-de-media.s3.amazonaws.com/images/AWS_Summit... · Leveraging your machine data analytics to manage, troubleshoot and secure](https://reader030.fdocuments.us/reader030/viewer/2022041016/5ec962cf8f6a78529a1d93f6/html5/thumbnails/20.jpg)
Example: Correlate Events with Performance
CPU Load
correlates to
User Query
Activity
![Page 21: Leveraging your machine data analytics to manage ...aws-de-media.s3.amazonaws.com/images/AWS_Summit... · Leveraging your machine data analytics to manage, troubleshoot and secure](https://reader030.fdocuments.us/reader030/viewer/2022041016/5ec962cf8f6a78529a1d93f6/html5/thumbnails/21.jpg)
Example: Searching for Particular Usage
_sourceCategory=*/stream AND explainJsonPlan.ETT logreduce by
| parse "[hostId=*-*]" as deployment, host | parse "]
explainJsonPlan.ETT *" as ett
| json field=ett "rangeDt", "sessionId", "callerModule",
"statusMessage", "executionDt", "buildEngineDt",
"customerId","inputMessageCt",
"messageCt","rawCt","parseRegexTime","indexCt","indexCtAfterBloomfi
lter","indexBatchCt","streamProcessingDt","operatorTime",
"pauseDt", "gcTime", "executionStartTime","queryStartTime"
| where (query matches "*logreduce by *")
| timeslice by 1d
| count as queries by _timeslice
![Page 22: Leveraging your machine data analytics to manage ...aws-de-media.s3.amazonaws.com/images/AWS_Summit... · Leveraging your machine data analytics to manage, troubleshoot and secure](https://reader030.fdocuments.us/reader030/viewer/2022041016/5ec962cf8f6a78529a1d93f6/html5/thumbnails/22.jpg)
Example: Understanding a Product Release
Announcement
![Page 23: Leveraging your machine data analytics to manage ...aws-de-media.s3.amazonaws.com/images/AWS_Summit... · Leveraging your machine data analytics to manage, troubleshoot and secure](https://reader030.fdocuments.us/reader030/viewer/2022041016/5ec962cf8f6a78529a1d93f6/html5/thumbnails/23.jpg)
Understanding the Adoption of a New Product Feature
![Page 24: Leveraging your machine data analytics to manage ...aws-de-media.s3.amazonaws.com/images/AWS_Summit... · Leveraging your machine data analytics to manage, troubleshoot and secure](https://reader030.fdocuments.us/reader030/viewer/2022041016/5ec962cf8f6a78529a1d93f6/html5/thumbnails/24.jpg)
Not
Just IT
Either
![Page 25: Leveraging your machine data analytics to manage ...aws-de-media.s3.amazonaws.com/images/AWS_Summit... · Leveraging your machine data analytics to manage, troubleshoot and secure](https://reader030.fdocuments.us/reader030/viewer/2022041016/5ec962cf8f6a78529a1d93f6/html5/thumbnails/25.jpg)
A Modern Solution for the Modern Application
Secure Core DevSecOps Cloud Native
$
Rapid ResponseTrue SaaS
DevSecOps
Full visibility
into App & Infra
Rapid scale,
adoption & TTV
Platform security &
compliance leader
Unified security
& compliance
Accelerated
innovation &
transformation
"Sumo Logic is the information radiator at SmartThings. Every team at SmartThings finds value with Sumo Logic”
![Page 26: Leveraging your machine data analytics to manage ...aws-de-media.s3.amazonaws.com/images/AWS_Summit... · Leveraging your machine data analytics to manage, troubleshoot and secure](https://reader030.fdocuments.us/reader030/viewer/2022041016/5ec962cf8f6a78529a1d93f6/html5/thumbnails/26.jpg)
Conversations on the Front Lines of the Data Revolution
mastersofdata.com
Available on iTunes and Google Play
![Page 27: Leveraging your machine data analytics to manage ...aws-de-media.s3.amazonaws.com/images/AWS_Summit... · Leveraging your machine data analytics to manage, troubleshoot and secure](https://reader030.fdocuments.us/reader030/viewer/2022041016/5ec962cf8f6a78529a1d93f6/html5/thumbnails/27.jpg)
Dr. Nicole Forsgren Jez Humble
Christian Madsbjerg
Author -
“Sensemaking”
DevOps Research and Assessment (DORA)
![Page 28: Leveraging your machine data analytics to manage ...aws-de-media.s3.amazonaws.com/images/AWS_Summit... · Leveraging your machine data analytics to manage, troubleshoot and secure](https://reader030.fdocuments.us/reader030/viewer/2022041016/5ec962cf8f6a78529a1d93f6/html5/thumbnails/28.jpg)
Thank
You