Monitoring advanced PaaS workloadsin the enterprise

Karl-Gustav Ots

Managing Consultant, Kompozure AB

@fincooper

• Cloud and cybersecurity consultant

• Trainer and international speaker

• Patented inventor

• Working on Azure since 2011

Karl-Gustav Ots @ Kompozure

Agenda

• End-to-end monitoring, what and why?

• Recent updates

• Available tooling

After the session, you’ll have an overview of Azure E2E monitoringoptions, whether you’re an IT Professional of a Developer.

Why end-to-end monitoring?

• By E2E I mean full-stack and actionable monitoring of:• Application

• Infrastucture

• Platform

• Out of scope:• Billing

• Having E2E monitoring infrastructure in place helps you track :• Health• Performance• Security• SLA

• Benefits:• Know how your application

performs• Understand how users use

your app • Fix issues and bugs faster

End-to-end monitoring helps to find out

Is my application UP

or DOWN?

Is my application crashing?

What exactly happened?

Is my application

fast enough?

Is my server able to handle

the load?

Is it Azure or just me?

What is the root cause?

How many people are impacted?

Azure Monitoring scene

Application Insights

Azure Monitor Azure HealthARM Activity

Logs

System Center Operations Manager

OperationsManagement

SuiteLog Analytics

Network Watcher

PowerBISecure Devops

Kit for Azure (AzSDK)

Security Center

Azure Monitor: consolidated pipeline for all monitoring data from Azure services. It gives

you access to performance metrics and events that describe the operation of the Azure infrastructure and any Azure services you are

using.

Application Insights: application performance

monitoring and user analytics. It monitors the code you've

written and applications you've deployed on Azure or

on premises/other clouds

Log Analytics:ingestion of log and

metric data from Azure services (via Azure

Monitor), Azure VMs, and on premises or other

cloud infrastructure and offers flexible log search

and out-of-the box analytics on top of this

data. It

Azure Monitor

Azure Monitor

• Built-In monitoring support for all Azure resources

• Out-of-the-box Resource Metrics, such as:• Total active connections on Azure DB for MySQL

• Number of throttling errors for IoT hub

• Alert rules to get notified & take automated actions

• Exposed as an API

Recent Updates

• Application Insights is now Generally Available• Also in Europe

• ARM Activity Logs Generally Available

• Azure Monitor Generally Available

• Azure Health and Planned Maintenance

• Log Analytics migration from Elastic Search and SOLR to Kustoquery language

Recent Updates (Ignite)

• Azure Monitor ITSM support• System Center Service Manager, Service Now, Provance, Cherwell

• New Azure Monitor Alert engine• Near-real time monitoring

• New UI for Application Insights and Azure Monitor

• Application Insights Failure Diagnostics

Demo

Azure Monitor: consolidated pipeline for all monitoring data from Azure services. It gives

you access to performance metrics and events that describe the operation of the Azure infrastructure and any Azure services you are

using.

Application Insights: application performance

monitoring and user analytics. It monitors the code you've

written and applications you've deployed on Azure or

on premises/other clouds

Log Analytics:ingestion of log and

metric data from Azure services (via Azure

Monitor), Azure VMs, and on premises or other

cloud infrastructure and offers flexible log search

and out-of-the box analytics on top of this

data. It

Application Insights

Application Insights Application Map

• Maps your application component dependencies

• Monitoring of load, performance, failures and alerts, at component level

• You can drill down to a speific Azure Monitor or Azure Service diagnostic view, such as SQL Database Advisor

• Helps you spot the problemmatic component more easily

Application insights Web test alerts

Availability test

• You can test any website

• Up to 16 Azure locations supported

• Not just HTTP response: can be configured to require certaincontent to be retrieved (welcome text, image etc)

Application insights Web test alerts

Recorded step tests

• Session recording with Visual Studio or browser

• Timing and random number input

• Authentication with SAML or AAD

Application Insights Machine Learning alerts

• Failure Anomalies.

• Performance Anomalies.

Application Insights PowerBI pack

• Combine metrics from multiple applications in one portal for self-service BI

• Premade visualizations for active users, page views, sessions, browser and OS version, and geographic distribution of users in a map

Azure Monitor: consolidated pipeline for all monitoring data from Azure services. It gives

you access to performance metrics and events that describe the operation of the Azure infrastructure and any Azure services you are

using.

Application Insights: application performance

monitoring and user analytics. It monitors the code you've

written and applications you've deployed on Azure or

on premises/other clouds

Log Analytics:ingestion of log and

metric data from Azure services (via Azure

Monitor), Azure VMs, and on premises or other

cloud infrastructure and offers flexible log search

and out-of-the box analytics on top of this

data. It

Log Analytics

Log Analytics

• Operation Management Suite (OMS) provides several infrastructure monitoring capabilities out of the box:• Network Performance Monitoring

• Storage, compute and Microsoft middleware performance

• With OMS, you can use the Kusto query engine to search trough your System Center logs or syslog.• You can ask e.g. for data on all unhealthy network links

• Or status of disk usage and patching for all VMs

• You can also bring all Application Insights telemetry into OMS search logs!

Demo

Log Analytics connectivity

• Input• Application Insights

• Azure Platform• Azure Active Directory Audit logs, Azure Activity Logs, Azure Security Center Alerts,

most Azure Resource Provider's Logs

• Windows or Linux Virtual Machine logs

• System Center logs

• ITSM tools: System Center Service Manager, ServiceNow, Provance, and Cherwell

• Output• Azure Log Integration : Anywhere ☺

Azure Audit logs in PowerBI

OMS Service Map

• Built on the BlueStripe acquisition

• Automatically maps dependencies of your Windows or Linux VMs• Shows connections between servers, ports and processes

• You need to install an agent

• Use Service map to gather a holistic SLA view on your IaaSappications• Drill down to machine level to see OMS performance monitoring data

• Think Application Map for infra!

SCOM

Azure end-to-end Monitoring

IaaS PaaS

Performance monitoring

Operations Management Suite

Application Insights

Dependencymapping

OMS Service Map App insights Application Map

Alerts and Health Azure Monitor Azure Monitor

Visualization PowerBi, Portal Dashboard and SDK

PowerBI, Portal Dashboard and SDK

SCOM visibility Azure Management Pack Application Insights Management Pack

Further reading

• Patterns & Practices article on Monitoring:• https://docs.microsoft.com/en-us/azure/monitoring-and-diagnostics/

• Logic App that posts a message to a Slack channel when an Azure alert fires:• https://github.com/Azure/azure-quickstart-templates/tree/master/201-alert-to-slack-with-logic-

app

• Set up alerts automatically using PowerShell• https://docs.microsoft.com/en-us/azure/application-insights/app-insights-powershell-alerts

• Provision alerts from Secure DevOps kit for Azure:• https://github.com/azsdk/azsdk-docs/blob/master/01-Subscription-

Security/Readme.md#azsdk-suscription-activity-alerts

• Ignite Sessions:• Analyze & Debug applications across your DevOps workflow with Azure Application Insights• Manage and optimize your cloud spend with Azure Cost Management by Cloudyn• Monitoring, diagnosing and debugging with Azure networking

Thank you!

Please do not forget to evaluate the session before you leave by using ourLollipolls!