MySQL and MongoDB Monitoring and Optimization · 5 © 2017 Percona Monitoring and Management...

32
© 2017 Percona 1 Peter Zaitsev MySQL and MongoDB Monitoring and Optimization with Percona Monitoring and Management CEO Percona University, Berlin May 9 th , 2017

Transcript of MySQL and MongoDB Monitoring and Optimization · 5 © 2017 Percona Monitoring and Management...

Page 1: MySQL and MongoDB Monitoring and Optimization · 5 © 2017 Percona Monitoring and Management Critical need for modern database infrastructure

© 2017 Percona1

Peter Zaitsev

MySQL and MongoDB Monitoring and Optimizationwith Percona Monitoring and Management

CEOPercona University, BerlinMay 9th, 2017

Page 2: MySQL and MongoDB Monitoring and Optimization · 5 © 2017 Percona Monitoring and Management Critical need for modern database infrastructure

© 2017 Percona2

PMM Stands for

Page 3: MySQL and MongoDB Monitoring and Optimization · 5 © 2017 Percona Monitoring and Management Critical need for modern database infrastructure

© 2017 Percona3

Why Did We Start Working on PMM

Page 4: MySQL and MongoDB Monitoring and Optimization · 5 © 2017 Percona Monitoring and Management Critical need for modern database infrastructure

© 2017 Percona4

Percona Vision

100% Free and Open Source Platform for 95%

of applications

Page 5: MySQL and MongoDB Monitoring and Optimization · 5 © 2017 Percona Monitoring and Management Critical need for modern database infrastructure

© 2017 Percona5

Monitoring and Management

Critical need for modern database infrastructure

Page 6: MySQL and MongoDB Monitoring and Optimization · 5 © 2017 Percona Monitoring and Management Critical need for modern database infrastructure

© 2017 Percona6

Monitoring and Management Status

Commercial License

Cloud Based

Do it yourself

Page 7: MySQL and MongoDB Monitoring and Optimization · 5 © 2017 Percona Monitoring and Management Critical need for modern database infrastructure

© 2017 Percona7

Would be great to have

100% Free and Open Source

Can run In the Cloud and on Premises

Easy to use

Page 8: MySQL and MongoDB Monitoring and Optimization · 5 © 2017 Percona Monitoring and Management Critical need for modern database infrastructure

© 2017 Percona8

Available for

Anyone on the Team

•Engineers, •DBA •SREs

Any Environment

•Development•Staging/QA•Production

Page 9: MySQL and MongoDB Monitoring and Optimization · 5 © 2017 Percona Monitoring and Management Critical need for modern database infrastructure

© 2017 Percona9

About PMM

Page 10: MySQL and MongoDB Monitoring and Optimization · 5 © 2017 Percona Monitoring and Management Critical need for modern database infrastructure

© 2017 Percona10

PMM Philosophy

Do not reinvent the wheel

Use as much of industry leading components as possible

Make Integration and Customization easy

Page 11: MySQL and MongoDB Monitoring and Optimization · 5 © 2017 Percona Monitoring and Management Critical need for modern database infrastructure

© 2017 Percona11

Industry Leading Components

Page 12: MySQL and MongoDB Monitoring and Optimization · 5 © 2017 Percona Monitoring and Management Critical need for modern database infrastructure

12

Current Focus

To Become Best 100% Free and Open Source

Solution for MySQL and MongoDB

Page 13: MySQL and MongoDB Monitoring and Optimization · 5 © 2017 Percona Monitoring and Management Critical need for modern database infrastructure

© 2017 Percona13

Currently Works

Metrics for MySQL and MongoDB

Support for PXC, Galera, ProxySQL

Support of Amazon RDS

Query Analytics for MySQL

Experimental Orchestrator Integration

Do it yourself Grafana Alerting

Page 14: MySQL and MongoDB Monitoring and Optimization · 5 © 2017 Percona Monitoring and Management Critical need for modern database infrastructure

© 2017 Percona14

PMM Platform Support

• Docker• Virtual Appliance• AMI

Server Side

• LinuxClient Side

Page 15: MySQL and MongoDB Monitoring and Optimization · 5 © 2017 Percona Monitoring and Management Critical need for modern database infrastructure

© 2017 Percona15

In Works

Support for Longer retention period

Better Cloud Support

Ease of use

Query Analytics for MongoDB

Improved Query Analytics Interface

Alerting

Page 16: MySQL and MongoDB Monitoring and Optimization · 5 © 2017 Percona Monitoring and Management Critical need for modern database infrastructure

© 2017 Percona16

By the Experts for the Experts ?

Assist Experts to Resolve the most complicated problems

But be friendly enough for Non-Expert use

Actionable Advice

Integration and Automation

Page 17: MySQL and MongoDB Monitoring and Optimization · 5 © 2017 Percona Monitoring and Management Critical need for modern database infrastructure

© 2017 Percona17

PMM Data Capture

1 sec resolution data capture for most important data

Capture a lot more with lower resolution

Allow to perform deep analyses

1000s of metrics captured per instance

Page 18: MySQL and MongoDB Monitoring and Optimization · 5 © 2017 Percona Monitoring and Management Critical need for modern database infrastructure

© 2017 Percona18

PMM Architecture Overview

Page 19: MySQL and MongoDB Monitoring and Optimization · 5 © 2017 Percona Monitoring and Management Critical need for modern database infrastructure

© 2017 Percona19

Database as a Black Box….

Page 20: MySQL and MongoDB Monitoring and Optimization · 5 © 2017 Percona Monitoring and Management Critical need for modern database infrastructure

© 2017 Percona20

What does MySQL and MongoDB do ?

Responds Application Requests

Page 21: MySQL and MongoDB Monitoring and Optimization · 5 © 2017 Percona Monitoring and Management Critical need for modern database infrastructure

© 2017 Percona21

Criteria

Response (Available)

Quickly (Performance)

Right (Correctness)

Page 22: MySQL and MongoDB Monitoring and Optimization · 5 © 2017 Percona Monitoring and Management Critical need for modern database infrastructure

© 2017 Percona22

Problem Caused By

Application

• Too many Queries

• Bad Queries• Improper

Capacity Planning

Database

• Choosing Bad Plan

• Contention Issues

• Locking

Hardware and Environment

• CPU• Disk• Memory • Network

Page 23: MySQL and MongoDB Monitoring and Optimization · 5 © 2017 Percona Monitoring and Management Critical need for modern database infrastructure

© 2017 Percona23

Query Analyses

Working for MySQL

Will be available for MongoDB shortly

Page 24: MySQL and MongoDB Monitoring and Optimization · 5 © 2017 Percona Monitoring and Management Critical need for modern database infrastructure

© 2017 Percona24

What Queries are causing the load ?

Page 25: MySQL and MongoDB Monitoring and Optimization · 5 © 2017 Percona Monitoring and Management Critical need for modern database infrastructure

© 2017 Percona25

Why are they causing this load ?

Page 26: MySQL and MongoDB Monitoring and Optimization · 5 © 2017 Percona Monitoring and Management Critical need for modern database infrastructure

© 2017 Percona26

How to fix them

Page 27: MySQL and MongoDB Monitoring and Optimization · 5 © 2017 Percona Monitoring and Management Critical need for modern database infrastructure

© 2017 Percona27

System Information

Page 28: MySQL and MongoDB Monitoring and Optimization · 5 © 2017 Percona Monitoring and Management Critical need for modern database infrastructure

© 2017 Percona28

What happens on OS and Hardware Level

Page 29: MySQL and MongoDB Monitoring and Optimization · 5 © 2017 Percona Monitoring and Management Critical need for modern database infrastructure

29

As well as Database Level

Page 30: MySQL and MongoDB Monitoring and Optimization · 5 © 2017 Percona Monitoring and Management Critical need for modern database infrastructure

30

In-Depth MongoDB Dashboards

Page 31: MySQL and MongoDB Monitoring and Optimization · 5 © 2017 Percona Monitoring and Management Critical need for modern database infrastructure

© 2017 Percona31

Lets Explore the Demo!http://pmmdemo.percona.com

Page 32: MySQL and MongoDB Monitoring and Optimization · 5 © 2017 Percona Monitoring and Management Critical need for modern database infrastructure

DATABASE PERFORMANCEMATTERS

Database Performance MattersDatabase Performance MattersDatabase Performance MattersDatabase Performance MattersDatabase Performance Matters