Webinar: Management and Automation of MariaDB Galera Clusters

© MariaDB Corpora,on Ab

Management & Automa,on of MariaDB Galera Clusters

Vinay Joosery, CEO -‐ [email protected]

Jean-‐Jérôme Schmidt, VP Marke,ng -‐ [email protected] Ralf Gebhardt, Sales Engineer -‐ [email protected]

* * 02.10.14 1


Agenda

• Introduc,on • MariaDB Galera Cluster Essen,als • Partner presenta,on: Severalnines • MariaDB Enterprise and MariaDB Enterprise Cluster

02.10.14 2


About MariaDB Corpora,on

●  Home for the founders and original developers of the core of MySQL

●  Home for the commercial offering of MariaDB

●  Provides support and services for MySQL and derived databases like MariaDB

●  Flagship product is MariaDB Enterprise: It includes support, tools and services for MariaDB

02.10.14 3

mariadb.com


Data Redundancy with MariaDB

• MariaDB Internal Replica,on • Asynchronous • Semi-‐Synchronous • Storage based redundancy (Ac,ve/Passive) • DRBD (Distributed Replicated Block Device) • SAN (Storage Area Network) • VMWare replica,on • MariaDB Galera Cluster

02.10.14 4


HA using MariaDB Replica,on

• This is in many cases a good enough solu,on, but it has some issues

• The cluster is very loosely coupled, not all nodes are aware of all the other nodes for example

• Replica,on is asynchronous, so failing over is more difficult than usually

• Adding a slave is difficult

02.10.14 5


MariaDB Galera Cluster Architecture

• MariaDB Galera Cluster is a so_ware-‐only solu,on with many advantages

• No failover requirements -‐ the nodes are all ac,ve and are all masters

•  “Proper” Cluster with built-‐in failover, locking and split-‐brain protec,on

• Synchronous replica,on with low overhead due to op,mis,c locking

• Automated online add node • No applica,on change scale out

02.10.14 6


HA using MariaDB Replica,on

02.10.14 7

MariaDB Galera Cluster

MariaDB Server MariaDB Server MariaDB Server

Galera wsrep Library Galera wsrep Library Galera wsrep Library

Synchronous Replication

Load Balancer / Failover

Application / Application Server


Secng up MariaDB Galera Cluster

• MariaDB Galera Cluster consists of the MariaDB binary that in turns talks to the Galera wsrep library

• Once set up, Galera is configured using the usual my.cnf file, and is monitored / managed per node using SHOW GLOBAL STATUS and SHOW GLOBAL VARIABLES commands

02.10.14 8

Confidential

Automation and Management of Database Clusters

September 30, 2014

Vinay Joosery & Jean-Jérôme Schmidt

Severalnines

[email protected] & [email protected]

Confidential

Agenda

¤  Database Infrastructure Lifecycle ¤  Deploy, Monitor, Manage, Scale

¤  ClusterControl Overview

¤  Introducing ClusterControl 1.2.8

¤  Live Demo

10

Copyright Severalnines AB

Confidential

Database Infrastructure Lifecycle

11

Copyright 2013 Severalnines AB

Confidential

Database TCO

12


Source: IDC, Maximizing the Business Value of Enterprise Database Applications

Confidential

Infrastructure Lifecycle

13


Manage Scale

Monitor Deploy

Confidential

Deployment - Beyond Puppet or Chef

¤  Puppet/Chef are appropriate for a group of single-node components ¤  E.g. web servers can be clones of each other..

¤  Distributed databases are complex ¤  Different node types & roles

¤  Orchestration of procedures in a specific order

¤  Using e.g. Chef for deploying a distributed database ¤  Yes, it is possible

¤  Not much Chef functionality is leveraged

¤  Prepare to write code

14


Confidential

Monitoring - Beyond Nagios

¤  What do you do when the application is slow?

¤  Is it Disk? CPU? RAM? Badly written queries?

¤  What are the symptoms? (Replication queues, Page Faults, locks, # connections, …)

¤  How do you avoid problems?

¤  How do you plan for capacity?

15


Confidential

Management - Beyond Monitoring

16


Confidential

Scaling - Beyond Manual Operations

17


Confidential

ClusterControl Overview

18


Confidential

ClusterControl In a nutshell

19


Manage Scale

Monitor Deploy

Confidential

Supported Databases

SQL

¤  MariaDB Cluster

¤  MySQL Galera Cluster (Codership)

¤  Percona XtraDB Cluster

¤  MySQL Cluster (NDB)

¤  MySQL Replication – with GTID

¤  Standalone MySQL/MariaDB

NoSQL

¤  MongoDB Sharded Cluster

¤  MongoDB Replica Set

¤  TokuMX Cluster


20

Confidential

ClusterControl Automation & Management

¤  Provisioning ¤  Deploy a cluster in minutes

¤  On-premises or in the cloud (AWS & OpenStack)

¤  Monitoring ¤  Systems view

¤  1sec resolution

¤  DB / OS stats & performance advisors

¤  Configurable dashboards

¤  Query Analyzer

¤  Real-time / historical

21


Confidential

ClusterControl Automation & Management

¤  Management ¤  Multi cluster/data-center

¤  Automate repair/recovery

¤  Database upgrades

¤  Backups

¤  Configuration management

¤  Cloning

¤  One-click scaling

22


Confidential

Getting Started

¤  Dedicated VM for the controller

¤  Specs ¤  2 CPU cores ¤  2-4GB RAM ¤  20GB diskspace

¤  No agents ¤  Host stats gathered via SSH

¤  Installation ¤  YUM/APT ¤  Setup SSH access to DB nodes

23


Confidential

Example Architecture

24


Confidential 25


Confidential

Introducing ClusterControl 1.2.8

26


Confidential

ClusterControl 1.2.8 - Highlights ¤  YUM/APT repositories for ClusterControl

¤  Deployment and scaling of single-node MySQL, MariaDB and MongoDB

¤  Alerts and incident tracking with PagerDuty

¤  Unified Event Viewer

¤  New flexible alarms/email notification system

¤  Audit logging - Administrator activity tracking

¤  Global MySQL User Management

¤  New default dashboards for MySQL/MariaDB

¤  Puppet Module for ClusterControl

¤  Improved LDAP support for Active Directory and FreeIPA

27


Confidential

Deployment of single-node MariaDB, MySQL & MongoDB

¤  Deploy single DB nodes

¤  Scale into clusters with a single click

28


Confidential

Alert & Incident Tracking: PagerDuty Integration

¤  Integrate ClusterControl alerting with PagerDuty

¤  Add phone and SMS alerting to ClusterControl

29


Confidential

Cluster-Wide MariaDB / MySQL User Management

¤  Easily create MySQL users across multiple clusters,

¤  Manage all privileges

30


Confidential

New Default Dashboards for MariaDB & MySQL ¤  InnoDB IO - shows IO read/write stats for InnoDB

¤  Query Performance - for queries such as table scans and joins without indexes

¤  Galera Flow Control - shows the replication performance

31


Confidential

Demo

32


Confidential

Customers

33


Confidential

Thank You!

¤  Cluster Configurator ¤  www.severalnines.com/config

¤  ClusterControl ¤  www.severalnines.com/clustercontrol

¤  Severalnines Blog ¤  www.severalnines.com/blog

¤  Contact: jj@severalnines

34


Full product and service offering for MariaDB and MySQL available today

•  MariaDB & MySQL Server

•  MySQL compa,ble

•  Fully open source

•  Feature enhanced

•  Galera Cluster

•  NoSQL compa,ble (Cassandra, LevelDB)

•  Tools for MariaDB & MySQL

•  Monitor, manage, backup

•  High availability

•  Cloud deployment

•  Clients for Java and C

•  Services for MariaDB & MySQL

•  Opera,ons support

•  Developer support

•  Consul,ng, training, remote DBA

02.10.14 35

Enterprise Subscrip,ons Annually renewed bundle of DB tools and services

MariaDB/MySQL Server

Services Tools


MariaDB Enterprise Subscrip,on Offers

02.10.14 36

MariaDB Enterprise MariaDB Enterprise Cluster

Summary Powerful enterprise data management. Highly available database cluster for the most demanding use cases.

Supported Database Pla?orms

●  MariaDB (Included) ●  MySQL ●  Percona XtraDB

●  MariaDB Galera Cluster (Included) ●  MySQL + Galera ●  Percona XtraDB Cluster

Comprehensive Benefits: ●  30 min. support response ●  Unlimited incidents ●  Updates and bug fixes ●  Security patches ●  Advice, hot-‐fixes ●  InstallaMon, configuraMon help ●  Email, web, remote login ●  Exclusive content ●  Roadmaps ●  OpMonal enterprise products ●  OpMonal services including

Remote DBA, ConsulMng, Training, NRE

✔ ✔

Included Third-‐party Products

●  Monitoring: MONyog ●  Query Editor: SQLyog ●  Backup: XtraBackup, Zmanda Backup

●  Cluster Deployment, Management & Monitoring : SeveralNines ClusterControl

●  Monitoring: MONyog ●  Query Editor: SQLyog ●  Backup: XtraBackup, Zmanda Backup


Ques,ons?

www.mariadb.com www.facebook.com/mariadb.dbms

www.twiker.com/mariadb

Webinar: Management and Automation of MariaDB Galera Clusters

Software

Transcript of Webinar: Management and Automation of MariaDB Galera Clusters