Webinar slides: Severalnines & MariaDB present: Automation & Management of MariaDB 10.2 with the new...

December 5, 2017

Introducing ClusterControl 1.5 With MariaDB 10.2 support … and more!

Johan Andersson, CTO SeveralninesPresenter

[email protected]

Copyright 2017 Severalnines AB

I'm Jean-Jérôme from the Severalnines Team and I'm your host for today's webinar!

Feel free to ask any questions in the Questions section of this application or via the Chat box.

You can also contact me directly via the chat box or via email: [email protected] during or after the webinar.

Your host & some logistics



About Severalnines and ClusterControl


What we do

Manage Scale

Monitor Deploy


Provisioning

Deploy a cluster in minutes

On-premises or in the cloud (AWS)

Monitoring

Systems view

1sec resolution

DB / OS stats & performance advisors

Configurable dashboards

Query Analyzer

Real-time / historical

ClusterControl Automation & Management

Management

Multi cluster/data-center

Automate repair/recovery

Database upgrades

Backups

Configuration management

Cloning

One-click scaling


Supported Databases


Customers



MariaDB 10.2

Ralf Gebhardt, Product Manager MariaDBPresenter

[email protected]

LAYOUT

Title Slide (Dark)

MariaDB TX 2.0OverviewRalf Gebhardt

LAYOUT

Title OnlyPowerPoint Default

MariaDB TX 2.0

MariaDB Services

RemoteAdministration

EnterpriseArchitecture

MigrationManagement

TechnicalSupport

MariaDB Tools

MariaDBAdmin

MariaDBMonitor

MariaDBBackup

MariaDBNotifications

Pluggable Storage

Replication

MariaDB Server

Pluggable Storage

Replication

MariaDB Server

Pluggable Storage

Replication

MariaDB Server

MariaDB Cluster

MariaDB Connectors

MariaDB MaxScale (Proxy)

Failover Sharding Streaming Caching

Security Routing

Transaction Platform

LAYOUT

Comparison (Dark/Blue)

EnterpriseReliability

High Availability

Disaster Recovery

Scalability

Performance

Security

Open Development

Extensible Architecture

Community Collaboration

Flexible Data Model

Streaming Integration

Community Innovation

LAYOUT

Section Header (Dark)

MariaDB TX 2.0

What’s new in MariaDB Server 10.2

LAYOUT


SQL Completeness

Common Table ExpressionsHelps make complex queries easier to read and maintain by breaking them down into simpler building blocks

Window FunctionsHelps eliminate expensive subqueries and self-joins, improving query performance, and helps make queries easier to read

JSON and GeoJSON functionsHelps developers read and write native JSON documents using SQL functions. GeoJSON functions transfer spatial data types to/from JSON

Window function exampleSELECT depname, empno, salary, avg(salary)OVER (PARTITION BY depname) FROM empsalary;

With CTEs and Window functions as well as JSON functions, MariaDB Server delivers comprehensive SQL that can handle multiple data models

depname empno salary avg

Engineering 11 5200 4700

Engineering 8 4200 4700

HR 9 6000 5000

HR 5 4000 5000

Sales 2 7000 5500

Sales 4 4000 5500

LAYOUT


Schema Compatibility

Check constraints Helps a DBA to enforce data consistency on the database server level without the need to implement triggers

Multiple triggersof the same type (BEFORE, AFTER) can be created per table

Decimal pointIncreased decimal point from 30 to 38 . A requirement especially in Finance.

Check constraints exampleSchema compatibility features allow MariaDB Server to be a practical alternative to legacy enterprise databases

CREATE TABLE jsontable (

id INTEGER NOT NULL PRIMARY KEY

AUTO_INCREMENT,

jsonfield VARCHAR(1024),

category VARCHAR(20) as

(JSON_VALUE(jsonfield,'$.category')),

KEY jsonkey (category),

CHECK (JSON_VALID(jsonfield)));

LAYOUT


Performance and Scalability

Indexes for virtual columnsWith supporting indexes, virtual columns can be used efficiently for searching on computed columns, like for JSON attributes.

MyRocks• Storage Engine developed by Facebook as a more

efficient alternative to InnoDB, based on RocksDB • 2x better compression, 10x less write amplification,

faster replication, faster data loading

MariaDB MaxScale Query CacheHelps improve the performance of repeat queries by caching the results within the proxy, either in memory or on disk (2.8x performance improvement)

Indexed virtual Columns, new storage engine and enhanced database proxy for a high performance and scalable database

Database Size

Test Iteration (1 hour/iteration)

Size

(G

B)

InnoDB (uncompressed)

InnoDB (compressed)

MyRocks (compressed)

LAYOUT


Security

Data MaskingHelps meet HIPAA/PCI requirements by masking sensitive data on a per-column, per-user basis

Binary Log based RollbackHelps DBAs recovery faster (minutes instead of hours) by rolling back recent transactions based on a point in time rather than restoring data from a backup, can apply to specific tables or the entire database

Data masking exampleTighter security with the most capable database firewall for data masking, DoS protection

SELECT name, ssn FROM tbl_customers WHERE id = 100;

name ssn-------------------------------Shane Johnson XXX-XX-XXXX

LAYOUT


Recovery and Replication

Compressed Replication Helps to reduce binary log size and network traffic

Delay between Master and Slave A delay between master and slave can be configured on the slave and will be enforced by the replication sql threads.

Binary Log based RollbackHelps DBAs recovery faster (minutes instead of hours) by rolling back recent transactions based on a point in time rather than restoring data from a backup, can apply to specific tables or the entire database

Data masking exampleEnhanced replication options for the most used read scaling solution and fast disaster recovery

CHANGE MASTER TO master_delay=3600;

LAYOUT

Section Header (Dark)

Future

MariaDB Server 10.3

LAYOUT


Overview MariaDB Server 10.3

Temporal Data processing • System Versioned Tables include timestamped

version of the data in a table.

Database Compatibility Enhancements• PL/SQL compatibility parser• PL/SQL style packages• Sequences• INTERSECT and EXCEPT to complement UNION• Invisible Columns• New ROW type and type of for stored functions

Performance• ADD INSTANT COLUMN for InnoDB• Statement based lock wait timeouts

Flexibility• User defined aggregate functions• Compressed Columns• Proxy protocol support

Scalability• Spider storage engine updated to the latest release

Removed limitations• DELETE statement can delete from the table that

is used in a subquery in the WHERE clause• UPDATE statements can use same source and

target

Thank you

LAYOUT

Thank You (Dark)



About ClusterControl

ClusterControl Platform


ClusterControl

CC ClientsNotifications

Email

PagerDuty

VictorOps

OpsGenie

Slack

TeleGram

Webhooks

Web UI

S9s CLI

JSON RPC

Support24/7

KeepAlived

HAProxy ProxySQL MaxScale

GaleraMariaDb

Percona

ReplicationMariaDb

Percona

MongoDbMongoDb Inc

Percona

PostgreSqlPgSQL

Codership

CloudBackup

What Problems do we Address?


DeployDeploy MySQL, Postgres or MongoDB - single instances or entire clusters

MonitorGet a unified view of all clusters across all your datacenters

ScaleAdd/remove nodes, resize instances & clone your production clusters

ManageAutomatically repair & recover broken nodes or clusters. Test & automate upgrades

Deployment Features in ClusterControl


● Each Cluster can be deployed and existing Clusters can be imported.● Web UI

○ Deployment Wizard● CLI

○ Allows easy integration with e.g Ansible s9s cluster --create --cluster-type=galera --nodes='10.10.10.26;10.10.10.27;10.10.10.28' --vendor=percona --cluster-name=PXC_CENTOS7 --provider-version=5.7 --os-user=vagrant --wait

● Supports multiple NICs and templated configurations.

Monitoring Features in ClusterControl


● Database specific stats and Health status○ Graphs and Dashboards

● Host statistics ○ E.g Predictive disk space usage monitoring

● Query Monitoring○ E.g Top Queries, Outlier detection

● Advisors○ Developer Studio with JS like syntax

● Notifications○ Email, Pagerduty, VictorOps etc

● Operational Reports

Management Features in ClusterControl


● Availability○ Node/Cluster Recovery

● Backup and Restore○ MySQL: mysqldump, xtrabackup○ Postgres: pg_dump, pg_basebackup○ MongoDb: Mongdump, MongoDb

Consistent Backup● Configuration ● Upgrades● Loadbalancer

○ HAProxy, ProxySQL, MaxScale○ KeepAlived

Scaling Features in ClusterControl


● Horizontal Scaling○ Add / Remove Nodes

● Load Balancers are updated automatically

Load Balancer Load Balancer Load Balancer Load Balancer

Load Balancer Load Balancer Load Balancer



ClusterControl 1.5

Support for New Technologies


MySQL Cluster (NDB) v7.5 support

MariaDB v10.2 support (Galera and MySQL Replication)

PostgreSQL v10 support

Improved Cloud Services


● Cloud Services (AWS S3 and Google Cloud Storage)○ Manual upload or schedule

backups to be uploaded after completion to the cloud.

○ Download and restore backups from a cloud storage.

New Backup Features for MySQL


● Backups (MySQL)○ Backup individual databases separately

(mysqldump only).○ Upload, download and restore backups stored

in the cloud.○ Trigger a verification and restore of a backup

after N hours of completion.○ Rebuild a replication slave by staging it from

an existing backup.○ Add a new replication slave by staging it from

an existing backup.

Improved PostgreSQL Support


● PostgreSQL○ New backup method pg_basebackup

which makes a binary copy of the database files.

○ Synchronous replication failover (support for synchronous_standby_names).

○ Support for HAProxy with Keepalived.○ Support for PostgreSql 10.

Improved ProxySQL Support


● ProxySQL○ Mass import existing database users into ProxySQL.○ Add and modify scheduler scripts.

Other New Features


● Further Highlights○ Added support to show and filter DB status variables for MongoDB

nodes.○ HTML formatted alarm and digest emails.○ Multiple NICs supports when deploying Load balancers (HAProxy).○ Continuous improvements to UX/UI and performance.○ New cmon-cloud process and clud client to handle cloud services.○ New Report: Database Growth



ClusterControl DEMO



Q&A

End of Year Promotion

Get Three Months Free with an Annual Contract

Our Best Offer Ever!Just Sign By December 31st!

Additional Resources


● ClusterControl 1.5 release announcement● Download ClusterControl● ClusterControl for MariaDB 10.2● End of year promotion: get 3 additional months free if

you sign up for annual ClusterControl subscriptions by December 31st 2017: [email protected]

https://severalnines.com/blog/announcing-clustercontrol-15-featuring-automatic-backup-verification-and-cloud-upload

https://severalnines.com/download-clustercontrol-database-management-system

https://severalnines.com/blog/clustercontrol_supports_mariadb_10_2

mailto:[email protected]

Webinar slides: Severalnines & MariaDB present: Automation & Management of MariaDB 10.2 with the new...

Internet

Transcript of Webinar slides: Severalnines & MariaDB present: Automation & Management of MariaDB 10.2 with the new...