MariaDB for the Enterprise

19.06.2014


MariaDB


MariaDB Versions


MariaDB 10.0

Scalability● Advanced parallel replication● Sharding● MaxScale proxy (future)

Performance● Enhanced optimization● Improved and special purpose storage engines● Carefully tuned and enhanced server internals● Advanced performance monitoring

Availability ● HA clustering - integrating Galera cluster● More online operations, less planned downtime

NoSQL● Interoperable storage engines such as Cassandra and Connect● Dynamic columns and JSON processing● HandlerSocket API

Operations ● Comprehensive diagnostics built-in to the DB● APIs and open architecture for easier integration

Security● Role-based access control● Authentication plugins● Sophisticated auditing capabilities

© 2014, MariaDB Corp.

Global Transaction ID (GTID)

● New MariaDB exclusive global event ID unique across multiple independent replication streams.

○ DomainID added to SeqNum-ServerID to uniquely label replication events.

○ Slaves save their replication status in a crash-safe table, transactionally synced to the slave’s binlog.

○ Replication streams always strictly ordered, but independent streams may be interleaved on the slave.

● Much simpler failover to new master with complex topologies.

● Supports multi-source and parallel replication.

A1

A2

A3

A4

A5

B1

B2

B3

B4

B5

A1

A2

B1

A3

B2

B3

A4

A 4

B 3

Crash-safeReplication State

XXDomainID

32-bit

YYYYSeqNum

64-bit

ZZServerID

32-bit

MariaDB GTID


● Sponsored by Google.● Allows slaves to

process update eventsin parallel.

● Uses MariaDB 10’simproved GlobalTransaction ID (GTID).

● Preliminary benchmarks: almost 10x faster at 12 threads.


Multi-Source Replication

● Collects data foranalytics usingbuilt-in replication.

● Aids in administrationexample: consolidatedbackups of multiple databases.

● Uses MariaDB 10’s improvedGlobal Transaction ID (GTID).

Online E-Commerce Application

Master S S S S

Content Management

System

Click-stream data

Data WarehouseSlaveETL

Master S S S S

Master S S S S


Multi-DC Replication


● Clustered MariaDB nodescooperate to remain in sync.

● With multiple master nodes,reads and updates both scale.

● Synchronous replication withoptimistic locking delivers highavailability with little overhead.

● Fast failover because all nodes remains synchronized.

● Integrated and tested binaries.

MariaDB Galera Cluster

Load Balancingand Failover

Application / App Server


Sharding with Spider

● Contributed by a 3rd party developer.● Storage engine partitions large tables

across multiple DBs.● No changes to the client application.● Developers aren’t aware, can keep

applications simple.● Allows for more

parallelism, scale-out.● Transactional storage

engine.

.

Application

Customers

A-HI-PQ-Z

Spider

Customers

A-H

Shard 1

Customers

I-P

Shard 2

Customers

Q-Z

Shard 3


MariaDB 10 Performance:TokuDB Storage Engine

● 3rd party partner - TokuTek.● Drop-in replacement for

InnoDB/XtraDB.● Advanced indexing and

compression algorithms.● Transactional.● Up to 20x performance gain

for inserts/updates.● Up to 90% less disk storage.● Online schema changes.● Reduces or eliminates slave lag.● Best when DB doesn’t fit in memory,

and SSD longevity is important.


Optimizer Improvements

● Enhancements include:○ Disk access optimizations.○ JOIN optimizations.○ Subquery optimizations.○ Optimized derived tables and views.○ Execution control.○ Optimizer control.○ EXPLAIN improvements.

Less I/O, CPU, memory requirements. Faster execution.


CPU Cache

DRAM

Disks, SANs

Nanoseconds Microseconds Milliseconds

6 orders of magnitude

How Does Fusion-io Flash Storage Accelerate Databases?


How Much Faster Is MariaDB 10 With Fusion-io?

About 24 times faster


MariaDB 10 Interoperability:CONNECT Storage Engine

● From 3rd party developer.● Maps diverse data

to tables.● JOIN mapped data

to DB tables.● Flat files including CSV.● Tables in external DBs.● Generated tables

(PIVOT etc.)● Plug-in API for your own mappings.

Powerful tool for data integration, federation.

Application

Spider

MariaDB Parser/Optimizer/Connection Pool

CONNECTEngine

OtherEngines

DatabaseTables

.log

XMLCSV


MariaDB 10 Interoperability:Cassandra Storage Engine

● Window into a Cassandra ring:read/write like a table in MariaDB.

● Use standard SQL queries.● JOIN Cassandra data

to MariaDB tables.● Use a MariaDB cluster

for high-availabilityaccess.

● Bring data fromCassandra into OLTPapplications.

Application

Spider

DatabaseTables

MariaDB Parser/Optimizer/Connection Pool

CassandraEngine

OtherEngines


Dynamic (& Virtual) Columns

● Store unstructured data in MariaDB tables with a simple API.● Use MariaDB’s indexing and transactions to manipulate

“document” style data fast and consistently.● Nest sets of dynamic columns inside of other dynamic columns -

hierarchical structuring.● Include multiple rows with dynamic columns in transactions.● Virtual Columns allows to create function based columns

Cust ID Account Balance Dyn_Col_BLOBs

2035 $154.04 NAME: John Smith|LOC: 45.35243, -74.98348|IMAGE: x27A8B8C ...

2036 $929.10 NAME: Jane Doe|LOC: 45.35243, -74.98348|AGE: 32| GENDER: F...

2037 $377.53 NAME: Carol Jones|AGE: 43|GENDER: F||IMAGE: xA9674DE678 ...


MariaDB [test]> create table t1 (id int auto_increment primary key, -> name varchar(40), -> type enum ("shirt", "phone", "computer"), -> price decimal(10,2), -> dynstr mediumblob);Query OK, 0 rows affected (0.11 sec)

MariaDB [test]> insert into t1 (name, type, price, dynstr) values -> ("Funny shirt", "shirt", 10.0, COLUMN_CREATE(1, "blue", 10, "XL")), -> ("nokia", "phone", 649, COLUMN_CREATE(1, "black", 2, "touchscreen")), -> ("htc Desire hd", "phone", 579, COLUMN_CREATE(1, "black", 3, "Android")), -> ("BM/Lenovo Thinkpad X60s", "computer", 419, COLUMN_CREATE(1, "black", 3, "Linux"));Query OK, 4 rows affected (0.04 sec)Records: 4 Duplicates: 0 Warnings: 0

MariaDB [test]> select id, name, type, price, length(dynstr) as len, column_list(dynstr) as list from t1;+----+-------------------------+----------+--------+------+------+| id | name | type | price | len | list |+----+-------------------------+----------+--------+------+------+| 1 | Funny shirt | shirt | 10.00 | 17 | 1,10 || 2 | nokia | phone | 649.00 | 27 | 1,2 || 3 | htc Desire hd | phone | 579.00 | 23 | 1,3 || 4 | BM/Lenovo Thinkpad X60s | computer | 419.00 | 21 | 1,3 |+----+-------------------------+----------+--------+------+------+4 rows in set (0.03 sec)


MariaDB [test]> select name from t1 where COLUMN_GET(dynstr, 1 as char(10)) = "black";+-------------------------+| name |+-------------------------+| nokia || htc Desire hd || BM/Lenovo Thinkpad X60s |+-------------------------+3 rows in set (0.01 sec)

MariaDB [test]> MariaDB [test]> select name, COLUMN_GET(dynstr, 1 as char(10)) from t1 where COLUMN_EXISTS(dynstr, 1);+-------------------------+-----------------------------------+| name | COLUMN_GET(dynstr, 1 as char(10)) |+-------------------------+-----------------------------------+| Funny shirt | blue || nokia | black || htc Desire hd | black || BM/Lenovo Thinkpad X60s | black |+-------------------------+-----------------------------------+4 rows in set (0.00 sec)


Security


Operations

● Improved Table Discovery - less work for DBAs;integrates storage engines. ✔ exclusive to MariaDB 10

● SHOW PLUGINS SONAME - dynamic report oninstalled components. ✔ exclusive to MariaDB 10

● SHUTDOWN Command - apps can shutdown the databaseprogrammatically. ✔ exclusive to MariaDB 10

● Kill Query by Query ID - fix performance blocks .● Online ALTER TABLE - schema changes without downtime.● Per-thread Memory Statistics - easier tuning and problem

diagnosis. ✔ exclusive to MariaDB 10

● Improved Error Messages - faster problem solving.✔ exclusive to MariaDB 10


● Audit Plugin 1.1 includes table event logging such as triggers and stored procedure calls, unique to its integration with MariaDB.

● Building on these capabilities, V2.0 of the Audit Plugin is planned to include:○ Optional field substitution of placeholders in query logs to improve

privacy and security.○ Integration with MariaDB 10 Role-based Access Control - filtering

audit logs by role.○ Recording of privilege changes as auditable events.○ Log rotation.

● Projected availability: November, 2014.

MariaDB Audit Plugin 2.0 Roadmap


Introducing MariaDB MaxScale, Web Scale Database Proxy

MaxScale hides complexity, making clusters of systems look like a single

server to a client.

● Simplifies complex replication schemesfor massive scale, high availability.

● Manages performance with logging.● Safeguards data through firewall filtering.● Connects diverse clients and databases

with multiple protocols, query transformations.

Client Simple

Requests

MaxScale


MariaDB MaxScale: Lightweight, Modular, Intelligent, Transparent

ProtocolAuthenticatio

n

Mon

itorFilter &

LoggingRouting

MaxScaleCore

Routing

● MaxScale core is a high-performance message switch.

● Module APIs allow for multiple modules ofeach type.

● Modules can be client-facing, back-end facing, internal, or connect to other DBs.

19.06.2014

MaxScae

Each application server uses 2 connections: 1 R/W, 1 R

MaxScale connects the R/W client connections to the master and the R

connections are load-balanced to all slaves

Each application server uses only 1 connection

MaxScale creates 2 connections, one for R/W on the master node and one for R/O

load balanced on the slave nodes

MaxScale

R/WSplitting

MaxScale monitors the state of each node and only applies

operations on available slaves


Only fully synchronised nodes are included

MaxScale monitors the state of the nodes and load balances all

operations

MaxScale


If the “master” node fails a new one can be elected immediately

MaxScale selects one node as ”master” and the other nodes as ”

slaves”

MaxScale


MariaDB 10.0 Roadmap

MariaDB 10.0 10.0.X Releases through 2014

Performance● Thread pool improvements including Percona enhancements.● SHOW EXPLAIN improvements (PARTITIONS, EXTENDED attributes).

Scalability ● Supportability matrix and testing for combining MariaDB 10 and MySQL 5.6 replication.

Interoperability

● Port and optimize for IBM’s Power 8 architecture (in conjunction with IBM).

● Improvements to CONNECT engine.● Experimental Mroonga Asian full-text search engine.


MariaDB 10.1 RoadmapMariaDB 10.1

10.1 Beta Tentative Q4 CY201410.1 GA Tentative Q1 CY2015

Performance

● Per-query variables.● userstat improvements.● NUMA enhancements.● Improved thread management● Remote and portable tablespaces● Query timeouts.● InnoDB:

○ >16K InnoDB buffers.○ InnoDB defragmentation.○ InnoDB persistent auto-increment.○ InnoDB forced primary key.○ SHOW ENGINE INNODB STATUS.

● Memory engine varchar, BLOB types, default_tmp_storage_engine.● Merge WebscaleSQL improvements, integrate stress test.● UNION ALL without temporary tables.● Optimizer enhancements:

○ Semi-joins + outer-joins.○ Optimizer trace.○ EXPLAIN JSON.○ EXPLAIN ANALYZE.



MariaDB 10.110.1 Beta Tentative Q4 CY201410.1 GA Tentative Q1 CY2015

Scalability

● Performance tuning Parallel Replication and GTID, benchmarks.● Row-level parallel replication enhancements.● Slave execution of triggers.● Selected WebscaleSQL scalability enhancements.

Availability ● Full integration of Galera Cluster into MariaDB.

Interoperability ● Open Query Graph (OQGRAPH) engine improvements.● GIS improvements: full OGC compliance (map data).

Operations● New Performance Schema instruments.● Progress report on mysqldump.● CREATE OR REPLACE for most database objects (GSOC).



MariaDB 10.110.1 Beta Tentative Q4 CY201410.1 GA Tentative Q1 CY2015

Security

● Kerberos authentication support through plug-in.● Password Validation Plugin.● Password improvements in the server:

○ Set password expiry dates.○ Lock passwords after failed attempts.

● Audit Plugin addition: Track password changes.● Role-based access control improvements and performance tuning.

Other Features

● Version control in GitHub.● Additional character set and collation options.● Multiple triggers per table.● MDL improvements.● IPv6/IPv4 datatype.


Resources

● bugs: mariadb.org/jira● mailing lists:

○ [email protected]○ [email protected]

● fb.com/MariaDB.dbms● twitter: @mariadb● #maria on irc.freenode.net● https://mariadb.com/kb/en● downloads: https://downloads.mariadb.org

○ apt,yum repositoriies available● Default in RHEL7, SuSE 12, Fedora, Slackware, Archlinux etc etc

mailto:[email protected]




https://mariadb.com/kb/en

https://mariadb.com/kb/en

https://downloads.mariadb.org

MariaDB for the Enterprise

Technology

Transcript of MariaDB for the Enterprise