Running virtualized Galera instances for fun and profit
14
Running virtualized Galera instances for fun and profit Linux Conf Au 2014 - Sysadmin Miniconf Raghavendra Prabhu [email protected] Percona January 6th, 2013 Raghavendra Prabhu (Percona) Virtualized Galera January 6th, 2013 1 / 14
-
Upload
raghavendra-prabhu -
Category
Engineering
-
view
133 -
download
0
description
This is the talk given at linux conf au 2014, Perth in the sysadmin miniconf. The talk is on how Galera instances can be used better when there is virtualization in place, as in today's OpenStack environments and such.
Transcript of Running virtualized Galera instances for fun and profit
Running virtualized Galera instances for fun andprofit
Linux Conf Au 2014 - Sysadmin Miniconf
Raghavendra [email protected]
Percona
January 6th, 2013
Raghavendra Prabhu (Percona) Virtualized Galera January 6th, 2013 1 / 14
Outline
1 Introduction
2 Galera and Virtualization
3 Coming Together
4 Conclusion
Raghavendra Prabhu (Percona) Virtualized Galera January 6th, 2013 2 / 14
Introduction
Overview
Synchronous replicationGalera and PXCVirtualizationHigh AvailabilityCommonality
Raghavendra Prabhu (Percona) Virtualized Galera January 6th, 2013 3 / 14
Galera and Virtualization
Galera/PXC
What are theyHow do they workMySQL CompatibilitySynchronous replication
OthersGoogle F1/SpannerMySQL NDB
Sharding?
Raghavendra Prabhu (Percona) Virtualized Galera January 6th, 2013 4 / 14
Galera and Virtualization
Virtualization
Popular solutionsXen, KVM, OpenStackContainers - LXC, Docker, ZeroVM
Application-isolated virt
ApplicationConstraintsAdvantagesData-centers
WSCs and clusters
Raghavendra Prabhu (Percona) Virtualized Galera January 6th, 2013 5 / 14
Galera and Virtualization
Warehouse-scale
ClustersHadoop, Manta et.al.
Different from normal data-centersWhy?Homogenity of hardware and stacksDemands and constraints
Raghavendra Prabhu (Percona) Virtualized Galera January 6th, 2013 6 / 14
Coming Together
Current scenario
Popular SolutionsGlusterFS: FUSESheepdog: QEMU
Application level clusteringHow is this different
Can work with themGalera and others
Hadoop{No,New,}SQLMapreduce/Compute
Raghavendra Prabhu (Percona) Virtualized Galera January 6th, 2013 7 / 14
Coming Together
Scenarios
Necessity
Hardware of today
SaturationWSC
High Availability
MigrationWANs
Isolation
Hosting
Raghavendra Prabhu (Percona) Virtualized Galera January 6th, 2013 8 / 14
Coming Together
Deployment I
Initialisation
Bootstrapping
Cloning
QCOW zero-copy: I/OReduced memory footprint: KSMThin-provisioning: BallooningUpgrades!Load-balancing galera
Raghavendra Prabhu (Percona) Virtualized Galera January 6th, 2013 9 / 14
Coming Together
Deployment II
Operation
Migration
Live Migration: Streaming
Guest Agent
FTWRL: Xtrabackup
Shared storage
COW or CORLAN v/s WAN
Raghavendra Prabhu (Percona) Virtualized Galera January 6th, 2013 10 / 14
Coming Together
Deployment III
Storage
Single host
VirtFS: share the root!Works well with QCOW
Network
LatencySynchronous replication!
Affects pre-commit stage
virtio-net/vhost-net
Raghavendra Prabhu (Percona) Virtualized Galera January 6th, 2013 11 / 14
Coming Together
Deployment IV
Misc
Backups
Dirty bitmaps
Roles
ThrottlingReader - WriterUpgrades, maintenanceNon-homogenous hardwareAsync replication support
Raghavendra Prabhu (Percona) Virtualized Galera January 6th, 2013 12 / 14
Conclusion
Thoughts?
Questions
Usage and Experience
Raghavendra Prabhu (Percona) Virtualized Galera January 6th, 2013 13 / 14
Conclusion
Me
Raghavendra Prabhu
http://wnohang.net/about
Software Engineer at Percona and Product Lead of PXC
https://launchpad.net/percona-xtradb-cluster
Raghavendra Prabhu (Percona) Virtualized Galera January 6th, 2013 14 / 14
