Languages
Pages
Legal
Running virtualized Galera instances for fun andprofit
Linux Conf Au 2014 - Sysadmin Miniconf
Raghavendra [email protected]
Percona
January 6th, 2013
Raghavendra Prabhu (Percona) Virtualized Galera January 6th, 2013 1 / 14
Outline
1 Introduction
2 Galera and Virtualization
3 Coming Together
4 Conclusion
Raghavendra Prabhu (Percona) Virtualized Galera January 6th, 2013 2 / 14
Introduction
Overview
Synchronous replicationGalera and PXCVirtualizationHigh AvailabilityCommonality
Raghavendra Prabhu (Percona) Virtualized Galera January 6th, 2013 3 / 14
Galera and Virtualization
Galera/PXC
What are theyHow do they workMySQL CompatibilitySynchronous replication
OthersGoogle F1/SpannerMySQL NDB
Sharding?
Raghavendra Prabhu (Percona) Virtualized Galera January 6th, 2013 4 / 14
Galera and Virtualization
Virtualization
Popular solutionsXen, KVM, OpenStackContainers - LXC, Docker, ZeroVM
Application-isolated virt
ApplicationConstraintsAdvantagesData-centers
WSCs and clusters
Raghavendra Prabhu (Percona) Virtualized Galera January 6th, 2013 5 / 14
Galera and Virtualization
Warehouse-scale
ClustersHadoop, Manta et.al.
Different from normal data-centersWhy?Homogenity of hardware and stacksDemands and constraints
Raghavendra Prabhu (Percona) Virtualized Galera January 6th, 2013 6 / 14
Coming Together
Current scenario
Popular SolutionsGlusterFS: FUSESheepdog: QEMU
Application level clusteringHow is this different
Can work with themGalera and others
Hadoop{No,New,}SQLMapreduce/Compute
Raghavendra Prabhu (Percona) Virtualized Galera January 6th, 2013 7 / 14
Coming Together
Scenarios
Necessity
Hardware of today
SaturationWSC
High Availability
MigrationWANs
Isolation
Hosting
Raghavendra Prabhu (Percona) Virtualized Galera January 6th, 2013 8 / 14
Coming Together
Deployment I
Initialisation
Bootstrapping
Cloning
QCOW zero-copy: I/OReduced memory footprint: KSMThin-provisioning: BallooningUpgrades!Load-balancing galera
Raghavendra Prabhu (Percona) Virtualized Galera January 6th, 2013 9 / 14
Coming Together
Deployment II
Operation
Migration
Live Migration: Streaming
Guest Agent
FTWRL: Xtrabackup
Shared storage
COW or CORLAN v/s WAN
Raghavendra Prabhu (Percona) Virtualized Galera January 6th, 2013 10 / 14
Coming Together
Deployment III
Storage
Single host
VirtFS: share the root!Works well with QCOW
Network
LatencySynchronous replication!
Affects pre-commit stage
virtio-net/vhost-net
Raghavendra Prabhu (Percona) Virtualized Galera January 6th, 2013 11 / 14
Coming Together
Deployment IV
Misc
Backups
Dirty bitmaps
Roles
ThrottlingReader - WriterUpgrades, maintenanceNon-homogenous hardwareAsync replication support
Raghavendra Prabhu (Percona) Virtualized Galera January 6th, 2013 12 / 14
Conclusion
Thoughts?
Questions
Usage and Experience
Raghavendra Prabhu (Percona) Virtualized Galera January 6th, 2013 13 / 14
Conclusion
Me
Raghavendra Prabhu
http://wnohang.net/about
Software Engineer at Percona and Product Lead of PXC
https://launchpad.net/percona-xtradb-cluster
Raghavendra Prabhu (Percona) Virtualized Galera January 6th, 2013 14 / 14
Top Related