Why MySQL High Availability Matters

Copyright©2017,Oracleand/oritsaffiliates.Allrightsreserved.|

WhyMySQLHighAvailabilityMaFersMaFLordMySQLProductManager@maFalord


SafeHarborStatementThefollowingisintendedtooutlineourgeneralproductdirecNon.ItisintendedforinformaNonpurposesonly,andmaynotbeincorporatedintoanycontract.Itisnotacommitmenttodeliveranymaterial,code,orfuncNonality,andshouldnotberelieduponinmakingpurchasingdecisions.Thedevelopment,release,andNmingofanyfeaturesorfuncNonalitydescribedforOracle’sproductsremainsatthesolediscreNonofOracle.

3


ProgramAgenda

4

HighAvailabilityExplained

NaNveMySQLHighAvailability

HighlyAvailableMySQLReferenceArchitectures

What’sComingNextforMySQLHAandScale?

1

2

3

4


ProgramAgenda

5





1

2

3

4


HighAvailability:TermsandConcepts• Availability

– OutageanddownNme– MeanTimeBetweenFailures(MTBF)– MeanTimeToRecover(MTTR)– ServiceLevelAgreement(SLA)– TheNine’sScale:5nines=5minsdownNmeperyear

• Capacity/Performance• Redundancy•  FaultTolerance• DisasterTolerance/Recovery

6


HighAvailability:ConsideraNons•  SLArequirements

– WhatisneededtosupportyourbusinessobjecNves

• OperaNonalcapabiliNes– Willyouhavetheworkforcetoimplementandmaintainit

•  Serviceagility– Canitgrowandchangeasyourcompanydoes

•  Timetomarket– Canyougotomarketquickly

• Budgetaryconstraints– CostofdownNmeversuscostofHAimplementaNon

7

WhatToUse?


HighAvailability:Factors•  Environment

– Redundantserversindifferentdatacentersandgeographicalareaswillprotectyouagainstregionalissues—powergridfailures,hurricanes,earthquakes,etc.

• Hardware– Eachpartofyourhardwarestack—networking,storage,servers—shouldberedundant

•  Sogware– Everylayerofthesogwarestackneedstobeduplicatedanddistributedacrossseparatehardwareandenvironments

• Data– Datalossandinconsistency/corrupNonmustbepreventedbyhavingmulNplecopiesofeachpieceofdata,withconsistencychecksandguaranteesforeachchange

8


HighAvailability:DesignFactors• Reliability,Availability,andServiceability(RAS)

– Reliability•  Qualityhardwareandsogwarecomponentsthatyoucanmanageandtrust

– Availability• MulNplecopiesofeachdatumreplicatedtoseparatehardware• MulNplecopiesofeachpieceofthehardwareandsogwarestack• MulNplephysicallocaNons

– Separatepowergrids– Enoughphysicaldistancetosurvivedisasterssuchasfloods,earthquakes,andpowergridoutages

•  Resiliency– AutomaNontotransparentlydealwithanypotenNalfailureintheinfrastructure,hardware,sogware

– Serviceability•  Ensurethatyoucanmonitor,diagnose,maintain,andrepairitall

9


HighAvailability:AcceptablePerformance• Performanceoutsideofacceptableboundsisunavailability

– DetermineyouracceptableapplicaNonresponseNmes– Ensurethatyoucanmeasureimpactfromeachlayerofstack– Determinefailureversusload

•  Scaleup/outorfailover

• BuildelasNcityintoeachlayer– QuicklyandeasilyscaleupanddowntohandlechangingloadandtrafficpaFerns

10


HighAvailability:TheCausesofDownNme

11

40%

40%

20%

Sogware/ApplicaNon HumanError Hardware*Source:GartnerGroup1998survey

AstudybytheGartnerGroupprojectedthatthrough2015,80%ofdownNmewillbeduetopeopleandprocessissues


HighAvailability:TheBusinessCostofDownNme• CalculateacostperminuteofdownNme

– Averagerevenuegeneratedper-minuteoverayear– CostofnotmeeNnganycustomerSLAs– FactorincoststhatarehardertoquanNfy1.  Revenue2.  ReputaNon3.  CustomersenNment4.  Stockprice5.  Service’ssuccess6.  Company’sveryexistence

12

THIS iswhyHAma;ers!


HighAvailability:DatabaseNeeds• Managementinfrastructure

– Monitoringofstatus,health,performance•  FaciliNesforservicechanges,servicetransiNons

•  FailuredetecNonandhandling– IdenNfyandhandlefailures

•  ElasNcity– Scaleuptoensureacceptableperformanceisalwaysmaintained

• Consistencyguarantees– ConflictdetecNonandhandling;datalossprotecNon/prevenNon

• Onlinemaintenance

13


• RecoveryTimeObjecNve– MaximumlengthofdownNmebeforethereisbreakin“businessconNnuity”

• RecoveryPointObjecNve– PointinNmetowhichdatamustberecoveredwhenserviceisre-established

Tier 1 •  Mission-critical services

Tier 2 •  Business-critical services

Tier 3 •  Task-critical services

Tier 4 •  Non-critical services

14

HighAvailability:DoesTheApplicaNonRequireIt?


MySQLMaster/SlaveReplicaEon

Master/SlavewithAutomatedFailover

DRBD

OSorVMvendoracEve/passivesoluEons

MySQLGroupReplicaEon

HighAvailability:CommonMySQLSoluNons

9 9 . 9 9 9 %

15

ConEnuousAvailability


ProgramAgenda

16





1

2

3

4


C

B

A

C

B

ACRASH

C

B

A

NowBisthenewmaster

UhOh! It’sOK!

Amajorbuildingblockforhighavailability

WhatisReplicaNonUsedFor?

17


GroupReplicaEon

18

AppServerswithMySQLRouter

MySQLGroupReplicaNon

“HighAvailabilitybecomesacorefirstclassfeatureofMySQL!”


MySQLGroupReplicaNon:WhatIsIt?• GroupReplicaNonlibrary

– ImplementaNonofReplicatedDatabaseStateMachinetheory• MySQLGCSisbasedonPaxos(variantofMencius)

– ProvidesvirtuallysynchronousreplicaNonforMySQL5.7+– SupportedonallMySQLpla>orms

•  Linux,Windows,Solaris,OSX,FreeBSD“Mul?-masterupdateanywherereplica?onpluginforMySQLwithbuilt-inconflictdetec1onandresolu1on,automa1cdistributedrecovery,andgroupmembership.”

19




•  AhighlyavailabledistributedMySQLdatabaseservice– Clusteringeliminatessinglepointsoffailure(SPOF)

•  Allowsforonlinemaintenance– Removestheneedformanuallyhandlingserverfail-over– Providesdistributedfaulttoleranceandself-healing– EnablesAcNve/AcNveupdateanywheresetups– AutomatesreconfiguraNon(adding/removingnodes,crashes,failures)– Makesiteasytoscaleup/downbasedondemand– AutomaNcallyensuresdataconsistency

•  Detectsandhandlesconflicts•  Preventsdataloss•  PreventsdatacorrupNon

20

MySQLGroupReplicaNon:WhatDoesItProvide?


MySQLGroupReplicaNon:UseCases•  ElasEcReplicaEon

– EnvironmentsthatrequireaveryfluidreplicaNoninfrastructure,wherethenumberofservershastogroworshrinkdynamicallyandwithliFlepainaspossible.

• HighlyAvailableShards– Shardingisapopularapproachtoachievewritescale-out.UserscanuseMySQLGroupReplicaNontoimplementhighlyavailableshardsinafederatedsystem.EachshardcanmapintoaReplicaNonGroup.

• AlternaEvetoMaster-SlaveReplicaEon– ItmaybethatasinglemasterservermakesitasinglepointofcontenNon.WriNngtoanenNregroupmayprovemorescalableundercertaincircumstances.

21


MySQLGroupReplicaNon:WhatSetsItApart?

•  BuiltbytheMySQLEngineeringTeam– NaNvelyintegratedintoServer:InnoDB,ReplicaNon,GTIDs,PerformanceSchema,SYS– Built-in,noneedforseparatedownloads– Availableonallplaxorms[Linux,Windows,Solaris,FreeBSD,etc]

•  BeFerperformancethansimilarofferings– MySQLGCShasopNmizednetworkprotocolthatreducestheimpactonlatency

•  Easiermonitoring– SimplePerformanceSchematablesforgroupandnodestatus/stats– NaNvesupportforGroupReplicaNoncomingtoMySQLEnterpriseMonitor

• ModernfullstackMySQLHAbeingbuiltaroundit– NaNveend-to-endeasytouseshardedInnoDBclusters

22


MySQLGroupReplicaNon:Architecture

NodeTypesR:Trafficrouters/proxies:mysqlrouter,haproxy,sqlproxy,...M:mysqldnodesparNcipaNnginGroupReplicaNon

23


MySQLGroupReplicaNon:Stack•  TheGroupReplicaNonpluginisresponsiblefor

– MaintainingdistributedexecuNoncontext– DetecNngandhandlingconflicts– Handlingdistributedrecovery

•  Detectmembershipchanges•  Donatestateifneeded•  Collectstateifneeded

– ProposingtransacNonstoothermembers– ReceivingandhandlingtransacNonsfromothermembers

– DecidingtheulNmatefateoftransacNons•  commitorrollback

24

GCSAPI

ReplicaEonPlugin

PluginAPI

MySQLServer

Group Comm. System (Corosync) GroupCom.Engine


MySQLGroupReplicaNon:Stack•  TheGroupCommunicaNonSystemAPI:

– AbstractstheunderlyinggroupcommunicaNonsystemimplementaNonfromthepluginitself

– MapstheinterfacetoaspecificgroupcommunicaNonsystemimplementaNon

•  TheGroupCommunicaNonSystemengine:– VariantofPaxosdevelopedatMySQL– Buildingblocktoprovidedistributedagreementbetweenservers

25

GCSAPI

ReplicaEonPlugin

PluginAPI

MySQLServer

Group Comm. System (Corosync) GroupCom.Engine


MySQLGroupReplicaNon:PerformanceComparison

26


MySQLRouter

•  TransparentclientconnecNonrouNng– Loadbalancing– ApplicaNonconnecNonfailover

•  StatelessdesignofferseasyHAclientrouNng– AlocalRouterbecomespartoftheapplicaNonstack”MySQLRouterallowsyoutoeasilymigrateyourstandaloneMySQLinstancestona?velydistributedandhighlyavailableGroupReplica?onclusterswithoutaffec?ngexis?ngapplica?ons!”

27

TransparentAccesstoHADatabasesforMySQLApplicaEons




ProgramAgenda

28





1

2

3

4


HardwareandInfrastructureNotes

•  3,5,or7machinespergroup– Isolatemachineresourcesasmuchaspossible– LimitvirtualizaNonlayers– Machinesconfiguredfordedicateddatabaseserverrole

•  RecommendedconfiguraNon– 32-64vCPUswithfastCPUclock(2.5GHz+)– SSDs(fordataandreplicaNonlogs)

– HighqualitynetworkconnecNonbetweeneachmachine•  Lowlatency,highthroughput,reliable•  Limitroutersandhubsasmuchaspossible•  Isolatedanddedicatednetworkwhenpossible

29


SharedNothingCluster–SingleDataCenter

30

ApplicaEonServers

MySQLRouterinStack

MySQLDatabaseServiceGroupReplicaEon


SharedNothingCluster–CrossDataCenter

31

MySQLDatabaseServiceGroupReplicaEon

DataCenter1 DataCenter2

Clients


GeographicallyRedundantCluster

32

AsyncReplicaEon

AcEveDataCenter BackupDataCenter

Clients


AcNve/AcNveMulN-DataCenterSetup

33

AsyncReplicaEon

RegionalDataCenter RegionalDataCenter

RegionalClientsRegionalClients


ProgramAgenda

34





1

2

3

4

Copyright©2017,Oracleand/oritsaffiliates.Allrightsreserved.| 35

MySQLDocumentStore

RelaNonal&DocumentModels

MySQLHA

Out-Of-BoxHA

ReadScale-Out

AsyncReplicaNon+AutoFailover

WriteScale-Out

Sharding

S1

S2

S3

S4

*DownloadInnoDBClusterPreviewReleasefromlabs.mysql.com


MySQLRouter:2.1• NaNvesupportforInnoDBclusters

– UnderstandsGroupReplicaNon(GR)topology– UNlizesmetadataschemastoredoneachmember

•  BootstrapsitselfandsetsupclientrouNngfortheGRcluster•  AllowsforintelligentclientrouNngintotheGRcluster•  SupportsmulN-masterandsingleprimarymodes

• Coreimprovements– Logging– Monitoring– Performance– Security

36



MySQLShellSetup,Manage,Orchestrate

labs.mysql.com


MySQLShell

37

AsingleunifiedclientforalladministraEveandoperaEonstasks




• MulN-Language:JavaScript,Python,andSQL– Naturallyscriptable

•  SupportsbothDocumentandRelaNonalmodels•  ExposesfullDevelopmentandAdminAPI”MySQLShellprovidesthedeveloperandDBAwithasingleintui?ve,flexible,andpowerfullinterfaceforallMySQLrelatedtasks!”


MySQLShell:AdminAPI

• mysql-js>dba.help()•  Theglobalvariable'dba'isusedtoaccesstheMySQLAdminAPI

• PerformDBAoperaNons– ManageMySQLInnoDBclusters

•  Createclusters•  Getclusterinfo•  Start/StopMySQLInstances•  ValidateMySQLinstances•  …

DatabaseAdministraEonInterface

labs.mysql.com




38


MySQLEnterpriseMonitor• NaNveholisNcsupportforGroupReplicaNonclusters

– IntelligentmonitoringandalerNng– Topologyviews– Detailedmetricsandgraphs– BestPracNceadvice

• MonitoringofMySQLRouterinstances

39


OracleCloud:MySQLCloudService• MySQLEnterpriseEdiNon• WebbasedconsoletomanageyourMySQLCloudinstances•  Self-ServiceProvisioning•  ElasNcScalability• MulN-LayeredSecurity• UnifiedCloudManagement• OraclePaaSandIaaSIntegraNon• PremierTechnicalSupportincluded

40

IntegratedHAandDRserviceopEons–uElizing

GroupReplicaEon–comingsoon!


AlwaysOn,WithoutFail:MySQLGroupReplicaEonLuisSoares,MySQLReplicaNonTeamLead,Oracle

Tuesday,January17,2017at09:00AMPacificStandardTime

Registernow!

UpcomingWebinar

41

Why MySQL High Availability Matters

Technology

Transcript of Why MySQL High Availability Matters