Accelerate MySQL for Demanding OLAP and OLTP Use …...Accelerate MySQL® for Demanding OLAP and...

Post on 27-Jun-2020

3 views 0 download

Transcript of Accelerate MySQL for Demanding OLAP and OLTP Use …...Accelerate MySQL® for Demanding OLAP and...

AccelerateMySQL®forDemandingOLAPandOLTPUseCasewithApache®Ignite™

December7,2016

NikitaIvanovCTOandCo-FounderGridGainSystems

PeterZaitsevCEOandCo-FounderPercona

©2016Percona2

AboutthePresentation

Problems

ExistingSolutions

NikitaIvanovwillshowthepowerofApacheIgnite

©2016Percona3

AboutPercona

WeExisttohelpyoutosucceedwithMySQLandMongoDB

©2016Percona4

SupportBroadEcosystem

PerconaServerforMySQL

MySQL MariaDB

AWSforMySQLandAurora

MongoDBPerconaServerforMongoDB

GoogleCloudSQL

©2016Percona5

Percona Software– 100%OpenSource

PerconaServerforMySQL

PerconaServerforMongoDB

PerconaXtraDBCluster

PerconaXtrabackup PerconaToolkit

PerconaMonitoringandManagement

©2016Percona6

Services

• Support • More than Support (Percona Care)• Managed Services (Percona Care Ultimate)• Consulting, Training

©2016Percona7

MyConviction

Thereisnosilverbulletintechnology!

©2016Percona8

Why?

Alldesigndecisionscomeswiththeirownbenefitsanddrawbacks

©2016Percona9

TechnologiesnotTechnology

LargeScaleapplicationstendtousemorethanonetechnologyondata

layer

©2016Percona10

WorksespeciallywellwithOpenSource!

AdditionalComponentsdonotrequireheftylicensefees

Easytoprototypeandtestout

OpenSourceCommunityisgoodatbuildingbridges

©2016Percona11

BalanceisNeeded

Useasmanytechnologiesasyouneed,butnomore

©2016Percona12

MySQL

MySQLisnoException.ItisnotGreatfor

Everything.

©2016Percona13

SomeoftheProblems

HotData

HighlyVolatileData

LargeDataVolume

AnalyticalProcessing

FullTextSearch

©2016Percona14

HotData

Forexample“Cache”

Largevolumeofsimplerequests

HighoverheadduetoSQL

NogoodMemoryfocusedEngine

NotDesignedforveryhighConcurrency

©2016Percona15

Solutions

MySQL

••MemcacheDinterface

••ThreadPool

External

••MemcacheD••Redis

©2016Percona16

HighlyVolatileData

Lotsofupdates,especiallytoasinglerow

DesignaroundfullTransactionalACIDsemantics

DiskLogbaseddurability

PessimisticLogging

©2016Percona17

Solutions

MySQL

••DataDesign••ConfigurationTuning

••ParallelReplication

External

••MemcacheD••Redis

©2016Percona18

LargeDataVolume

MySQLisdesignedassinglenodesystem

LimitedinCPU,Memory

Manual“Sharding”solutionsarepainful

Especiallywithcomplexqueries

©2016Percona19

Solutions

MySQL

••ManualSharding

••Vitess••ProxySQL

External

••ShadingforMemcacheDandRedis

••MongoDB••Cassandra

©2016Percona20

Analytics(OLAP)

MySQLdoesnotsupportcolumnbasedstorage

MySQLoptimizerislimitedforcomplexqueries

MySQLdoesnotdoparallelqueryexecution

MySQLdoesnotdodistributedqueryexecution

©2016Percona21

Solutions

MySQL

••ConfigurationandSchemaDesign(Limited)

External

••Hadoop&Spark

••Vertica••ClickHouse

©2016Percona22

FullTextSearch

CanhandlebasicFullTextSearch

Doesnotscalewellwithdatavolume

Noparallelprocessing

Limitedsearchrelevanceoptions

HardTodoGISsearches;Facets

Nolanguageprocessing

©2016Percona23

Solutions

MySQL

••SmallScalesearchapplicationsonly

••SupportedwithInnodbtablessinceMySQL5.6

External

••Elastic••Solr••Sphinx

©2016Percona24

NewSolutionsconstantlyappear

Alwaysbeonlookoutforabettersolutions!

©2016Percona25

ApacheIgnite

NikitaIvanovwillshowwhatyoucandowith

ApacheIgnite!

AccelerateMySQL®forDemandingOLAPandOLTPUseCaseswithApache®Ignite™

December7,2016

NikitaIvanov

Founder&CTO,GridGainSystemsApacheIgnitePMC

WhyIn-MemoryComputingNow?DecliningDRAMCost

Costdrops30%every12months8zettabytesin2015growingto35in2020

DRAM

DataGrowthDrivingDemand

Disk

Flash0

5

10

15

20

25

30

35

2009 2010 2015 2020

GrowthofGlobalData

Zettab

ytesofD

ata

©2014GridGainSystems,Inc.

In-MemoryDataFabricIdealacceleratorforSQLdatastoresandapps

ApacheIgniteisaleadingopen-source,cloud-readydistributedsoftwaredelivering100xperformanceandscalabilitybystoringandprocessingdatainmemoryacrossscaleoutorscaleupinfrastructure.

©2014GridGainSystems,Inc.

In-MemoryDataFabricMaincomponents

©2014GridGainSystems,Inc.

• DistributedIn-MemoryKey-ValueStore• ReplicatedandPartitioneddata• TBsofdata,ofanytype• On-HeapandOff-HeapStorage• HighlyAvailableIn-MemoryReplicas• AutomaticFailover• DistributedACIDTransactions• SQL99 queriesandJDBC/ODBC driver• CollocationofComputeandData

In-MemoryDataGrid

©2014GridGainSystems,Inc.

• DirectAPIforMapReduce• ZeroDeployment• Cron-likeTaskScheduling• StateCheckpoints• LoadBalancing• AutomaticFailover• FullClusterManagement• PluggableSPIDesign

In-MemoryComputeGrid

SmartMeteringandUtilities– deliversacomprehensiveIoTplatform

50+ Million Meters

• SilverSpring Requirements:– 100xspeedupofDB-basedops– Addscalability&elasticity– Useopensourcetechnologies

• WhyGridGainUsed:– Strongcomputecapabilities

• Co-locatedin-memoryprocessing– Demonstratedbest

• On-demandelasticity&scalability• ANSI-99SQLSupport• Transactionalconsistency

SilverSpring IoT Platform

GridGainSecurity

©2016Percona33

JoinUsatPerconaLive!MySQL,MongoDB,OpenSourceDatabases▪April24-27,2017▪SantaClara,CA▪Tutorials,keynotesandsessionsfromtechnicalexperts

Use“WebinarPL”codetoreceivea10%discount▪SaveevenmorewithearlybirdpricinguntilJanuary8th▪https://www.percona.com/live/17/register

Sponsorshipopportunitiesavailable▪https://www.percona.com/live/17/be-a-sponsor

©2014GridGainSystems,Inc.

MoreInformationPerconahttps://www.percona.com/• PeterZaitsev:pz@percona.com• Consulting:https://www.percona.com/services/consulting

GridGainSystemshttps://www.gridgain.com/• NikitaIvanov:nivanov@gridgain.com• GridGainProfessionalorEnterpriseEditionfor30-DayTrial:https://www.gridgain.com/resources/download

• ApacheIgnite:https://ignite.apache.org/

THANKYOU!!!