MySql NoSQL Opensource and Beyond

91
MYSQL, SQL, NOSQL, AND OPEN SOURCE IN 2014 AND BEYOND BARON SCHWARTZ FEBRUARY 13, 2014

Transcript of MySql NoSQL Opensource and Beyond

  • MYSQL, SQL, NOSQL, AND OPEN SOURCE IN 2014 AND BEYOND

    BARON SCHWARTZFEBRUARY 13, 2014

  • THANKS GOOGLE!

  • AT WORK

    VIVIDCORTEX

    LINUX, AWS, ANSIBLE, GITHUB, MYSQL

    GITHUB.COM/VIVIDCORTEX

    GO-DATABASE-SQL.ORG/

  • MYSQL

  • FAITHFUL ARE THE WOUNDS OF A FRIEND- PROVERBS 27:6

  • ORACLE GRATITUDE LISTVIRTUALBOX

    MYSQL 5.5 AND 5.6

    EMPLOYS HUNDREDS OF ENGINEERS

    MYSQL CONNECT

    PARTICIPATION IN PERCONA LIVE

    WORKBENCH

    YUM REPOSITORIES

    COMMUNITY TEAM

    COMPOSURE

  • MARIADB AND SKYSQL

  • OPEN-SOURCE RDBMSS NOW

    LICENSING

    REVENUE MODEL

    MATURITY

  • MYSQL AND POSTGRESQL

  • PERFECT IS THE ENEMY OF GOODTHE MAN WHO SAYS IT CAN'T BE DONE IS GENERALLY INTERRUPTED BY SOMEONE DOING IT

    - ELBERT HUBBARD

  • PROGRESS

  • MYSQL AND MONGODB

  • HARD THINGS

  • REAL-TIME

  • VERY LARGE DEPLOYMENTS

  • MIXED WORKLOADS

  • DISASTER RECOVERY

  • RUNNING RELIABLY

  • EXTENDING

  • SCHEMA CHANGES

  • QUERY PLANNING

  • BACKGROUND MAINTENANCE

  • ACID

  • REPLICATION

  • SHARDING

  • PERFORMANCE MANAGEMENT

  • INSTRUMENTATION

  • CONFIGURING

  • BENCHMARKING

  • DATABASES ARE HARD

  • USEFUL THINGS

  • QUEUEING THEORY

  • LITTLES LAW: N = XR

  • AMDAHLS LAW

  • UNIVERSAL SCALABILITY LAW

    SEE FOR EXAMPLE HTTP://GOO.GL/2XMCRJ

  • FUNDAMENTAL PERFORMANCE METRICS

    THROUGHPUT, RESPONSE TIME, CONCURRENCY

    UTILIZATION

    ARRIVALS, COMPLETIONS, TIMESTAMPS

  • MODELS AND THEIR APPLICATIONS

    HTTPS://TWITTER.COM/HMASON/STATUS/430830517177421824

  • "ESSENTIALLY, ALL MODELS ARE WRONG, BUT SOME ARE USEFUL" - GEORGE BOX

  • "EVERYTHING SIMPLE IS FALSE. EVERYTHING WHICH IS COMPLEX IS UNUSABLE." - PAUL VALRY

  • THE MAP IS NOT THE TERRITORY.- KORZYBSKI

    ALL MEASUREMENTS ARE WRONG.- NEIL J. GUNTHER.

  • INTERESTING THINGS

    REGRESSION

    FORECASTING

    ANOMALY DETECTION

    EXPONENTIAL MOVING AVERAGES

    CONTROL CHARTS

    FAST FOURIER TRANSFORMS

    SUPERVISED LEARNING

  • PERFORMANCE MANAGEMENT

  • THE SKY IS FALLING

  • TOOLS DRIVE PROCESS

  • IS THE WORK GETTING DONE?

  • SO WHAT?

  • CAPS

  • PERFORMANCE

  • AVAILABILITY

  • METRICS THAT MATTER

    Desirable Easy

  • SHOULDERS OF GIANTS

    THINKING CLEARLY ABOUT PERFORMANCE - CARY MILLSAP (ACM QUEUE)

    AXIOMATIC APPROACH

  • STORAGE AND INDEXING

  • THE TREE WAS GOOD ... AND A TREE TO BE DESIRED TO MAKE ONE WISE - GENESIS 3:6

  • NEW DATA STRUCTURES

    FRACTAL TREES

    SKIP LISTS

    LOG-STRUCTURED MERGE TREES

  • THEN HEZEKIAH QUESTIONED WITH THE PRIESTS AND THE LEVITES CONCERNING THE HEAPS.- 2 CHRONICLES 31:9

  • STATE OF CLOUD RDBMSS

  • FOR THY MERCY IS GREAT ABOVE THE HEAVENS:AND THY TRUTH REACHETH UNTO THE CLOUDS.

    - PSALM 108:4

  • STATE OF CLOUD RDBMSS

  • NOSQL THEN HE QUESTIONED WITH HIM IN MANY WORDS; BUT HE ANSWERED HIM NOTHING.- LUKE 23:9

  • INNOVATIONS

  • HTTPS://TWITTER.COM/STEWARTSMITH/STATUS/410651205615230976

  • REINVENTIONS

  • GREAT DATABASES

  • WISHLIST

    CTES AND WINDOWING FUNCTIONS

    A SPRINKLING OF NOSQL (E.G. MEMCACHED PROTOCOL)

    OPTIONAL SCHEMA, JSON, SEARCH, GIS

    DISABLE FOOT-GUNS

  • TECHNICAL DIVERSITY

  • THE ROAD AHEAD

  • RELIABILITYHIGH AVAILABILITYDURABILITYSAFETYACID

  • SCALABILITY & PERFORMANCE

  • DISTRIBUTED

  • EXTENSIBLE

  • DEVELOPER-FRIENDLYSQL IS THE WORST QUERY LANGUAGE EXCEPT ALL THOSE OTHER

    LANGUAGES THAT HAVE BEEN TRIED FROM TIME TO TIME.- APOLOGIES TO WINSTON CHURCHILL.

  • MANAGEABLE

  • MORE EFFICIENT

  • PERFECT DATABASESZERO LATENCYLINEAR SCALING100% UPTIMEINSTANTANEOUS GLOBAL REPLICATIONUNICORNS AND PIXIE DUST

  • HTTPS://TWITTER.COM/APHYR

    HTTP://APHYR.COM/TAGS/JEPSEN

  • ONES I STILL PAY ATTENTION TOCLUSTRIX

    FOUNDATIONDB

    AEROSPIKE

    CASSANDRA

    RIAK

    REDIS

    MONGODB

    ELASTICSEARCH

    KAFKA

    DRUID

    HYPERDEX

    MYSQL

  • TIME-SERIES DATABASES

  • PROMISING TS DBSDRUID (HTTP://DRUID.IO/) INFLUXDB (HTTP://INFLUXDB.ORG/)

  • THE FUTURE IS TIME-SERIES

  • BOOK RECOMMENDATIONS

  • THE SEVEN HABITS OF HIGHLY EFFECTIVE PEOPLE

  • THE ROAD LESS TRAVELED

  • THE FOUR AGREEMENTS

  • THICH NHAT HANH

  • THE LAST LECTURE

  • OPENED GROUND

  • MANS SEARCH FOR MEANING

  • [email protected]/[email protected]/IN/XAPRB

  • TWITTER.COM/APHYR/STATUS/428663676229259264/PHOTO/1

    NOS.TWNSND.CO/IMAGE/74843161105

    FLICKR.COM/PHOTOS/RYN413/3952952164/

    FLICKR.COM/PHOTOS/FUN_FLYING/246252322/

    FLICKR.COM/PHOTOS/PSHAN427/2382209408/

    FLICKR.COM/PHOTOS/JOEDSILVA/4698703312/

    FLICKR.COM/PHOTOS/KEWING/9538208117/

    FLICKR.COM/PHOTOS/SHINDOTV/3835365695/

    FLICKR.COM/PHOTOS/ERICTASTAD/3506710802/

    FLICKR.COM/PHOTOS/TJT195/42956175/

    FLICKR.COM/PHOTOS/TWCOLLINS/2300019208/

    FLICKR.COM/PHOTOS/MARFIS75/8150285487/

    FLICKR.COM/PHOTOS/64425827@N00/3195818623/

    FLICKR.COM/PHOTOS/GOODTHINGS/314937703/

    FLICKR.COM/PHOTOS/UNITOPIA/3249963401/

    FLICKR.COM/PHOTOS/HAMED/1313923579/

    FLICKR.COM/PHOTOS/CYCLOPS-PHOTO/7007689829/

    FLICKR.COM/PHOTOS/RICARDO_FERREIRA/2477533652/

    FLICKR.COM/PHOTOS/NOAHBULGARIA/299613189/

    FLICKR.COM/PHOTOS/ATBARTLETT/2432704579/

    FLICKR.COM/PHOTOS/21078769@N00/8456666615/

    FLICKR.COM/PHOTOS/JUPIN/3775377827/

    FLICKR.COM/PHOTOS/MARKCHADWICK/4706439554/

    FLICKR.COM/PHOTOS/HJMEDIASTUDIOS/7883634326/

    FLICKR.COM/PHOTOS/AKEG/2230862848/

    FLICKR.COM/PHOTOS/GSFC/8693068949/

    FLICKR.COM/PHOTOS/DGOODPHOTO/5264024028/

    FLICKR.COM/PHOTOS/SHOOTINA710IS/3495052939/

    FLICKR.COM/PHOTOS/SHAKESKC/8671183899/

    FLICKR.COM/PHOTOS/RENE_SCHLEGEL/7347915500/

    FLICKR.COM/PHOTOS/MARCKJERLAND/4285433177/

    FLICKR.COM/PHOTOS/KESSOP/3987243989/

    FLICKR.COM/PHOTOS/PEASAP/2088444066/

    PICJUMBO.COM/ENDLESS-RAILWAY/

    PICJUMBO.COM/PIECE-OF-HONEY-CAKE/

    LITTLEVISUALS.CO

    WIKIMEDIA

    FLICKR.COM/PHOTOS/SCOTTWILLS/41061936/

    FLICKR.COM/PHOTOS/TIGGYWINKLE/4035326/

    FLICKR.COM/PHOTOS/JEFF_SCH/6493265365/

    FLICKR.COM/PHOTOS/KIMMYB66/10930209196/

    FLICKR.COM/PHOTOS/JANNEM/3312116875/

    FLICKR.COM/PHOTOS/AHOCKLEY/510252370/

    FLICKR.COM/PHOTOS/MAG3737/11863836236/

    FLICKR.COM/PHOTOS/GIOVANNIJL-S_PHOTOHUT/361679973/

    UNSPLASH.COM/

    NOS.TWNSND.CO/

    FLICKR.COM/PHOTOS/IDEONEXUS/3472498256/

    FLICKR.COM/PHOTOS/STEFANGEENS/3662436279/

    FLICKR.COM/PHOTOS/43052603@N00/3143727186/

    FLICKR.COM/PHOTOS/SUPERFAMOUS/9042401115/

    FLICKR.COM/PHOTOS/ORIGOMI/47113865/

    FLICKR.COM/PHOTOS/VROGY/514733529/

    FLICKR.COM/PHOTOS/PAULLEW/2694638955/

    FLICKR.COM/PHOTOS/AOA-/7133425507/

    FLICKR.COM/PHOTOS/ANDREKNU/5817696055/

    FLICKR.COM/PHOTOS/E_PHOTS/3012896283/

    FLICKR.COM/PHOTOS/ANDERS_YOUNG/3427271511/

    NOS.TWNSND.CO/IMAGE/65898470947

    FLICKR.COM/PHOTOS/SMB_FLICKR/2319952076/

    FLICKR.COM/PHOTOS/BIJOUBABY/4539701617/

    PICJUMBO.COM/MACBOOK-PRO-FROM-THE-TOP/

    NOS.TWNSND.CO/IMAGE/75266323323

    PICJUMBO.COM/BMW-SPEED-O-METER/

    FLICKR.COM/PHOTOS/CHAOTICMIND75/6895872661/

    FLICKR.COM/PHOTOS/CLOVER_1/3433081165/

    FLICKR.COM/PHOTOS/HUGOVK/6798051186/

    FLICKR.COM/PHOTOS/JASONRPHOTOGRAPHY/2885155839/

    FLICKR.COM/PHOTOS/BOBAUBUCHON/5411945096/

    FLICKR.COM/PHOTOS/ADAVEY/4695995469/

    FLICKR.COM/PHOTOS/CHRIS_GIN/3535620878/

    FLICKR.COM/PHOTOS/_FURFUR_/3016090586/