Cassandra and DataStax Enterprise on PCF

21
Unless otherwise indicated, these slides are © 2013-2016 Pivotal Software, Inc. and licensed under a Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/ Cassandra and DataStax Enterprise on PCF Ben Lackey DataStax @benofben Cornelia Davis Pivotal @cdavisafc

Transcript of Cassandra and DataStax Enterprise on PCF

Page 1: Cassandra and DataStax Enterprise on PCF

Unless o therw ise ind ica ted , these s l ides are © 2013-2016 P ivo ta l So f tware , Inc . and l i censed under a Creat ive Commons At t r ibu t ion-NonCommerc ia l l i cense: h t tp : / / c rea t ivecommons.org / l i censes /by-nc /3 .0 /

Cassandra and DataStax Enterprise on PCF

Ben LackeyDataStax@benofben

Cornelia DavisPivotal

@cdavisafc

Page 2: Cassandra and DataStax Enterprise on PCF

PIV

OTA

L

Brokered Services

PAR

TNE

RE

DU

SE

R P

RO

VID

ED

PIV

OTA

L

BOSH Managed Services

PAR

TNE

R

Automated, Polyglot Build/

Package/DeployContainer Scheduling Elastic (Auto)Scale

PCF Elastic Runtime

z

PCF Tools• Apps Manager UI (App Admin UI) • CLI • REST APIs • PCF Metrics Dashboard

Ops Manager UI (Cloud Admin UI)

Mobile Push Notifications

Dingo PostgreSQL

Gemfire

Redis

RabbitMQ

Spring Cloud Services

Single Sign On

MySQL

HDB

Greenplum DB

VMware (vSphere + Photon)

MS SQL Server

IBM DB/2

Active MQ

Infrastructure OpenStack

*Integration with various 3rd party visualization and management vendors

Security (Application & Platform)

Self-Healing & High Availability

(Application & Platform)

Zero Downtime Upgrades &

Patches (Application & Platform)

Integrated Logging/Metrics*

(Application & Platform)

Dynamic Routing & Extensible Route

Services

Dev + Ops Role-Based Self-Service

Access

Amazon Web Services

Microsoft Azure

Google Cloud Platform

Oracle DB

Cluster Orchestration and Management (BOSH)

Infrastructure Agnostic Software Packaging

Multi-Cloud Orchestration of Infrastructure Provisioning

Distributed Software Configuration and Health/Lifecycle Management

Applications/APIs/Microservices

Compiled, staged, containerized, deployed and managed by platform

Pre-packaged container deployed and managed

by platformJava  |  .NET  |  Ruby  |  Node.js  |  Python  |  PHP  |  Go

Pivotal Cloud Foundry

Page 3: Cassandra and DataStax Enterprise on PCF

Unless o therw ise ind ica ted , these s l ides are © 2013-2016 P ivo ta l So f tware , Inc . and l i censed under a Creat ive Commons At t r ibu t ion-NonCommerc ia l l i cense: h t tp : / / c rea t ivecommons.org / l i censes /by-nc /3 .0 /

How do we handle massive transactional data and never go down?

3© 2016 DataStax, All Rights Reserved.

Schema Memtables Compaction SStables Commit Log

Page 4: Cassandra and DataStax Enterprise on PCF

Unless o therw ise ind ica ted , these s l ides are © 2013-2016 P ivo ta l So f tware , Inc . and l i censed under a Creat ive Commons At t r ibu t ion-NonCommerc ia l l i cense: h t tp : / / c rea t ivecommons.org / l i censes /by-nc /3 .0 /© 2016 DataStax, All Rights Reserved.

Cassandra• Distributed self healing mesh• No active/passive• Peer to peer replication• No single point of failure• Writes are done to all nodes

simultaneously• Data is safe from node, rack,

and datacenter failure• Optimized for high volume,

low latency operations

4

Page 5: Cassandra and DataStax Enterprise on PCF

Unless o therw ise ind ica ted , these s l ides are © 2013-2016 P ivo ta l So f tware , Inc . and l i censed under a Creat ive Commons At t r ibu t ion-NonCommerc ia l l i cense: h t tp : / / c rea t ivecommons.org / l i censes /by-nc /3 .0 / 5

http://12factor.net/

Page 6: Cassandra and DataStax Enterprise on PCF

Unless o therw ise ind ica ted , these s l ides are © 2013-2016 P ivo ta l So f tware , Inc . and l i censed under a Creat ive Commons At t r ibu t ion-NonCommerc ia l l i cense: h t tp : / / c rea t ivecommons.org / l i censes /by-nc /3 .0 / 6

Stateless apps allows the platform

to do all sorts of things for you

demo

Factor 6 – Processes

Page 7: Cassandra and DataStax Enterprise on PCF

Unless o therw ise ind ica ted , these s l ides are © 2013-2016 P ivo ta l So f tware , Inc . and l i censed under a Creat ive Commons At t r ibu t ion-NonCommerc ia l l i cense: h t tp : / / c rea t ivecommons.org / l i censes /by-nc /3 .0 / 7

                     Rou

ter

Cloud Controller

CELL

CELL

Data Service

PCF Elastic Runtime

Data Service

Page 8: Cassandra and DataStax Enterprise on PCF

Unless o therw ise ind ica ted , these s l ides are © 2013-2016 P ivo ta l So f tware , Inc . and l i censed under a Creat ive Commons At t r ibu t ion-NonCommerc ia l l i cense: h t tp : / / c rea t ivecommons.org / l i censes /by-nc /3 .0 / 8

                     Rou

ter

Cloud Controller

CELL

CELL

PCF Elastic Runtime

Page 9: Cassandra and DataStax Enterprise on PCF

Unless o therw ise ind ica ted , these s l ides are © 2013-2016 P ivo ta l So f tware , Inc . and l i censed under a Creat ive Commons At t r ibu t ion-NonCommerc ia l l i cense: h t tp : / / c rea t ivecommons.org / l i censes /by-nc /3 .0 / 9

demo

Page 10: Cassandra and DataStax Enterprise on PCF

Unless o therw ise ind ica ted , these s l ides are © 2013-2016 P ivo ta l So f tware , Inc . and l i censed under a Creat ive Commons At t r ibu t ion-NonCommerc ia l l i cense: h t tp : / / c rea t ivecommons.org / l i censes /by-nc /3 .0 /

Creating and Binding a DataStax Cassandra Service

10

Router

PCF  Elastic  Runtime

create resourcescreate service (HTTP) create service (HTTP)

bind service (HTTP)bind service (HTTP) obtain connection data

CLI Cloud Controller

Service Broker

Page 11: Cassandra and DataStax Enterprise on PCF

Unless o therw ise ind ica ted , these s l ides are © 2013-2016 P ivo ta l So f tware , Inc . and l i censed under a Creat ive Commons At t r ibu t ion-NonCommerc ia l l i cense: h t tp : / / c rea t ivecommons.org / l i censes /by-nc /3 .0 /

On Demand Clusters

11

create service

CLI Service Broker

Page 12: Cassandra and DataStax Enterprise on PCF

Unless o therw ise ind ica ted , these s l ides are © 2013-2016 P ivo ta l So f tware , Inc . and l i censed under a Creat ive Commons At t r ibu t ion-NonCommerc ia l l i cense: h t tp : / / c rea t ivecommons.org / l i censes /by-nc /3 .0 /

On Demand Clusters

12

create service

CLI Service Broker

BOSH Director

create

Manifest

Page 13: Cassandra and DataStax Enterprise on PCF

Unless o therw ise ind ica ted , these s l ides are © 2013-2016 P ivo ta l So f tware , Inc . and l i censed under a Creat ive Commons At t r ibu t ion-NonCommerc ia l l i cense: h t tp : / / c rea t ivecommons.org / l i censes /by-nc /3 .0 /

On Demand Clusters

13

create service

CLI Service Broker

BOSH Director

create

bosh deploy via BOSH Director API

Manifest

Page 14: Cassandra and DataStax Enterprise on PCF

Unless o therw ise ind ica ted , these s l ides are © 2013-2016 P ivo ta l So f tware , Inc . and l i censed under a Creat ive Commons At t r ibu t ion-NonCommerc ia l l i cense: h t tp : / / c rea t ivecommons.org / l i censes /by-nc /3 .0 /

On Demand Clusters

14

create service

CLI Service Broker

BOSH Director

create

VM

VM

VM

bosh deploy via BOSH Director API

Manifest

Page 15: Cassandra and DataStax Enterprise on PCF

Unless o therw ise ind ica ted , these s l ides are © 2013-2016 P ivo ta l So f tware , Inc . and l i censed under a Creat ive Commons At t r ibu t ion-NonCommerc ia l l i cense: h t tp : / / c rea t ivecommons.org / l i censes /by-nc /3 .0 / 15

PCF

Data Center 1

PCF

Data Center 2

Page 16: Cassandra and DataStax Enterprise on PCF

Unless o therw ise ind ica ted , these s l ides are © 2013-2016 P ivo ta l So f tware , Inc . and l i censed under a Creat ive Commons At t r ibu t ion-NonCommerc ia l l i cense: h t tp : / / c rea t ivecommons.org / l i censes /by-nc /3 .0 / 16

PCF

Data Center 1

PCF

Data Center 2

Pipelines Distribute Deployments

Active/Active

Page 17: Cassandra and DataStax Enterprise on PCF

Unless o therw ise ind ica ted , these s l ides are © 2013-2016 P ivo ta l So f tware , Inc . and l i censed under a Creat ive Commons At t r ibu t ion-NonCommerc ia l l i cense: h t tp : / / c rea t ivecommons.org / l i censes /by-nc /3 .0 / 17

PCF

Data Center 1

PCF

Data Center 2

Pipelines Distribute Deployments

“Active/Active”

Page 18: Cassandra and DataStax Enterprise on PCF

Unless o therw ise ind ica ted , these s l ides are © 2013-2016 P ivo ta l So f tware , Inc . and l i censed under a Creat ive Commons At t r ibu t ion-NonCommerc ia l l i cense: h t tp : / / c rea t ivecommons.org / l i censes /by-nc /3 .0 / 18

PCF

Data Center 1

PCF

Data Center 2

Pipelines Distribute Deployments

“Active/Active”

Page 19: Cassandra and DataStax Enterprise on PCF

Unless o therw ise ind ica ted , these s l ides are © 2013-2016 P ivo ta l So f tware , Inc . and l i censed under a Creat ive Commons At t r ibu t ion-NonCommerc ia l l i cense: h t tp : / / c rea t ivecommons.org / l i censes /by-nc /3 .0 / 19

PCF

Data Center 1

PCF

Data Center 2

Pipelines Distribute Deployments

Active/Active

Page 20: Cassandra and DataStax Enterprise on PCF

Unless o therw ise ind ica ted , these s l ides are © 2013-2016 P ivo ta l So f tware , Inc . and l i censed under a Creat ive Commons At t r ibu t ion-NonCommerc ia l l i cense: h t tp : / / c rea t ivecommons.org / l i censes /by-nc /3 .0 /

Summary• On-demand single tenant database-as-a-service on PCF• Supports DataStax Enterprise 5.0 (incl. OpsCentre 6.0)• Currently under active development• Early adopter program late Q3/early Q4

Vision:• DataStax multi-data center support

We want to hear from you:• Damian O'Connor, [email protected] (Product Manager for the Cassandra Service on PCF)• Cornelia Davis, [email protected] (Sr. Director of Technology, Platform)• Ben Lackey, [email protected] (Partner Architect)

20

Page 21: Cassandra and DataStax Enterprise on PCF

Unless o therw ise ind ica ted , these s l ides are © 2013-2016 P ivo ta l So f tware , Inc . and l i censed under a Creat ive Commons At t r ibu t ion-NonCommerc ia l l i cense: h t tp : / / c rea t ivecommons.org / l i censes /by-nc /3 .0 /

Learn More. Stay Connected.

Cornelia Davis @cdavisafc

Ben Lackey @benofben

@springcentralspring.io/blog

@pivotalpivotal.io/blog

@pivotalcfhttp://engineering.pivotal.io