Cassandra and DataStax Enterprise on PCF

Post on 16-Apr-2017

193 views 0 download

Transcript of Cassandra and DataStax Enterprise on PCF

Unless o therw ise ind ica ted , these s l ides are © 2013-2016 P ivo ta l So f tware , Inc . and l i censed under a Creat ive Commons At t r ibu t ion-NonCommerc ia l l i cense: h t tp : / / c rea t ivecommons.org / l i censes /by-nc /3 .0 /

Cassandra and DataStax Enterprise on PCF

Ben LackeyDataStax@benofben

Cornelia DavisPivotal

@cdavisafc

PIV

OTA

L

Brokered Services

PAR

TNE

RE

DU

SE

R P

RO

VID

ED

PIV

OTA

L

BOSH Managed Services

PAR

TNE

R

Automated, Polyglot Build/

Package/DeployContainer Scheduling Elastic (Auto)Scale

PCF Elastic Runtime

z

PCF Tools• Apps Manager UI (App Admin UI) • CLI • REST APIs • PCF Metrics Dashboard

Ops Manager UI (Cloud Admin UI)

Mobile Push Notifications

Dingo PostgreSQL

Gemfire

Redis

RabbitMQ

Spring Cloud Services

Single Sign On

MySQL

HDB

Greenplum DB

VMware (vSphere + Photon)

MS SQL Server

IBM DB/2

Active MQ

Infrastructure OpenStack

*Integration with various 3rd party visualization and management vendors

Security (Application & Platform)

Self-Healing & High Availability

(Application & Platform)

Zero Downtime Upgrades &

Patches (Application & Platform)

Integrated Logging/Metrics*

(Application & Platform)

Dynamic Routing & Extensible Route

Services

Dev + Ops Role-Based Self-Service

Access

Amazon Web Services

Microsoft Azure

Google Cloud Platform

Oracle DB

Cluster Orchestration and Management (BOSH)

Infrastructure Agnostic Software Packaging

Multi-Cloud Orchestration of Infrastructure Provisioning

Distributed Software Configuration and Health/Lifecycle Management

Applications/APIs/Microservices

Compiled, staged, containerized, deployed and managed by platform

Pre-packaged container deployed and managed

by platformJava  |  .NET  |  Ruby  |  Node.js  |  Python  |  PHP  |  Go

Pivotal Cloud Foundry

Unless o therw ise ind ica ted , these s l ides are © 2013-2016 P ivo ta l So f tware , Inc . and l i censed under a Creat ive Commons At t r ibu t ion-NonCommerc ia l l i cense: h t tp : / / c rea t ivecommons.org / l i censes /by-nc /3 .0 /

How do we handle massive transactional data and never go down?

3© 2016 DataStax, All Rights Reserved.

Schema Memtables Compaction SStables Commit Log

Unless o therw ise ind ica ted , these s l ides are © 2013-2016 P ivo ta l So f tware , Inc . and l i censed under a Creat ive Commons At t r ibu t ion-NonCommerc ia l l i cense: h t tp : / / c rea t ivecommons.org / l i censes /by-nc /3 .0 /© 2016 DataStax, All Rights Reserved.

Cassandra• Distributed self healing mesh• No active/passive• Peer to peer replication• No single point of failure• Writes are done to all nodes

simultaneously• Data is safe from node, rack,

and datacenter failure• Optimized for high volume,

low latency operations

4

Unless o therw ise ind ica ted , these s l ides are © 2013-2016 P ivo ta l So f tware , Inc . and l i censed under a Creat ive Commons At t r ibu t ion-NonCommerc ia l l i cense: h t tp : / / c rea t ivecommons.org / l i censes /by-nc /3 .0 / 5

http://12factor.net/

Unless o therw ise ind ica ted , these s l ides are © 2013-2016 P ivo ta l So f tware , Inc . and l i censed under a Creat ive Commons At t r ibu t ion-NonCommerc ia l l i cense: h t tp : / / c rea t ivecommons.org / l i censes /by-nc /3 .0 / 6

Stateless apps allows the platform

to do all sorts of things for you

demo

Factor 6 – Processes

Unless o therw ise ind ica ted , these s l ides are © 2013-2016 P ivo ta l So f tware , Inc . and l i censed under a Creat ive Commons At t r ibu t ion-NonCommerc ia l l i cense: h t tp : / / c rea t ivecommons.org / l i censes /by-nc /3 .0 / 7

                     Rou

ter

Cloud Controller

CELL

CELL

Data Service

PCF Elastic Runtime

Data Service

Unless o therw ise ind ica ted , these s l ides are © 2013-2016 P ivo ta l So f tware , Inc . and l i censed under a Creat ive Commons At t r ibu t ion-NonCommerc ia l l i cense: h t tp : / / c rea t ivecommons.org / l i censes /by-nc /3 .0 / 8

                     Rou

ter

Cloud Controller

CELL

CELL

PCF Elastic Runtime

Unless o therw ise ind ica ted , these s l ides are © 2013-2016 P ivo ta l So f tware , Inc . and l i censed under a Creat ive Commons At t r ibu t ion-NonCommerc ia l l i cense: h t tp : / / c rea t ivecommons.org / l i censes /by-nc /3 .0 / 9

demo

Unless o therw ise ind ica ted , these s l ides are © 2013-2016 P ivo ta l So f tware , Inc . and l i censed under a Creat ive Commons At t r ibu t ion-NonCommerc ia l l i cense: h t tp : / / c rea t ivecommons.org / l i censes /by-nc /3 .0 /

Creating and Binding a DataStax Cassandra Service

10

Router

PCF  Elastic  Runtime

create resourcescreate service (HTTP) create service (HTTP)

bind service (HTTP)bind service (HTTP) obtain connection data

CLI Cloud Controller

Service Broker

Unless o therw ise ind ica ted , these s l ides are © 2013-2016 P ivo ta l So f tware , Inc . and l i censed under a Creat ive Commons At t r ibu t ion-NonCommerc ia l l i cense: h t tp : / / c rea t ivecommons.org / l i censes /by-nc /3 .0 /

On Demand Clusters

11

create service

CLI Service Broker

Unless o therw ise ind ica ted , these s l ides are © 2013-2016 P ivo ta l So f tware , Inc . and l i censed under a Creat ive Commons At t r ibu t ion-NonCommerc ia l l i cense: h t tp : / / c rea t ivecommons.org / l i censes /by-nc /3 .0 /

On Demand Clusters

12

create service

CLI Service Broker

BOSH Director

create

Manifest

Unless o therw ise ind ica ted , these s l ides are © 2013-2016 P ivo ta l So f tware , Inc . and l i censed under a Creat ive Commons At t r ibu t ion-NonCommerc ia l l i cense: h t tp : / / c rea t ivecommons.org / l i censes /by-nc /3 .0 /

On Demand Clusters

13

create service

CLI Service Broker

BOSH Director

create

bosh deploy via BOSH Director API

Manifest

Unless o therw ise ind ica ted , these s l ides are © 2013-2016 P ivo ta l So f tware , Inc . and l i censed under a Creat ive Commons At t r ibu t ion-NonCommerc ia l l i cense: h t tp : / / c rea t ivecommons.org / l i censes /by-nc /3 .0 /

On Demand Clusters

14

create service

CLI Service Broker

BOSH Director

create

VM

VM

VM

bosh deploy via BOSH Director API

Manifest

Unless o therw ise ind ica ted , these s l ides are © 2013-2016 P ivo ta l So f tware , Inc . and l i censed under a Creat ive Commons At t r ibu t ion-NonCommerc ia l l i cense: h t tp : / / c rea t ivecommons.org / l i censes /by-nc /3 .0 / 15

PCF

Data Center 1

PCF

Data Center 2

Unless o therw ise ind ica ted , these s l ides are © 2013-2016 P ivo ta l So f tware , Inc . and l i censed under a Creat ive Commons At t r ibu t ion-NonCommerc ia l l i cense: h t tp : / / c rea t ivecommons.org / l i censes /by-nc /3 .0 / 16

PCF

Data Center 1

PCF

Data Center 2

Pipelines Distribute Deployments

Active/Active

Unless o therw ise ind ica ted , these s l ides are © 2013-2016 P ivo ta l So f tware , Inc . and l i censed under a Creat ive Commons At t r ibu t ion-NonCommerc ia l l i cense: h t tp : / / c rea t ivecommons.org / l i censes /by-nc /3 .0 / 17

PCF

Data Center 1

PCF

Data Center 2

Pipelines Distribute Deployments

“Active/Active”

Unless o therw ise ind ica ted , these s l ides are © 2013-2016 P ivo ta l So f tware , Inc . and l i censed under a Creat ive Commons At t r ibu t ion-NonCommerc ia l l i cense: h t tp : / / c rea t ivecommons.org / l i censes /by-nc /3 .0 / 18

PCF

Data Center 1

PCF

Data Center 2

Pipelines Distribute Deployments

“Active/Active”

Unless o therw ise ind ica ted , these s l ides are © 2013-2016 P ivo ta l So f tware , Inc . and l i censed under a Creat ive Commons At t r ibu t ion-NonCommerc ia l l i cense: h t tp : / / c rea t ivecommons.org / l i censes /by-nc /3 .0 / 19

PCF

Data Center 1

PCF

Data Center 2

Pipelines Distribute Deployments

Active/Active

Unless o therw ise ind ica ted , these s l ides are © 2013-2016 P ivo ta l So f tware , Inc . and l i censed under a Creat ive Commons At t r ibu t ion-NonCommerc ia l l i cense: h t tp : / / c rea t ivecommons.org / l i censes /by-nc /3 .0 /

Summary• On-demand single tenant database-as-a-service on PCF• Supports DataStax Enterprise 5.0 (incl. OpsCentre 6.0)• Currently under active development• Early adopter program late Q3/early Q4

Vision:• DataStax multi-data center support

We want to hear from you:• Damian O'Connor, daoconnor@pivotal.io (Product Manager for the Cassandra Service on PCF)• Cornelia Davis, cdavis@pivotal.io (Sr. Director of Technology, Platform)• Ben Lackey, ben.lackey@datastax.com (Partner Architect)

20

Unless o therw ise ind ica ted , these s l ides are © 2013-2016 P ivo ta l So f tware , Inc . and l i censed under a Creat ive Commons At t r ibu t ion-NonCommerc ia l l i cense: h t tp : / / c rea t ivecommons.org / l i censes /by-nc /3 .0 /

Learn More. Stay Connected.

Cornelia Davis @cdavisafc

Ben Lackey @benofben

@springcentralspring.io/blog

@pivotalpivotal.io/blog

@pivotalcfhttp://engineering.pivotal.io