CASSANDRA ON AZURE? REALLY?!Oded Peer, RSA Security
2© Copyright 2015 EMC Corporation. All rights reserved.
THE ELEPHANT IN THE ROOM
3© Copyright 2015 EMC Corporation. All rights reserved.
• Only two leaders in Gartner Magic Quadrant for Cloud IaaS (2015)
• Only two leaders in Gartner Magic Quadrant for Public Cloud Storage Services (2014)
• Computing capacity: AWS has X10 the combined competition, Microsoft has X2 the non-Amazon combined competition
• Cloud platform revenues: AWS 6bn revenue, Azure 1.5bn
AZURE AND AWS
4© Copyright 2015 EMC Corporation. All rights reserved.
AZURE IAAS
5© Copyright 2015 EMC Corporation. All rights reserved.
Type CPU RAM (GB) Temp Storage (GB)
IOPS $/mo
A7 8 56 605 16*500 655A8 8 56 382 16*500 1091
VM TYPES
6© Copyright 2015 EMC Corporation. All rights reserved.
Type CPU RAM (GB) Temp Storage (GB)
IOPS $/mo
A7 8 56 605 16*500 655A8 8 56 382 16*500 1091D13 8 56 400 (SSD) 16*500 521D14 16 112 800 (SSD) 32*500 1032D13_v2 8 56 400 (SSD) 16*500 599
VM TYPES
7© Copyright 2015 EMC Corporation. All rights reserved.
Type CPU RAM (GB) Temp Storage (GB)
IOPS $/mo
A7 8 56 605 16*500 655A8 8 56 382 16*500 1091D13 8 56 400 (SSD) 16*500 521D14 16 112 800 (SSD) 32*500 1032D13_v2 8 56 400 (SSD) 16*500 599DS13 8 56 112 (SSD) 25,600
256 MB/SD13++
VM TYPES
8© Copyright 2015 EMC Corporation. All rights reserved.
Type CPU RAM (GB) Temp Storage (GB)
IOPS $/mo
A7 8 56 605 16*500 655A8 8 56 382 16*500 1091D13 8 56 400 (SSD) 16*500 521D14 16 112 800 (SSD) 32*500 1032D13_v2 8 56 400 (SSD) 16*500 599DS13 8 56 112 (SSD) 25,600
256 MB/SD13++
G4 16 224 3072 (SSD) 32*500 3274GS4 16 224 448 (SSD) 40,000
1000 MB/SG4++
VM TYPES
9© Copyright 2015 EMC Corporation. All rights reserved.
• Ephemeral – Fast, data loss
• Standard – 16k IOPS limit (single VM)
• Premium (SSD) – Per-disk IOPS limit
STORAGE OPTIONS
10© Copyright 2015 EMC Corporation. All rights reserved.
Type Size (GB) IOPS ThroughputMB/S
$/mo
P10 128 500 100 18P20 512 2300 150 66P30 1024 5000 200 122
PREMIUM STORAGE PRICING
11© Copyright 2015 EMC Corporation. All rights reserved.
• Data and logs on ephemeral SSD– 100k IOPS and 1.5 GB/sec on G5
• Data and logs on premium storage– Striped volumes (better than JBOD)– Network latency 1-3 ms– Max 64 TB, 80k IOPS and 1 GB/sec disk throughput– Use standard storage for backup snapshots
• Data on premium logs on ephemeral
CASSANDRA STORAGE OPTIONS
12© Copyright 2015 EMC Corporation. All rights reserved.
• Logically isolated network• Within a VNET bandwidth is a function of VM type
– Up to 20 Gbps for G5• VNET to VNET VPN gateway
– Cross region support– Standard (100 Mbps)– High performance (200 Mbps)– Latency according to distance
VNET AND MULTI-REGION DEPLOYMENT
13© Copyright 2015 EMC Corporation. All rights reserved.
• Availability Zones
PLACING REPLICAS
14© Copyright 2015 EMC Corporation. All rights reserved.
• Availability Zones• Upgrade Domain, Fault Domain
PLACING REPLICAS
15© Copyright 2015 EMC Corporation. All rights reserved.
• Availability Zones• Upgrade Domain, Fault Domain – assigned at deployment
PLACING REPLICAS
16© Copyright 2015 EMC Corporation. All rights reserved.
AUTOMATIC DEPLOYMENT
17© Copyright 2015 EMC Corporation. All rights reserved.
• Single node sandbox• DSE cluster (BYOL)• Single region• 4, 12, 36 or 90 nodes• Choose your VM type (D12-D14, G2-G5)• Ephemeral storage• Includes OpsCenter
AZURE MARKETPLACESIMPLIFIED DEPLOYMENT
18© Copyright 2015 EMC Corporation. All rights reserved.
19© Copyright 2015 EMC Corporation. All rights reserved.
• Fully managed Cassandra-as-a-Service hosted on Microsoft Azure
• Apache Cassandra and DSE• Multiple Cassandra versions• OpsCenter• Uses D-series VMs• Multi region
MANAGED CASSANDRA
20© Copyright 2015 EMC Corporation. All rights reserved.
REAL WORLD USE CASES
21© Copyright 2015 EMC Corporation. All rights reserved.
• DSE on Ubuntu• Single Azure region, 2 vDC• G4 nodes, considering D14_v2• Data on ephemeral disks• 12 nodes: ingest 20k - 50k events/sec• 30 nodes: ingest 200k events/sec
OFFICE 365
22© Copyright 2015 EMC Corporation. All rights reserved.
• DS13 VMs (8 CPUs, 56 GB RAM)• 16 p10 premium storage disks• Single Azure region• Combination of Upgrade Domain and Fault Domain for replica
placement
ADAPTIVE AUTHENTICATION
23© Copyright 2015 EMC Corporation. All rights reserved.
• Your mileage may vary• Microsoft eager to help• VPN throughput lower than expected• Commitlog flush IO spikes change in flush interval• LCS STCS to reduce compaction IO
TIPS
24© Copyright 2015 EMC Corporation. All rights reserved.
THANK YOU
Top Related