Deploying, Backups, and Restore w Datastax + Azure at Albertsons/Safeway (Gurpreet Singh,...
Transcript of Deploying, Backups, and Restore w Datastax + Azure at Albertsons/Safeway (Gurpreet Singh,...
![Page 1: Deploying, Backups, and Restore w Datastax + Azure at Albertsons/Safeway (Gurpreet Singh, Albertsons/Safeway) | Cassandra Summit 2016](https://reader035.fdocuments.us/reader035/viewer/2022081520/586f76031a28ab10258b62b9/html5/thumbnails/1.jpg)
GURPREET SINGH
Deploying ,backing up and restore with Datastax and Azure .
![Page 2: Deploying, Backups, and Restore w Datastax + Azure at Albertsons/Safeway (Gurpreet Singh, Albertsons/Safeway) | Cassandra Summit 2016](https://reader035.fdocuments.us/reader035/viewer/2022081520/586f76031a28ab10258b62b9/html5/thumbnails/2.jpg)
1 Introduction
2 What is ARM ?
3 Data Backup Strategy
4 Restore Data
5 Questions ?
© DataStax, All Rights Reserved. 2
![Page 3: Deploying, Backups, and Restore w Datastax + Azure at Albertsons/Safeway (Gurpreet Singh, Albertsons/Safeway) | Cassandra Summit 2016](https://reader035.fdocuments.us/reader035/viewer/2022081520/586f76031a28ab10258b62b9/html5/thumbnails/3.jpg)
© DataStax, All Rights Reserved. 3
About me :
• Currently working as a Cloud Architect At Albertsons/Safeway
• Passionate about cloud and Big data technologies, self-motivated
• I love to socialize and I believe in never giving up.
![Page 4: Deploying, Backups, and Restore w Datastax + Azure at Albertsons/Safeway (Gurpreet Singh, Albertsons/Safeway) | Cassandra Summit 2016](https://reader035.fdocuments.us/reader035/viewer/2022081520/586f76031a28ab10258b62b9/html5/thumbnails/4.jpg)
© DataStax, All Rights Reserved. 4
![Page 5: Deploying, Backups, and Restore w Datastax + Azure at Albertsons/Safeway (Gurpreet Singh, Albertsons/Safeway) | Cassandra Summit 2016](https://reader035.fdocuments.us/reader035/viewer/2022081520/586f76031a28ab10258b62b9/html5/thumbnails/5.jpg)
© DataStax, All Rights Reserved. 5
ARM (DEPLOYMENT)
• RESOURCE• RESOURCE GROUP• RESOURCE PROVIDER• RESOURCE MANAGER TEMPLATE• DECLARATVE SYNTAX
![Page 6: Deploying, Backups, and Restore w Datastax + Azure at Albertsons/Safeway (Gurpreet Singh, Albertsons/Safeway) | Cassandra Summit 2016](https://reader035.fdocuments.us/reader035/viewer/2022081520/586f76031a28ab10258b62b9/html5/thumbnails/6.jpg)
ARM (DEPLOYMENT CONTD ..)
• ARM : Azure Resource Manager , a template which is written in JSON a key–value pair .
• Template Format :
© DataStax, All Rights Reserved. 6
![Page 7: Deploying, Backups, and Restore w Datastax + Azure at Albertsons/Safeway (Gurpreet Singh, Albertsons/Safeway) | Cassandra Summit 2016](https://reader035.fdocuments.us/reader035/viewer/2022081520/586f76031a28ab10258b62b9/html5/thumbnails/7.jpg)
BACKUP
OpsCenter backups the data ,how ?
![Page 8: Deploying, Backups, and Restore w Datastax + Azure at Albertsons/Safeway (Gurpreet Singh, Albertsons/Safeway) | Cassandra Summit 2016](https://reader035.fdocuments.us/reader035/viewer/2022081520/586f76031a28ab10258b62b9/html5/thumbnails/8.jpg)
© DataStax, All Rights Reserved. 8
CHALLENGES/LIMITATIONS
• OpsCenter 5.X didn't have option to backup the data in Centralized location in Azure cloud , the way it has Amazon S3 .
• Network latency if we try to use one or two blob storage for multiple VMs (Causes failure) .
![Page 9: Deploying, Backups, and Restore w Datastax + Azure at Albertsons/Safeway (Gurpreet Singh, Albertsons/Safeway) | Cassandra Summit 2016](https://reader035.fdocuments.us/reader035/viewer/2022081520/586f76031a28ab10258b62b9/html5/thumbnails/9.jpg)
© DataStax, All Rights Reserved. 9
rsync – a mirror !
All the nodes MUST have custom script at location
“/usr/share/datastax-agent/bin/backup-scripts”
Or
./bin/backup-scripts for tarball
Using Opscenter ->Backups , you can schedule backups.
![Page 10: Deploying, Backups, and Restore w Datastax + Azure at Albertsons/Safeway (Gurpreet Singh, Albertsons/Safeway) | Cassandra Summit 2016](https://reader035.fdocuments.us/reader035/viewer/2022081520/586f76031a28ab10258b62b9/html5/thumbnails/10.jpg)
RESTORE
How and where to start Restore ?
![Page 11: Deploying, Backups, and Restore w Datastax + Azure at Albertsons/Safeway (Gurpreet Singh, Albertsons/Safeway) | Cassandra Summit 2016](https://reader035.fdocuments.us/reader035/viewer/2022081520/586f76031a28ab10258b62b9/html5/thumbnails/11.jpg)
© DataStax, All Rights Reserved. 11
STEPS TO RESTORE CASSANDRA ON AZURE• Standup new infrastructure with DSE software and with exact same no. of nodes as
in Production .
• Copy the mirror disks to the location where a restore should be performed
• Update cassandra.YAML with cluster name ,seeds ,broadcast_address,rpc_address ,num_tokens and data, commit logs and saved caches directory .
• Update cassandra-rackdc.properties with the dc and rack (Fault domains in Azure , Availability zones in amazon) .
• Clean-up the SYSTEM tables Peers, Local .
• Update Cluster name, data-center & Rack for LOCAL column family .
• NODETOOL FLUSH .
• START Your DSE .
![Page 12: Deploying, Backups, and Restore w Datastax + Azure at Albertsons/Safeway (Gurpreet Singh, Albertsons/Safeway) | Cassandra Summit 2016](https://reader035.fdocuments.us/reader035/viewer/2022081520/586f76031a28ab10258b62b9/html5/thumbnails/12.jpg)
12© DataStax, All Rights Reserved.