AWS Webinar 201 - Backup, Archive and Disaster Recovery

40
AWS 201 Backup, Archive and Disaster Recovery Markku Lepistö Technology Evangelist @markkulepisto

description

IT systems and applications are producing and consuming content at a rapidly growing rate. This could significantly impact costs and agility of IT organizations if not planned for appropriately. Organizations of all sizes have seen significant benefits from utilizing cloud services in their business. One early area of focus for companies has been the highly durable, low cost and massively scalable benefits that come with cloud storage services. Today, thousands of developers and businesses around the globe rely on Amazon Web Services (AWS) for their backup, archival and disaster recovery requirements. This session covers best practices on proven designs from real world customer use cases and discuss topics such as capacity planning, durability, cost, security, as well as content categorization and transfer.

Transcript of AWS Webinar 201 - Backup, Archive and Disaster Recovery

Page 1: AWS Webinar 201 - Backup, Archive and Disaster Recovery

AWS  201  

Backup,  Archive  and  Disaster  Recovery  

Markku  Lepistö  -­‐  Technology  Evangelist  @markkulepisto  

Page 2: AWS Webinar 201 - Backup, Archive and Disaster Recovery

Housekeeping

•  Presentation ~45mins •  Post Questions Online •  Q&A at the end •  Reminder – Fill in the survey!

Page 3: AWS Webinar 201 - Backup, Archive and Disaster Recovery

Agenda

• What’s the Problem? • Data Transfer • Data Stores • Backup and DR • What’s Next?

Page 4: AWS Webinar 201 - Backup, Archive and Disaster Recovery

Problem

Page 5: AWS Webinar 201 - Backup, Archive and Disaster Recovery

We  are  constantly  producing  more  data  

Page 6: AWS Webinar 201 - Backup, Archive and Disaster Recovery

Primary Block

Storage

Primary File Storage

Archival Storage

Disk Based Backup Storage

Tape Infrastructure & Management

Replicated Storage for

Disaster Recovery

Offsite Locations

Geo-Resilience

Pressure on Traditional On-Premise Solutions

Complex  /  BriIle  Siloed  /  Expensive  Capacity  Guessing  

Page 7: AWS Webinar 201 - Backup, Archive and Disaster Recovery

Traditional Backups

•  Long/slow recovery time

•  Low durability (higher probability for data loss) •  Requires Tape Museums •  Expensive Tech Refresh

Page 8: AWS Webinar 201 - Backup, Archive and Disaster Recovery

AWS Services Help?

Page 9: AWS Webinar 201 - Backup, Archive and Disaster Recovery

Transfer

Page 10: AWS Webinar 201 - Backup, Archive and Disaster Recovery

AWS  Global  Infrastructure  

10 Regions

25 Availability Zones

51 Edge Locations

Page 11: AWS Webinar 201 - Backup, Archive and Disaster Recovery

AWS  Direct  Connect  Dedicated  bandwidth  between  your  

site  and  AWS  

AWS  Import/Export  Physical  transfer  of  media  into  and  

out  of  AWS    

When  -­‐  if  ever  -­‐  will  the  bandwidth  of    the  Internet  surpass  that  of  FedEx?  

—Johan  Öbrink  

Page 12: AWS Webinar 201 - Backup, Archive and Disaster Recovery

ElasPc  Block  Store  High  performance  block  storage  device  

 1GB  to  1TB  in  size,  max  4000  IOPS/volume  Mount  as  drives  to  instances    

with  snapshot/cloning  funcOonaliOes  

Simple  Storage  Service  Highly  scalable  object  storage  

1  byte  to  5TB  in  size  99.999999999%  durability  

Glacier  Long  term  object  archive  

1c/GB/month,  $120/TB/year  99.999999999%  durability  

Very  fast  mounted  volumes  

Slow,  infrequent  archive  

Fast  object  storage  

AWS Storage Options

Page 13: AWS Webinar 201 - Backup, Archive and Disaster Recovery

Storage Tiers & Automated Life-Cycle

Page 14: AWS Webinar 201 - Backup, Archive and Disaster Recovery

1PB  Raw  Storage  

800TB  Usable  Storage  

600TB  Allocated  Storage  

400TB  WriIen  ApplicaPon  Storage  

S3  &  Glacier  –    Only  actual  usage  is  charged  

Raw Storage at On perm vs. Cloud

Page 15: AWS Webinar 201 - Backup, Archive and Disaster Recovery

Access via Console, SDKs and Third-party Solutions

S3   Glacier  

Internet Web Services API

HTTP(S)

Via SDK Via 3rd parties

Page 16: AWS Webinar 201 - Backup, Archive and Disaster Recovery

AWS Storage Gateway for offsite disk backups Gateway-Cached Volumes

Backup Servers On-premises

Host

AWS Storage

Gateway VM

Direct Attached or Storage Area Network Disks

iSCSI SSL

Production Systems

Your  Datacenter  

Amazon  Simple  Storage  Service  

(S3)  

AWS  Storage  Gateway  Service  

Page 17: AWS Webinar 201 - Backup, Archive and Disaster Recovery

AWS Storage Gateway for departmental file shares Gateway-Stored Volumes

On-premises Host

AWS Storage

Gateway VM

Direct Attached or Storage Area Network Disks

SSL

Your  Datacenter  

Amazon  Simple  Storage  Service  

(S3)  

AWS  Storage  Gateway  Service  

iSCSI

End Users

CIFS/NFS

File servers

Page 18: AWS Webinar 201 - Backup, Archive and Disaster Recovery

AWS Storage Gateway - Virtual Tape Library

Page 19: AWS Webinar 201 - Backup, Archive and Disaster Recovery

•  CIFS/NFS  Local  PresentaPon  •  Appliance  or  Virtual  Machine  •  In-­‐Line  De-­‐DuplicaPon  •  Customer  Retained  Security  Keys  •  Local  Cache  for  recently  archived  data  

Partner Solutions

Page 20: AWS Webinar 201 - Backup, Archive and Disaster Recovery

Choosing the Data Store

Page 21: AWS Webinar 201 - Backup, Archive and Disaster Recovery

Amazon  ElasPCache  

Amazon  RDS  

Amazon  Redshic  

Amazon  S3  

Request  rate  High   Low  

Cost/GB  High   Low  

Latency  Low   High  

Data  Volume  Low   High  

Amazon  Glacier  

Amazon  CloudSearch  

Amazon  EMR  

Structure  

Low  

High  

Amazon  DynamoDB  

Page 22: AWS Webinar 201 - Backup, Archive and Disaster Recovery

cost, volume, access pattern structure

Page 23: AWS Webinar 201 - Backup, Archive and Disaster Recovery

Recovering from Disasters

Page 24: AWS Webinar 201 - Backup, Archive and Disaster Recovery

Backup  and  restore   Pilot  light  

Warm  standby  

Hot  standby  

Page 25: AWS Webinar 201 - Backup, Archive and Disaster Recovery

cost speed of recovery

Page 26: AWS Webinar 201 - Backup, Archive and Disaster Recovery

Backup the DB

Page 27: AWS Webinar 201 - Backup, Archive and Disaster Recovery

Backup Server Images

Page 28: AWS Webinar 201 - Backup, Archive and Disaster Recovery

Create instances from AMIs

Restore data from backups

Restore DB and App Servers

Page 29: AWS Webinar 201 - Backup, Archive and Disaster Recovery
Page 30: AWS Webinar 201 - Backup, Archive and Disaster Recovery
Page 31: AWS Webinar 201 - Backup, Archive and Disaster Recovery

Summary

Page 32: AWS Webinar 201 - Backup, Archive and Disaster Recovery

Internet  Web  Services  API  HTTP(S)  

AWS  Direct  Connect  

Block   File  

AWS  Cloud  

Customer  Data  Center  

Storage  Use  Cases  

Archive   Backup   Disaster  Recovery  

Next Generation Enterprise Storage  

Page 33: AWS Webinar 201 - Backup, Archive and Disaster Recovery

Tradi8onal:  On-­‐Premise  Solu8ons  

Primary  Block  Storage  

Primary  File  Storage  

Archival  Storage  

Disk  Based  Backup  Storage  

Tape  Infrastructure  &  Management  

Replicated  Storage  for  Disaster  Recovery  

Offsite  LocaPons  Geo-­‐

Resilience  

Next  Genera8on:  Gateway  &  Cloud  Storage  

Reduce  SAN  Footprint  

Reduce  NAS  Footprint  

Eliminate  Archival  

Hardware  &  Socware  

Eliminate  Backup  

Hardware  &  Socware  

Eliminate  Tape   Recover  in  Cloud  or  any  Data  Center  

Eliminate  Secondary  

Data  Centers  

Reduce  Complexity.   Reduce  Cost.  

Page 34: AWS Webinar 201 - Backup, Archive and Disaster Recovery

data information

abandoned actionable

Page 35: AWS Webinar 201 - Backup, Archive and Disaster Recovery

Amazon  CloudFront      

Amazon  Cloudsearch  

Amazon  ElasPc  

Transcoder  

Amazon  SWF  

Amazon  DynamoDB  

Amazon  ElasPc  MapReduce  

Amazon  VPC   Amazon  EC2   Amazon  EBS  

Discovery  

Delivery  

DR,  Archive,  Backup  and  Compute  

Transcoding  

Workflow  

AnalyPcs  

Managed  DBs  

Glacier  

(OR)  

Business  Value  From  The  Data  

Page 36: AWS Webinar 201 - Backup, Archive and Disaster Recovery

Benefits of AWS Storage Financial

–  Significant reduction in capital investments –  Pay for only what you use: Metered Utility –  Eliminate the need to over purchase –  AWS prices continue to fall over time

Operational –  Streamline and simplify data management operations –  Reduction of systems and data centers –  Focus employees on proactive and innovative tasks

Business –  Never stop the business as capacity is endless –  Never slow the pace of innovation –  Turn IT into an innovation enabler

Page 37: AWS Webinar 201 - Backup, Archive and Disaster Recovery

Demo Warm Standby, Cross-Region

Disaster!! and Recovery

Page 38: AWS Webinar 201 - Backup, Archive and Disaster Recovery

Thank  you  

Markku  Lepistö  -­‐  Technology  Evangelist  @markkulepisto  

Page 39: AWS Webinar 201 - Backup, Archive and Disaster Recovery

Your  feedback  is  important  

Please  complete  the  Survey!  What’s  good,  what’s  not  

What  you  want  to  see  at  these  events  

What  you  want  AWS  to  deliver  for  you  

Page 40: AWS Webinar 201 - Backup, Archive and Disaster Recovery

Q&A