AWS Tech Talk

42
© 2020, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Josh Mello, Storage Business Development Girish Chanchlani, Storage Solutions Architect February 18, 2020 AWS Tech Talk: Creating an Enterprise Backup Strategy with AWS Storage

Transcript of AWS Tech Talk

Page 1: AWS Tech Talk

© 2020, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Josh Mello, Storage Business Development

Girish Chanchlani, Storage Solutions Architect

February 18, 2020

AWS Tech Talk:Creating an Enterprise Backup Strategy with AWS Storage

Page 2: AWS Tech Talk

© 2020, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Agenda

• Today’s backup challenges and considerations for your backup strategy

• Amazon S3 storage

• AWS Storage Gateway

• APN backup solutions

• AWS Backup

• AWS resources

Page 3: AWS Tech Talk

© 2020, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Customer backup challenges

• IDC predicts that the collective sum of the world’s data will grow from 33 ZBs to 175 ZBs by 2025, a 61% CAGR

• Traditional backup approaches are not able to cost-effectively scale and secondary sites can be prohibitively expensive

• On-premises backup is consuming valuable resources for non-strategic purposes

Page 4: AWS Tech Talk

© 2020, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

AWS Storage Gateway

Backup models

Cloud nativeHybrid cloudOn-premises

AWS Cloud

Corporate data center

Traditional server

Storage Array

Backup Appliance

Corporate data center

Traditional server

Storage Array

AWS Cloud

AmazonS3

Amazon RDS

Amazon Elastic Block Store

Amazon EC2

Page 5: AWS Tech Talk

© 2020, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

On-Premises Backup Challenges

Traditional Backup Solutions:

• Are not cost-effective

• Do not scale seamlessly

• Consume valuable resources

• Require high-touch support to maintain and upgrade

Page 6: AWS Tech Talk

© 2020, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Immediate cloud backup benefits

Leverage existing investments

Cost effective storage

Elimination of tape backups

Unlock insights

Durability

Page 7: AWS Tech Talk

© 2020, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Amazon Simple Storage Service (S3)

Secure Durable

(99.999999999%)

Available

(99.9%)

Page 8: AWS Tech Talk

© 2020, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Your choice of Amazon S3 storage classes

Access frequencyFrequent Infrequent

• Active, frequently

accessed data

• Milliseconds access

• > 3 AZ

• $0.0210/GB

• Data with changing

access patterns

• Milliseconds access

• > 3 AZ

• $0.0210 to

$0.0125/GB

• Infrequently

accessed data

• Milliseconds access

• > 3 AZ

• $0.0125/GB

• Re-creatable, less

accessed data

• Milliseconds access

• 1 AZ

• $0.0100/GB

• Archive data

• Minutes or hours

access

• > 3 AZ

• $0.0040/GB

S3 Standard S3 Standard-IA S3 One Zone-IA S3 GlacierS3 Intelligent-

TieringS3 Glacier

Deep Archive

• Archive data

• Hours to access

• > 3 AZ

• $0.00099/GB

Page 9: AWS Tech Talk

© 2020, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

S3 Glacier and S3 Glacier Deep Archive

Priced from $0.00099/GB-Month

Standard restore tier typically within 12 hours

Priced from $0.004/GB-Month

Standard restore tier typically within 3-5 hours

Page 10: AWS Tech Talk

© 2020, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Need Immutability? – Amazon S3 Object Lock

Immutable S3 Objects

• Write Once Read Many (WORM) Protection for S3 Objects

• Object or bucket control of WORM & retention attributes

Retention Management Controls

• Define retention periods in your app or with bucket-level defaults

• Objects locked for the duration of the retention period

• Includes support for adding legal holds

Data Protection and Compliance

• Assessed for use in SEC 17a-4, CFTC, and FINRA environments

• Extra protection against accidental or malicious delete

• Audit retention date, mode, and legal hold status in S3 Inventory

Page 11: AWS Tech Talk

© 2020, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Amazon S3 Object Lock – the basics

IngestAdd retention controls to the object on PUT… or use bucket defaults to set retention on all new objects

LockWORM enforced based on Retain Until DateVersioning protects against overwrite, deletes are blocked

Retain Use APIs to extend retention, or for legal holds

Audit Review and audit retention information and object-level events

1

2

3

Page 12: AWS Tech Talk

© 2020, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Tape gateway: Overview and use casesVirtual tapes presented to on-premises backup applications

• Tape based backup with existing backup apps

• Archive to GlacierUse cases

On-Premises

iSCSI VTL

Tape Gateway

HTTPS

Application

Tape drives

Media changer

Tape Shelf(Amazon S3 Glacier)

Tape library(Amazon S3)

Service

Page 13: AWS Tech Talk

© 2020, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Select gateway type

Page 14: AWS Tech Talk

© 2020, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Select host platform

Page 15: AWS Tech Talk

© 2020, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Select service endpoint type

Page 16: AWS Tech Talk

© 2020, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Enter IP address assigned to gateway VM

Page 17: AWS Tech Talk

© 2020, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Activate gateway

Page 18: AWS Tech Talk

© 2020, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

View gateway in console

Page 19: AWS Tech Talk

© 2020, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Create tapes and present to backup application

Page 20: AWS Tech Talk

© 2020, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

View tape details

Page 21: AWS Tech Talk

“Using AWS Storage Gateway, Southern

Oregon University switched from physical to

virtual tape backup simply by dropping the

gateway’s virtual appliance into our existing

Veeam workflow. Setting it all up took three

hours, at most. We can now provision virtual

tapes on AWS with the click of a button.”

– Jesse Martinich, Network Service Manager,

Southern Oregon University

© 2020, Amazon Web Services, Inc. or its affiliates. All rights reserved.

SolutionChallenge Benefits

Southern Oregon University replaced physical tapes with AWS

• Backed up virtual tapes in

Amazon S3 via AWS

Storage Gateway

• Archived backup data into

Amazon S3 Glacier for

long-term storage

• Leveraged their Veeam-

based backup processes

• Moved all their physical

hardware within two

backup cycles

• SOU missed backup and

disaster recovery

objectives due to

hardware challenges,

hardware refreshes and

tape handling

• The team spent many

hours a week managing

physical backup, tape

libraries and tapes

• Eliminated 500

hours for backup

• Improved

productivity by

provisioning tapes

with a console click

• Increased savings by

eliminating

hardware costs

Page 22: AWS Tech Talk

© 2020, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

APN Partner Solutions

Page 23: AWS Tech Talk

© 2020, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Storage Use Cases

aws.amazon.com/backup-recovery/partner-solutions

Backup and Restore Primary Storage Archive BCDR

Solutions that leverage file, block, object, and streamed

data formats as an extension to on-premises storage

Solutions that leverage Amazon S3 for durable data backup

Solutions that leverage Amazon Glacier for durable and cost-

effective long-term data backup

Solutions that utilize AWS to enable recovery strategies focused on RTO and RPO

requirements

Consulting

Consulting services that provide implementation capabilities in

one or more core storage categories

Partner who has achieved Storage Competency

Page 24: AWS Tech Talk

© 2020, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

• Backup and recovery use cases protect data from logical errors such as system failure, application error, or accidental deletion. Backups can be run on-premises to the cloud, either directly to a cloud target or via a gateway appliance, or within the cloud.

• Backup is not archive

– Backup represents a point in time copy of the data

– Archived data is the only authoritative copy of the data

Backup & Restore

Page 25: AWS Tech Talk

© 2020, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Company: The San Francisco Giants are one of the oldest teams in Major League Baseball, and in its history had three World Series Championships, four National League Pennants, and have had seven playoff appearances.

Challenges: • Large spike in terms of amount of data being stored• Current data backup approach was complex, costly and not suited to

leverage economics of cloud

Solution: Cohesity for backup and long-term retention solution

Benefits:• Annual savings of >$15K by eliminating co-lococation• Backup windows reduced by 50%• Ability to balance business growth and ease of operations with a

hybrid cloud approach• Flexible and simple solution to meet future data expansion and

requirements

Cohesity: San Francisco Giants

Page 26: AWS Tech Talk

© 2020, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Company: a $16B+ specialty pharmaceutical company producing branded and generic drugs (i.e., BOTOX®), in over 100 countries with 10,000+ employees.

Challenges:• High data compliance requirements• Time-consuming eDiscovery data collection and review workflow• Intense manual integration of employee device data after M&A• Lack of IT staff to manage critical end user data across the globe

Solution: Druva inSync and Exterro’s eDiscovery platform enable Allergan to seamlessly drive an accelerated eDiscovery workflow in the cloud

Benefits:• Central visibility and management of data across all remote sites in

100 countries• Streamlined Legal Hold and eDiscovery• A 95% reduction in eDiscovery data collection time• Fully automated Legal Hold and data retention workflow

Druva: Allergan

Page 27: AWS Tech Talk

© 2020, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Rubrik: University of California San Diego

Company: UC San Diego is a top 15 research university worldwide with $1Bn+ in annual research funding. The 400-person IT department supports over 30,000 students and 6,000 faculty and staff.

Challenges: Outdated and siloed backup & recovery solution• No path to cloud• Lengthy RTOs• Complex and costly legacy solution management

Solution: Chose Amazon S3 and Rubrik as new data management solution.

Benefits:• 90% faster restores with VM + SQL recoveries (<30 min

vs. 5+ hours)• 90% management time savings (10 hrs per week down to

5-10 min)• 36 hrs to migrate infra to AWS (unable to migrate to

cloud before)

Page 28: AWS Tech Talk

© 2020, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Disaster Recovery

• Customer’s ability to technically recover from a situation where assets critical to business operations are inaccessible,

• Continue/restart core business operations using the recovery environment, and perform both operations within a period of time to reduce business loss.

• Many current BCDR solutions use traditional storage replication and recovery solutions (including Backup and Archive above) that are simply repointed to cloud targets vs. alternative locations.

• BCDR is implemented in two main ways: Cold (e.g. Backup & Recovery, Pilot Light) or Warm (e.g. Warm Standby or Multi-Site)

Page 29: AWS Tech Talk

© 2020, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Commvault: Dow Jones

Customer: Dow Jones is an American publishing and financial information firm.

Challenges:• Modernizing data protection with cloud infrastructure for better

business continuity.• Required cloud recovery/cloud DR capabilities.

Solution:• Commvault backup and recovery protecting on-premise

workloads directly into AWS S3• Reduced complexity and eliminated over 30,000 tapes.• Migrated 4,000 workloads into AWS with Commvault.

Benefits:• Leveraging Commvault and AWS, Dow Jones now has a

modernized data protection strategy to include on-premise protection, in-cloud protection and DR to the cloud.

• Improved SLA’s for the business, from days down to hours• Cut costs from $80,000 per month to $6,000 per month

Page 30: AWS Tech Talk

© 2020, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Company: Zebra designs, manufactures and sells a range of automatic identification and data capture (AIDC) products.

Challenges:• Needed backup and DR strategy for its global EC2 servers• Minimize downtime and eliminate data loss of critical IT systems• Solution should replicate AMIs to additional AWS regions• Wanted automated testing of backups at regular frequency

Solution: Chose CloudRanger’s Automated Disaster Recovery SaaS solution

Benefits:• Ensured EC2 servers are protected• Allowed for fully automated, real-time testing of cross-region disaster

recovery scenarios• Saved hundreds of management hours annually

Druva CloudRanger: Zebra

Page 31: AWS Tech Talk

© 2020, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

AWS Backup

Page 32: AWS Tech Talk

Cloud native backup

AWS Storage Gateway

Cloud nativeHybrid cloudOn-premises

AWS Cloud

Corporate data center

Traditional server

Storage Array

Backup Appliance

Corporate data center

Traditional server

Storage Array

AWS Cloud

AmazonS3

Amazon RDS

Amazon Elastic Block Store

Amazon EC2

Page 33: AWS Tech Talk

Cloud-native backup challenges

Complexity

• Custom scripts to automate & manage backups

• No centralized monitoring of backup operations

• Distributed logs

Compliance

• Difficult reporting for audit and compliance

• Lack of automated policy enforcement for data protection

Cost

• Time and resources allocated to building, maintaining and supporting data protection tools

Backup operations siloed across AWS services

Page 34: AWS Tech Talk

Introducing AWS Backup

AWS Backup

A fully managed, policy-based backup service that makes it easy to centrally manage and automate the

backup of data across AWS services

Page 35: AWS Tech Talk

Use cases

ComplianceCloud-native Backups Disaster Recovery

Protect your critical data across AWS

services

Simplify management of

business & regulatory compliance

Reduce risk of downtime and build

foundation for business continuity

Page 36: AWS Tech Talk

Backup Plans

define a backup schedule to specify

the timing and frequency of

backups, assign IAM roles

Create a lifecycle policy to define

timing of movement and period of

retention

Manage and monitor backups

Assign resources to the backup plan

using tags or ARNs

A backup plan allows a customer to fully operationalize their backup strategy within a single plan/document

Single backup plan doc

Page 37: AWS Tech Talk

Supported Functionality

Automated Backup Schedules ✓ ✓ ✓ ✓ ✓ ✓

Automated Retention Management ✓ ✓ ✓ ✓ ✓ ✓

Centralized Backup Monitoring/Logging ✓ ✓ ✓ ✓ ✓ ✓

KMS Integrated backup encryption ✓ ✓ ✓ ✓ ✓ ✓

Lifecycle to Cold Storage ✓

Item Level Restore ✓

Cross Region Backups ✓ ✓ ✓ ✓ ✓

Amazon

EFS

Amazon

EBS

Amazon

RDS

DynamoDB AWS Storage Gateway

Amazon EC2

Page 38: AWS Tech Talk

© 2019, Amazon Web Services, Inc. or its Affiliates. ”“

”“

Santos automates lifecycle management and centralizes compliance with AWS Backup

Santos built an in-house backup solution that required regular maintenance of Lambda scripts and resource snapshots. To meet compliance regulations, they spent time on a weekly basis identifying whether the scripts ran scheduled backups for all applications.

The company increased their confidence by streamlining their backups with AWS Backup. Santos removed their operational burden with automated routine backups, eliminated the maintenance of Lambda scripts, and met compliance regulations.

• Increased productivity and reduced the # hours needed to do backups by 80%

• Reduced operational costs associated with backup by 50%

• Increased accuracy of snapshots from 80% to 100%

SolutionChallenge Benefits

AWS Backup reduced operational overhead by 50%,

saving us days and weeks of maintaining and

scheduling scripts for backups. The ease of

implementing AWS Backup helped us jump-start our

backup automation, which gave us the piece of mind

that our backups meet compliance and removed the

operational burden. Gavin Boyce, Solutions Architect, Santos

Company: Santos

Industry: Oil & Gas

Country: Australia

Employees: 2,190

Website: https://www.santos.com/

About Santos

Santos Ltd. is Australia’s second-

largest independent oil and gas

producer and has one of the largest

exploration and production acreages

in Australia and extensive

infrastructure.

Page 39: AWS Tech Talk

Modernize your backup strategy

1. Reduce your infrastructure costs and move tape backup to the cloud with Tape Gateway

2. Leverage your existing investments with APN solutions

3. Support your backup requirements with Amazon S3

4. Address compliance requirements with S3 Object Lock

5. Automate cloud backup with AWS Backup

Page 40: AWS Tech Talk

Additional Resources

AWS Storage Solution Pages https://aws.amazon.com/products/storage/https://aws.amazon.com/backup-restorehttps://aws.amazon.com/disaster-recovery

AWS Storage Competency and This Is My Architecturehttps://aws.amazon.com/backup-recovery/partner-solutionshttps://aws.amazon.com/this-is-my-architecture

AWS Marketplace Storage for in-cloud use cases https://aws.amazon.com/marketplacehttps://aws.amazon.com/solutionspace/storage/

Webinarshttps://aws.amazon.com/webinars/partner-webinars

Additional Backup Documentation

eBook: Backup with AWSWhitepaper: Backup and Restore to AWS – APN Partners Case studies: Storage Gateway-based Backup solutions

Page 41: AWS Tech Talk

© 2020, Amazon Web Services, Inc. or its Affiliates. All rights reserved.© 2020, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Q & A

Page 42: AWS Tech Talk

© 2020, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Thank you!