February 2016 Webinar Series - Use AWS Cloud Storage as the Foundation for Hybrid Strategy
-
Upload
amazon-web-services -
Category
Technology
-
view
1.985 -
download
0
Transcript of February 2016 Webinar Series - Use AWS Cloud Storage as the Foundation for Hybrid Strategy
![Page 1: February 2016 Webinar Series - Use AWS Cloud Storage as the Foundation for Hybrid Strategy](https://reader035.fdocuments.us/reader035/viewer/2022070602/58781e771a28aba12d8b6033/html5/thumbnails/1.jpg)
© 2015, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Isaiah Weiner, AWS Partner Solutions Architecture
2/23/2016
Use AWS Cloud Storage as the Foundation for Hybrid Strategy
![Page 2: February 2016 Webinar Series - Use AWS Cloud Storage as the Foundation for Hybrid Strategy](https://reader035.fdocuments.us/reader035/viewer/2022070602/58781e771a28aba12d8b6033/html5/thumbnails/2.jpg)
Getting Started
Clarifying Block vs. File vs. Object Use Case: Backup and Recovery Use Case: Big Data Use Case: Active Archive Use Case: Primary Storage
![Page 3: February 2016 Webinar Series - Use AWS Cloud Storage as the Foundation for Hybrid Strategy](https://reader035.fdocuments.us/reader035/viewer/2022070602/58781e771a28aba12d8b6033/html5/thumbnails/3.jpg)
Block vs. File vs. Object
< 5 ms✔
< 10 ms✔✔Standards-based,Legacy app support
< 100 ms✔
✔ + Customizable!Modern stack support,
scalable interfaces
LatencyDataMetadataAccess
![Page 4: February 2016 Webinar Series - Use AWS Cloud Storage as the Foundation for Hybrid Strategy](https://reader035.fdocuments.us/reader035/viewer/2022070602/58781e771a28aba12d8b6033/html5/thumbnails/4.jpg)
What should I use, and when?
Economics Easy to Use Reduce risk Agility, Scale Pay as you go No upfront investment No commitment No risky capacity
planning
Self service administration
SDKs for simple integration
Durable and Secure Avoid risks of physical
media handling
Reduce time to market Focus on your business,
not your infrastructure
Amazon S3Durable object storage
for all types of data
Amazon EBSBlock storage for use
with Amazon EC2
Amazon GlacierArchival storage for infrequently accessed data
Amazon EFSFile storage for use with Amazon EC2
![Page 5: February 2016 Webinar Series - Use AWS Cloud Storage as the Foundation for Hybrid Strategy](https://reader035.fdocuments.us/reader035/viewer/2022070602/58781e771a28aba12d8b6033/html5/thumbnails/5.jpg)
Backup and Recovery
![Page 6: February 2016 Webinar Series - Use AWS Cloud Storage as the Foundation for Hybrid Strategy](https://reader035.fdocuments.us/reader035/viewer/2022070602/58781e771a28aba12d8b6033/html5/thumbnails/6.jpg)
Backup and Recovery to the Cloud
Amazon S3
Amazon GlacierAWS
DirectConnect
InternetAmazon S3-IA
Applicationservers
Cloud Gateway
Local disk
MediaServer
Cloud Gateway
HTTPS/API
Applicationservers
Cloud Connector
Local diskMedia
Server with cloud
connector
HTTPS/API
![Page 7: February 2016 Webinar Series - Use AWS Cloud Storage as the Foundation for Hybrid Strategy](https://reader035.fdocuments.us/reader035/viewer/2022070602/58781e771a28aba12d8b6033/html5/thumbnails/7.jpg)
Gateway: AWS Storage Gateway
Amazon EBS snapshots
Amazon S3
Amazon Glacier
AWSStorage Gateway
appliance
Applicationserver
AWSStorage Gateway
backendAWS
DirectConnect
Internet
Customer premises
![Page 8: February 2016 Webinar Series - Use AWS Cloud Storage as the Foundation for Hybrid Strategy](https://reader035.fdocuments.us/reader035/viewer/2022070602/58781e771a28aba12d8b6033/html5/thumbnails/8.jpg)
Gateway: NetApp AltaVault
Common backup applications integrated with AltaVaultSolve backup & archive headaches with cloud-integrated storage
90% reduction in time, cost, and data volumes Shrink recovery times from days to minutes 85% of backup & software providers supported
Glacier
On Premises
AWS
Cloud-integrated storage appliance
NetApp AltaVault
FAS
E-SeriesNon-NetApp
Storage
Seamlessly integrates into existing storage and backup
software environment
Deduplicates, compresses, and encrypts
Caches recent backups locally, vaults older copies to
the cloud
NetApp SnapProtect Arcserve CommVault Simpana EMC NetWorker HP Data Protector IBM Tivoli
Storage Mgr
Symantec Backup Exec
Symantec NetBackup
Veeam Microsoft SQL
Server Oracle RMAN
S3
AltaVault also available on marketplace to protect cloud-native workloads
Store data in the public or private cloud of choice
![Page 9: February 2016 Webinar Series - Use AWS Cloud Storage as the Foundation for Hybrid Strategy](https://reader035.fdocuments.us/reader035/viewer/2022070602/58781e771a28aba12d8b6033/html5/thumbnails/9.jpg)
Big Data
![Page 10: February 2016 Webinar Series - Use AWS Cloud Storage as the Foundation for Hybrid Strategy](https://reader035.fdocuments.us/reader035/viewer/2022070602/58781e771a28aba12d8b6033/html5/thumbnails/10.jpg)
S3 + EMR
EMR cluster
Amazon S3
EMR cluster
corporate data center
AWSDirect
Connect
Internet
Applicationserver
![Page 11: February 2016 Webinar Series - Use AWS Cloud Storage as the Foundation for Hybrid Strategy](https://reader035.fdocuments.us/reader035/viewer/2022070602/58781e771a28aba12d8b6033/html5/thumbnails/11.jpg)
S3 + RedShift
Amazon S3corporate data center
AWSDirect
Connect
Internet
Applicationserver
![Page 12: February 2016 Webinar Series - Use AWS Cloud Storage as the Foundation for Hybrid Strategy](https://reader035.fdocuments.us/reader035/viewer/2022070602/58781e771a28aba12d8b6033/html5/thumbnails/12.jpg)
Dive Deep on Big Data with S3AWS re:Invent 2015: DAT201 Introduction to Amazon Redshifthttps://www.youtube.com/watch?v=DIj1bFjiqd8
AWS re:Invent 2015: DAT308 How Yahoo! Analyzes Billions of Events a Day on Amazon RedShifthttps://www.youtube.com/watch?v=3qmzwqnC67kDAT308 Slides:http://www.slideshare.net/AmazonWebServices/dat308-yahoo-analyzes-billions-of-events-a-day-on-amazon-redshift
AWS re:Invent 2015: BDT305 Amazon EMR Deep Dive and Best Practiceshttps://www.youtube.com/watch?v=4HseALaLllcBDT305 Slides:http://www.slideshare.net/AmazonWebServices/bdt305-amazon-emr-deep-dive-and-best-practices
BDT314: Running a Big Data and Analytics Application on Amazon EMR and Amazon Redshift with a Focus on Securityhttp://www.slideshare.net/AmazonWebServices/bdt314-a-big-data-analytics-app-on-amazon-emr-amazon-redshift
![Page 13: February 2016 Webinar Series - Use AWS Cloud Storage as the Foundation for Hybrid Strategy](https://reader035.fdocuments.us/reader035/viewer/2022070602/58781e771a28aba12d8b6033/html5/thumbnails/13.jpg)
Active Archive
![Page 14: February 2016 Webinar Series - Use AWS Cloud Storage as the Foundation for Hybrid Strategy](https://reader035.fdocuments.us/reader035/viewer/2022070602/58781e771a28aba12d8b6033/html5/thumbnails/14.jpg)
AWS Import/Export Disk
• Accelerates moving large amounts of data into and out of Amazon S3, Glacier and EBS
• Transfers your data directly onto and off of customer owned storage devices
• Uses Amazon high-speed internal network to complete the transfer
• Supports up to eSATA and USB 2,3 attached drives up to 6 TB and 16 TB arrays
AWS Import/Export
![Page 15: February 2016 Webinar Series - Use AWS Cloud Storage as the Foundation for Hybrid Strategy](https://reader035.fdocuments.us/reader035/viewer/2022070602/58781e771a28aba12d8b6033/html5/thumbnails/15.jpg)
What is Snowball? Petabyte scale data transport
E-ink shipping label
Ruggedizedcase“8.5G Impact”
All data encrypted end-to-end
Rain & dust resistant
Tamper-resistant case & electronics
50 TB10GE network
![Page 16: February 2016 Webinar Series - Use AWS Cloud Storage as the Foundation for Hybrid Strategy](https://reader035.fdocuments.us/reader035/viewer/2022070602/58781e771a28aba12d8b6033/html5/thumbnails/16.jpg)
How it works
![Page 17: February 2016 Webinar Series - Use AWS Cloud Storage as the Foundation for Hybrid Strategy](https://reader035.fdocuments.us/reader035/viewer/2022070602/58781e771a28aba12d8b6033/html5/thumbnails/17.jpg)
How fast is Snowball?• Less than 1 day to transfer 250TB via 5x10G connections with 5
Snowballs, less than 1 week including shipping• Number of days to transfer 250TB via the Internet at typical utilizations
Internet Connection SpeedUtilization 1Gbps 500Mbps 300Mbps 150Mbps
25% 95 190 316 63250% 47 95 158 31675% 32 63 105 211
![Page 18: February 2016 Webinar Series - Use AWS Cloud Storage as the Foundation for Hybrid Strategy](https://reader035.fdocuments.us/reader035/viewer/2022070602/58781e771a28aba12d8b6033/html5/thumbnails/18.jpg)
How fast is Snowball? Less than 1 day to transfer 250TB via 5x10G connections with 5
Snowballs, less than 1 week including shipping Number of days to transfer 250TB via the Internet at typical utilizations
Internet Connection SpeedUtilization 1Gbps 500Mbps 300Mbps 150Mbps
25% 95 190 316 63250% 47 95 158 31675% 32 63 105 211
![Page 19: February 2016 Webinar Series - Use AWS Cloud Storage as the Foundation for Hybrid Strategy](https://reader035.fdocuments.us/reader035/viewer/2022070602/58781e771a28aba12d8b6033/html5/thumbnails/19.jpg)
How fast is Snowball? Less than 1 day to transfer 250TB via 5x10G connections with 5
Snowballs, less than 1 week including shipping Number of days to transfer 250TB via the Internet at typical utilizations
Internet Connection SpeedUtilization 1Gbps 500Mbps 300Mbps 150Mbps
25% 95 190 316 63250% 47 95 158 31675% 32 63 105 211
![Page 20: February 2016 Webinar Series - Use AWS Cloud Storage as the Foundation for Hybrid Strategy](https://reader035.fdocuments.us/reader035/viewer/2022070602/58781e771a28aba12d8b6033/html5/thumbnails/20.jpg)
When to use AWS Import/Export Snowball
Cloud Migration
Disaster Recovery
DatacenterDecommission
ContentDistribution
![Page 21: February 2016 Webinar Series - Use AWS Cloud Storage as the Foundation for Hybrid Strategy](https://reader035.fdocuments.us/reader035/viewer/2022070602/58781e771a28aba12d8b6033/html5/thumbnails/21.jpg)
AWS Snowball AWS Import/Export Disk
When to use Disk vs Snowball?
Import only, Export coming soon Currently available in US East
and US West 2 Import to S3 only Supports large data transfers,
from TBs to PBs
Supports import and export for S3 buckets and EBS snapshot import in:
US East (N. Virginia) US West (Oregon) US West (Northern California) EU (Ireland) Asia Pacific (Singapore)
Supports import into Glacier in: US East (N. Virginia) US West (Oregon) US West (Northern California) EU (Ireland) regions.
![Page 22: February 2016 Webinar Series - Use AWS Cloud Storage as the Foundation for Hybrid Strategy](https://reader035.fdocuments.us/reader035/viewer/2022070602/58781e771a28aba12d8b6033/html5/thumbnails/22.jpg)
Use Amazon Glacierfor lowest-cost, durable cold
storage of archival data
Use Amazon S3 for reliable,
durable primary storage
Use Amazon S3 Infrequent Access
Storage for secondary backups
at a lower cost
S3-IA
Tiering on AWS: optimize your storage spend
![Page 23: February 2016 Webinar Series - Use AWS Cloud Storage as the Foundation for Hybrid Strategy](https://reader035.fdocuments.us/reader035/viewer/2022070602/58781e771a28aba12d8b6033/html5/thumbnails/23.jpg)
Key prefix “logs/”
Transition objects to Glacier 30 days after creation
Delete 365 days after creation date
<LifecycleConfiguration> <Rule>
<ID>archive-in-30-days</ID> <Prefix>logs/</Prefix> <Status>Enabled</Status> <Transition>
<Days>30</Days>
<StorageClass>GLACIER</StorageClass> </Transition> <Expiration>
<Days>365</Days> </Expiration>
</Rule></LifecycleConfiguration
S3 lifecycle policies
![Page 24: February 2016 Webinar Series - Use AWS Cloud Storage as the Foundation for Hybrid Strategy](https://reader035.fdocuments.us/reader035/viewer/2022070602/58781e771a28aba12d8b6033/html5/thumbnails/24.jpg)
What about WORM?
SEC Rule 17a-4(f) FINRA Rule 4511 CFTC Regulation 1.31
Have: Need: Glacier Vault Lock
![Page 25: February 2016 Webinar Series - Use AWS Cloud Storage as the Foundation for Hybrid Strategy](https://reader035.fdocuments.us/reader035/viewer/2022070602/58781e771a28aba12d8b6033/html5/thumbnails/25.jpg)
Dive Deep on Active Archive
AWS re:Invent 2015: STG202 AWS Import/Export Snowball: Large-Scale Data Ingest into AWShttps://www.youtube.com/watch?v=86ogJHFSJRoSlides:http://www.slideshare.net/AmazonWebServices/stg202-aws-importexport-snowball-largescale-data-ingest-into-aws
Third-Party SEC 17a-4(f) Assessment for Vault Lockhttps://aws.amazon.com/blogs/aws/glacier-cohasset-assessment/
Service details and pricinghttps://aws.amazon.com/importexport/
![Page 26: February 2016 Webinar Series - Use AWS Cloud Storage as the Foundation for Hybrid Strategy](https://reader035.fdocuments.us/reader035/viewer/2022070602/58781e771a28aba12d8b6033/html5/thumbnails/26.jpg)
Primary Storage
![Page 27: February 2016 Webinar Series - Use AWS Cloud Storage as the Foundation for Hybrid Strategy](https://reader035.fdocuments.us/reader035/viewer/2022070602/58781e771a28aba12d8b6033/html5/thumbnails/27.jpg)
Hybrid Primary Storage Approaches
Java Python (boto) PHP .NET Ruby Node.js
iOS Android AWS Toolkit for Visual
Studio
AWS Toolkit for Eclipse
AWS Tools for Windows
PowerShell
AWS CLI
JavaScript
![Page 28: February 2016 Webinar Series - Use AWS Cloud Storage as the Foundation for Hybrid Strategy](https://reader035.fdocuments.us/reader035/viewer/2022070602/58781e771a28aba12d8b6033/html5/thumbnails/28.jpg)
Hybrid Primary Storage Approaches
Customer Datacenter
Amazon S3
Existing Storage
Infrastructure
On-PremisesApplicationServers
NFS, CIFS, SMB, iSCSI, FC, AoE, …
Works withexisting
applications
NAS or SAN Resources
?
![Page 29: February 2016 Webinar Series - Use AWS Cloud Storage as the Foundation for Hybrid Strategy](https://reader035.fdocuments.us/reader035/viewer/2022070602/58781e771a28aba12d8b6033/html5/thumbnails/29.jpg)
Primary Storage Technology Partners
S3 backed, NFS/SMB server
Natural fit for hybrid strategy
Originally a NAS accelerator
Past founder successes: CMU AFS, Transarc (IBM), Spinnaker Networks (NetApp)
![Page 30: February 2016 Webinar Series - Use AWS Cloud Storage as the Foundation for Hybrid Strategy](https://reader035.fdocuments.us/reader035/viewer/2022070602/58781e771a28aba12d8b6033/html5/thumbnails/30.jpg)
Primary Storage Technology Partners
Global filesystem backed by S3 supports NFS/SMB
Natural fit for hybrid strategy
Past founder successes: Alteon (Nortel), Aruba Networks (HP)
![Page 31: February 2016 Webinar Series - Use AWS Cloud Storage as the Foundation for Hybrid Strategy](https://reader035.fdocuments.us/reader035/viewer/2022070602/58781e771a28aba12d8b6033/html5/thumbnails/31.jpg)
Dive Deep with Primary Storage Use Cases
AWS re:Invent 2015: STG308 How Electronic Arts, State of Texas, & H3 Biomedicine Use AWShttps://www.youtube.com/watch?v=PmPriuFEz1kSlides:http://www.slideshare.net/AmazonWebServices/stg308-how-ea-state-of-texas-h3-biomedicine-protect-data
![Page 32: February 2016 Webinar Series - Use AWS Cloud Storage as the Foundation for Hybrid Strategy](https://reader035.fdocuments.us/reader035/viewer/2022070602/58781e771a28aba12d8b6033/html5/thumbnails/32.jpg)
Thank you!