Building Your AWS Migration Strategy for Large Data Sets

Building Your AWS Migration Strategy for Large Data SetsMatt BlanchardSolutions Architect, SoftNAS

Brent KaplanDirector Business Development, CloudHesive

February 25, 2016

© 2016 SoftNAS, Inc.

Introducing

Matt BlanchardSolutions Architect

SoftNAS


Brent KaplanDirector Business

DevelopmentCloudHesive

Housekeeping

Post your questions here

This session IS being recordedLinks to the recording and presentations will be provided later

To listen using your telephone select the ‘Telephone’ option.

For local numbers click the ‘additional numbers’ link.

You will need to use the Access Code and Audio PIN.

The audio for this webinar is available over VoIP. Just select

the use ‘Mic & Speakers’ option to listen to the webinar

through your computers speakers.

If you CAN NOT hear us, please check your

volume settings.

Webinar Audio1

2

3© 2016 SoftNAS, Inc.

Get My $100 AWS Credit!

First 100 attendees to register

(URL announced later)


Agenda

• Overview of Amazon Web Services Benefits• Data Migration Strategies with AWS• 5 Migration Options• Providing Highly Available Shared Storage• Demo

– Building Highly Available Shared Storage& Enabling Disaster Recovery

• SoftNAS Overview• CloudHesive Overview• Q&A


Overview of Amazon Web Services Benefits


7

What are My Storage Options on AWS?


8

• Block storage is an unformatted, POSIX-compliant storage device presented to the host operating system.

• Appropriate for use as the primary storage for file systems, databases, or for any applications that require fine granular updates.

• Can be aggregated into logical arrays using LVM or the software RAID utility of your choice (mdadm in Linux, diskpart/diskmgmt.msc in Windows)

What is Block Storage?


?

9

• What’s an object, anyway? An object is essentially any blob, or file: multimedia files, PDFs, and text documents are good examples.

• Object or “file” level storage is generally accessible to an application over a protocol, like CIFS, NFS, or HTTP, rather than as a hardware device available to the operating system.

• Useful for cold storage, log files, backup archives, video files, and much more.

What is Object Storage?


?

10

Variety of Storage Options


Amazon S3 (Simple Storage Service)

Amazon EBS (Elastic Block Storage)

Amazon EC2 Local Instance Store (Ephemeral volumes)

• Each has a unique combination of performance, durability, cost, and interface

• Often used to form a Storage Hierarchy

Data Migration Strategies with AWS


12

• Migrate applications to AWS• Build hybrid model• Deploy disaster recovery site

in an AWS region• Backup and archive into

Amazon S3, Glacier• Load data into AWS analytics

services, such as EMR and Redshift.

When Do We Need To Migrate Data?


13

Where Do We Migrate To?


Amazon S3Durable object

storage for all types of data

Amazon EBSBlock storage for use

with Amazon EC2

Amazon GlacierArchival storage for infrequently accessed data

Economics Easy to Use Reduce riskPay as you go

No upfront investmentNo commitment

No risky capacity planning

Self service administration

SDKs for simple integration

Durable and Secure

Avoid risks of physical media handling

5 Migration Options


© 2016 SoftNAS, Inc. 15

• Rsync• FTP• Jump box• SoftNAS Replication• AWS Snowball

What are my BYOT(Bring your own transfer) Options


Option Pro ConRsync • Fast, secure and robust • Not easy to use (needs

specific setup). Can be cumbersome over long hauls

FTP • Well known - wide spread, lots of clients, Fat’ish

• Not secure unless using SFTP (then speed is affected). Has a history of being hacking target

Jump Box • Easy to configure (Windows or Linux). Fast setup and deployment

• Relies on file level protocols. Slow (especially SMB)

SoftNAS Replication

• Fast block based ZFS sync. Easy to setup

• Needs SN instance on each side of transmission with own local storage

AWS Snowball • Native Amazon tool, intended for big data

• Hardware solution, requires shipment of appliance. Extra added cost

What Works Best?

17

AWS Snowball – Petabyte Scale Data Transport

© 2016 SoftNAS, Inc. E-ink shipping

label

Ruggedizedcase

“8.5G Impact”

All data encrypted end-to-end

Rain & dust resistant

Tamper-resistant case & electronics

50 TB10GE network

How Fast is Snowball?


• Less than 1 day to transfer 250TB via 5x10G connections with 5 Snowballs, less than 1 week including shipping

• Number of days to transfer 250TB via the Internet at typical utilizations Internet Connection Speed

Utilization 1Gbps 500Mbps 300Mbps 150Mbps25% 95 190 316 63250% 47 95 158 31675% 32 63 105 211

Providing Highly Available Shared Storage


20

• SNAP™ HA– Provides high availability seamless failover across zones– Leverages secure block replication with SoftNAS SnapReplicate

• Recommended: SNAP HA in high-availability mode = 99.999% uptime

High-Availability Architecture


21

Cross-zone HA: AWS Elastic IP


22

Cross-zone HA: Private Virtual IP Addresses


Demo: Building Highly Available Shared Storage & Enabling Disaster Recovery


SoftNAS Overview


25

Six main reasons to consider SoftNAS Cloud on AWS:

1. Powerful, full-featured data storage software2. Pure AWS3. Provides the BEST data protection available4. Fast, performance-tuned5. Easy, no specialized training required6. On-demand in AWS Marketplace

Best Solution


26

SoftNAS Products


SoftNAS Cloud NAS• Amazon Web Services (AWS)• Microsoft Azure• CenturyLink Cloud• VMware vSphere

SoftNAS for Service Providers• VMware vSphere

Multi-tenant NAS replacement for use with iSCSI and object storage

Public cloud NAS filerOn-premise cloud NAS filer

Technology Partners


Brands You Know Trust SoftNAS

CloudHesive Overview


30

Sign up for a AWS/SoftNAS Proof of Concept with CloudHesive & earn $75 AWS Credit!

• Contact Brent Kaplan to sign up!– [email protected] – Ph: 754-300-1798

Earn Additional $75 AWS Credit


mailto:[email protected]

31

• CloudHesive is an Amazon Web Services (AWS) Advanced Consulting Partner

• The ‘Go To’ Technical Partner for SoftNAS deployments.

• Managed Services Provider focused on cloud and security solutions

• Customers Profile that we Protected– HealthCare– Financial services– Regulated industries

Who Is CloudHesive


32

• Consulting – Cloud Strategy– Migration planning– Cloud Support

• Managed Security Services– Encryption as a Service (EaaS)– End Point Security – Encryption for data in-flight– Threat Management– Oversight of the security controls

• Managed Services – Migration to a cloud provider– Environments wrapped in security controls– Governance on Release/Change management processes– End to end monitoring and management

What We Do


We offer end-to-end cloud services and solutions to migrate and secure your mission critical applications.

33

• Implement Enterprise Solutions for small to mid-sized businesses

• Migration and Cloud security experts

• Allow us to do your migration for you so you can focus on your core business !!!

Cloud Migration Solutions


34

• Website : www.cloudhesive.com

• Website : www.softnas.com

• Get a $75 credit voucher with AWS for doing a SoftNAS proof of concept with CloudHesive

CloudHesive Info


http://www.cloudhesive.com/

http://www.softnas.com/

Earn $100 AWS Credit!

First 100 attendees to register

bit.ly/cloudhesive-aws-credits


http://bit.ly/cloudhesive-aws-credits





Next Steps• Learn More – bit.ly/softnas_aws &

cloudhesive.com

• SoftNAS Architecture on AWS White Paper – bit.ly/softnas-aws-wp

• Contact Us – softnas.com/contact

• Follow Us – @SoftNAS

• For additional information contact CloudHesive at [email protected] or 754-300-1798

Try It!

softnas.com/tryaws© 2016 SoftNAS, Inc.

http://bit.ly/softnas_aws

http://www.cloudhesive.com/

http://bit.ly/softnas-aws-wp

http://bit.ly/softnas-aws-wp

http://softnas.com/contact

http://twitter.com/softnas

http://twitter.com/softnas

mailto:[email protected]

Thank you


Building Your AWS Migration Strategy for Large Data Sets

Technology

Transcript of Building Your AWS Migration Strategy for Large Data Sets