AWS for the SQL Server Pro

@LynnLangit

Nov 2013

Data Expertise / Lynn Langit

Practicing Architect• Cloud Deployments (Azure, AWS, Google)

Technical author / trainer• Google Cloud Developer Series• SQL Server 2012 Developer Series • Cloudera Certified Developer• 2 books on SQL Server BI

Industry awards• Microsoft – MVP for SQL Server • Google – GDE for Cloud Platform• 10Gen – Master for MongoDB

Former MSFT FTE• 4 years

What and Why AWS?

AWS Amazon’s cloud

Large Set of services• Compute• Data• More

Market leader• In market

longest• Usually

cheapest • Most often used

in production

Amazon Web Services

5

How to Work with AWS

• Web Console

• Command Line Tools

• AWS SDK and IDE Tools

EC2 – Virtual Machines (AMIs)

EC2 – VMs (AMIs) from AWS Marketplace

8 April 2013

Demo - EC2Virtual Machines

Understanding EC2 storage options

S3 -- Storage

S3 – bucket properties

12 April 2013

Demo – S3 Storage

Glacier -- storage & archiving

14 April 2013

Demo – GlacierArchival Storage

RDS – partially managed SQL Server and more…

16 April 2013

Demo – RDSSQL Server as a service

RDS vs. EC2 for SQL Server

• Provisioned IO – performance guarantees

• Scheduled backups • Point in time restores• Scheduled

maintenance windows• Full use of all SQL

tools, SSMS, Profiler, DTA, etc…

• Supports Availability Groups (requires 2012 Enterprise)

• Cross-regional snapshots

Why RDS costs more

Redshift – Warehouse as a Service

19 April 2013

Demo – RedshiftData Warehousing as a Service

DynamoDBfor fast NoSQL with SSDs

21 April 2013

Demo – DynamoDB

NoSQL on SSD

Elastic MapReducefor easy Hadoop

23 April 2013

Demo – MapReduceHadoop on AWS

Data Pipelines – automated data transfer

25 April 2013

Demo – Data Pipeline

Build data flows on AWS

Elastic Beanstalkfor application scalability

27 April 2013

Demo – BeanstalkPaaS on AWS

28

AWS SDK for Visual Studio

29 April 2013

Demo – AWS SDKAdd-in for Visual Studio and .NET

Cloud Database Services by Vendor

AWS Google MicrosoftVirtual Machines EC2 w/SQL Server GCE – Linux only Azure VM – W/SQL

Server

Cloud RDBMS RDS - SQL ServerRedshift -Postgres

mySQLMariaDB

SQL Azure

NoSQL bucketsKey-Value stores

S3, EBS, Glacier, DynamoDB

Cloud Storage HR Datastore on GAE

Azure Blobs Azure Tables

Pipelines Data Pipelines Via APIs only SSIS (on-premises)

Streaming Machine Learning

Custom EC2 Prospective Search &Prediction API

StreamInsight

Document MongoDB on EC2 None MongoDB on Windows Azure

Hadoop MapReduce or Dremel

MapReduce on EC2 using S3

Big Query HDInsight (HDFS) on Azure

Data sets & other

EBS volumes w/datasets

FreebaseTranslation APIFull-text search

Azure Marketplace

Costs - Free Tier – EC2

Costs - Free Tier SQL and Dynamo

How much does it cost?

Creative Financing

• Use what you need and no more, i.e. instance size, storage size…

• Watch for price drops – RDS price decrease this week

Regular Pricing

• Pause EC2 instances to reduce compute charges• Delete EC2 instances to reduce storage charges

Smart EC2 Instance Usage

• Set pricing alerts• Use spot pricing• Re-selling compute / storage

Vanity Pricing

35

Example: EC2 Spot Pricing

36

Example: EC2 Reserved Pricing

37

Tip: Use Pricing Calculators

Example – from RightScale ‘PlanForCloud’

Conclusions

EC2 for testing, training and production (IaaS)

S3 for archiving R/W

Glacier for archiving W fast & cheap, R slow & expensive

RDS for HA SQL Server

Redshift for Data Warehousing on demand

DynamoDB for fast NoSQL – on SSDs

Elastic Map Reduce for easy Hadoop MapReduce

www.TeachingKidsProgramming.org• Free Courseware (Java, SmallBasic or C# / Pluralsight)• Do a Recipe Teach a Kid (Ages 10 ++)• Dec 2013 – Code.org – ‘Hour of Code’ education

partner

• recipes)

Keep Learning

Twitter: @LynnLangitYouTube:http://www.youtube.com/user/SoCalDevGal

Hire me• To help build your BI/Big Data

solution• To teach your team next gen BI• To learn more about using NoSQL

solutions