Introduction to the AWS Cloud from Digital Tuesday Meetup

99
What is Cloud Computing with Amazon Web Services? [email protected] @IanMmmm Ian Massingham — Technical Evangelist

Transcript of Introduction to the AWS Cloud from Digital Tuesday Meetup

Page 1: Introduction to the AWS Cloud from Digital Tuesday Meetup

What is Cloud Computing with Amazon Web Services?

[email protected]

@IanMmmm

Ian Massingham — Technical Evangelist

Page 2: Introduction to the AWS Cloud from Digital Tuesday Meetup

Learning about Cloud Computing with AWS

Who is using AWS and what are they using it for?

How can I use AWS services to run my workloads?

What is Cloud Computing and what are its benefits?

Page 3: Introduction to the AWS Cloud from Digital Tuesday Meetup

A broad and deep platform that helps customers build sophisticated, scalable applications

What is Cloud Computing?

Page 4: Introduction to the AWS Cloud from Digital Tuesday Meetup

Why are companies adopting cloud computing and AWS so quickly?

Page 5: Introduction to the AWS Cloud from Digital Tuesday Meetup

The primary reason businesses are moving so quickly to AWS and the cloud

#1: Agility

Page 6: Introduction to the AWS Cloud from Digital Tuesday Meetup

Convert CAPEX to OPEX

Lower Total Cost

No Need to Guess Capacity

No Undifferentiated Heavy Lifting

Go Global in Minutes

Page 7: Introduction to the AWS Cloud from Digital Tuesday Meetup

Why does agility matter?

Page 8: Introduction to the AWS Cloud from Digital Tuesday Meetup

Hotels Music StorageMagazines

Page 9: Introduction to the AWS Cloud from Digital Tuesday Meetup

Old World: Infrastructure in

weeks

Enterprises Can’t Afford to Be Slow

Page 10: Introduction to the AWS Cloud from Digital Tuesday Meetup

A Culture of Innovation: Experiment Often & Fail Without Risk

Page 11: Introduction to the AWS Cloud from Digital Tuesday Meetup

Who is using AWS and what are they using it for?

Page 12: Introduction to the AWS Cloud from Digital Tuesday Meetup

Startups on AWS

http://aws.amazon.com/solutions/case-studies/

Page 13: Introduction to the AWS Cloud from Digital Tuesday Meetup
Page 14: Introduction to the AWS Cloud from Digital Tuesday Meetup

150,000people are hosted on any given night

Page 15: Introduction to the AWS Cloud from Digital Tuesday Meetup

Total Number of Guests

January 2013 4 Million

Sep 2008 Mar 2009 Sep 2013Sep 2009 Mar 2013Sep 2012Mar 2012Sep 2011Mar 2011Mar 2010 Sep 2010

3M

Mar 2014 Jun 2014

6M

9M

12M

15M

Page 16: Introduction to the AWS Cloud from Digital Tuesday Meetup

Sep 2008 Mar 2009 Sep 2013Sep 2009 Mar 2013Sep 2012Mar 2012Sep 2011Mar 2011Mar 2010 Sep 2010

June 2014 15 Million

Up by Over 10 Million in One YearTotal Number of Guests

3M

Mar 2014 Jun 2014

6M

9M

12M

15M

Page 17: Introduction to the AWS Cloud from Digital Tuesday Meetup

0

350

700

1,050

1,400

2010 2014

24 48

432

1,300

Total Number of EC2 instances

Page 18: Introduction to the AWS Cloud from Digital Tuesday Meetup

Why AWS?

Page 19: Introduction to the AWS Cloud from Digital Tuesday Meetup

We have a 5 person operations team.

AWS allows us to devote our resources and mindshare to the core business.

“”

Page 20: Introduction to the AWS Cloud from Digital Tuesday Meetup

Enterprises on AWS

http://aws.amazon.com/solutions/case-studies/

Page 21: Introduction to the AWS Cloud from Digital Tuesday Meetup

70% reduction inoperational costs

#1: Development and Testing

Do more dev and test work, faster

Sharepoint and SAP SAP

Reduced dev and test environment costs

Oracle

Page 22: Introduction to the AWS Cloud from Digital Tuesday Meetup

#2: New Workloads

Product prototyping & design

Audience management & creative design

Hotel booking engine

Biological data research

Global deals engine

Video streaming

SIM card credit News distribution

App streaming Firmware upgrades

Mobile gamesMobile musicdiscovery

Page 23: Introduction to the AWS Cloud from Digital Tuesday Meetup

Websites & Digital Transformation

Page 24: Introduction to the AWS Cloud from Digital Tuesday Meetup

Analytics

4 PB Amazon Redshift data warehouse

Analytics on 450k subscribers using Amazon Redshift

Financial market

analytics

Improved drug quality through big data

Ad campaign effectiveness analysis

platform

Trading history analytics

Financial Simulations Platform

Large scale clinical data

analytic platform

Page 25: Introduction to the AWS Cloud from Digital Tuesday Meetup

Mobile

Cloud-connected trucks

Mobile services and analytics Web and mobile site Apps for cabin crew staff

App Store Streaming video Mobile services & streaming

Enterprise video creation and sharing app

Page 26: Introduction to the AWS Cloud from Digital Tuesday Meetup

#3: Supplement Existing Workloads with the Cloud

Export operational data to Amazon Redshift for analysis

2X faster queries at 1/2 the cost

Analytics

Disaster recovery SSAE 16-compliant to restore all data

within 2 hours

Equipment leasing app

Operational applications

Export data to AWS for analytics processing

Page 27: Introduction to the AWS Cloud from Digital Tuesday Meetup

#4: Supplement Workloads with Existing On-premises Infrastructure

AWS serves up application content & data

Integration back to Samsung Data Centers for financial transactionsExisting systems

Page 28: Introduction to the AWS Cloud from Digital Tuesday Meetup

#5: Migrating Existing Applications

Migrated 500 web properties in 5 months

1,700 web properties

New product websites in 2 days vs. 2 weeks

Migrated clinical trials simulations platform

Simulations in 1.2hrs vs. 60hrs

64% reduction in costs

Page 29: Introduction to the AWS Cloud from Digital Tuesday Meetup

#6: Data Center Migration

From 40 data centers, down to 6

9X increase in AWS usage

APIs help govern usage and control cost

Enabling global collaboration

3,000 applications by January 2015

Page 30: Introduction to the AWS Cloud from Digital Tuesday Meetup

#7: All-in — IT Entirely in the Cloud

“We have to be great at a number of things…

operating data centers is not one of those things”

“We are a hospitality management organization, not

an IT services company”

2000 applications migrating to AWS in 18 months

Page 31: Introduction to the AWS Cloud from Digital Tuesday Meetup

What are AWS’s services and how do I use them to run my workloads?

Page 32: Introduction to the AWS Cloud from Digital Tuesday Meetup

Infrastructure Regions Availability Zones Points of Presence

Enterprise Applications Virtual Desktops Sharing & Collaboration

Core Services Storage(Object, Block and Archival)

Compute(VMs, Auto-scaling and Load Balancing)

Databases(Relational, NoSQL, Caching)

Networking(VPC, DX, DNS)

CDN

Access Control

Usage & Resource Tracking

Monitoring and Logs

Administration & Security

Key Storage & Management

IdentityManagement

Service Catalog

Platform Services

Deployment & ManagementOne-click web app deployment

Dev/ops resourcemanagement

Resource Templates

PushNotifications

Mobile Services

Identity

Sync

Mobile Analytics

App ServicesQueuing &Notifications

Workflow

App streaming

Transcoding

Email

Search

Analytics

Hadoop

Data warehouse

Data Pipelines

Real-timeStreaming Data

Code Deploy

Code Pipeline

Code Commit

Page 33: Introduction to the AWS Cloud from Digital Tuesday Meetup

11 regions 28 availability zones 51 edge locations

Infrastructure

Page 34: Introduction to the AWS Cloud from Digital Tuesday Meetup

Critical Certifications and Compliance Programs

https://aws.amazon.com/compliance/

Page 35: Introduction to the AWS Cloud from Digital Tuesday Meetup

P H Y S I C A LN E T W O R K

S Y S T E M

PEOPLE & PROCESS

Familiar security model Customer ecosystem Every customer benefitsPartner ecosystem

Comprehensive Security Capabilities, Validated by Experts

https://aws.amazon.com/security/

Page 36: Introduction to the AWS Cloud from Digital Tuesday Meetup

Compute

Compute(EC2 Instances, Auto-scaling and Load Balancing)

Page 37: Introduction to the AWS Cloud from Digital Tuesday Meetup

G2

GPU enabled

M3

General purpose

Memory optimized

R3

CR1M2

Storage and IO optimized

C3

Compute optimized

CC2C1

I2

HI1

HS1

CG1M1

Broad Set of Compute Instance Types…

Page 38: Introduction to the AWS Cloud from Digital Tuesday Meetup

New EC2 Instance Type: C4

2.9 GHz E5 v3 (Haswell) Up to 36 vCPUS

EBS-optimized by default, at no extra cost

Compute Optimized

Page 39: Introduction to the AWS Cloud from Digital Tuesday Meetup

Networking, Security & Access Control

Networking

VPCRoute 53Direct Connect

Security

IAMCloudTrailCloudHSM

Page 40: Introduction to the AWS Cloud from Digital Tuesday Meetup

Storage

Storage(Object, Block and Archive)

Page 41: Introduction to the AWS Cloud from Digital Tuesday Meetup

Highly durable and available cloud storage

Amazon S3

Page 42: Introduction to the AWS Cloud from Digital Tuesday Meetup

Extremely low-cost cloud archive storage service

Amazon Glacier

Page 43: Introduction to the AWS Cloud from Digital Tuesday Meetup

Persistent block level storage volumes for use with Amazon EC2 instances

Amazon EBS

Page 44: Introduction to the AWS Cloud from Digital Tuesday Meetup

New EBS Volumes

Up to 16TB 10,000 IOPS

Up to 160MBps

General Purpose (SSD)

Up to 16TB 20,000 IOPS

Up to 320 MBps

Provisioned IOPS (SSD)

Page 45: Introduction to the AWS Cloud from Digital Tuesday Meetup

DatabasesRelational

NoSQL

Caching

Page 46: Introduction to the AWS Cloud from Digital Tuesday Meetup

AWS Database Services

Amazon RDS

Amazon DynamoDB

Amazon Elasticache

Page 47: Introduction to the AWS Cloud from Digital Tuesday Meetup

Introducing Amazon AuroraCommercial-grade Database Engine at Open-source Cost

Page 48: Introduction to the AWS Cloud from Digital Tuesday Meetup

MySQL compatible

Available, durable and fault tolerant

5X better performance than standard MySQL

Highly scalable and secure

Available through Amazon RDS

Introducing Amazon AuroraCommercial-grade Database Engine at Open-source Cost

Page 49: Introduction to the AWS Cloud from Digital Tuesday Meetup

AnalyticsHadoop

Real-time

Data warehouse

Data workflows

Page 50: Introduction to the AWS Cloud from Digital Tuesday Meetup

App ServicesQueuing

Orchestration

App Streaming

Transcoding

Email

Search

Page 51: Introduction to the AWS Cloud from Digital Tuesday Meetup

Deployment & ManagementContainers

Dev/ops Tools

Resource Templates

Usage Tracking

Monitoring and Logs

Page 52: Introduction to the AWS Cloud from Digital Tuesday Meetup

Mobile ServicesIdentity

Sync

Mobile Analytics

Notifications

Page 53: Introduction to the AWS Cloud from Digital Tuesday Meetup

Amazon Cognito

Amazon Mobile Analytics

Amazon Mobile SDK

SNS Push Notifications

Hi!

AWS Mobile Services

Page 54: Introduction to the AWS Cloud from Digital Tuesday Meetup

Enterprise Applications

Virtual Desktops Collaboration and Sharing

Page 55: Introduction to the AWS Cloud from Digital Tuesday Meetup

Integration with On-premises Resources

Integrated networking

Integrated access control

Integrated cloud backups

Single pane of glass

# 192.168.1.10

# 192.168.1.11

Microsoft Active Directory

Custom LDAP

App 1AWS Storage

Gateway

Page 56: Introduction to the AWS Cloud from Digital Tuesday Meetup

Small, autonomous teams Roadmap ownership

Decoupled launch schedules

Get Core Functionality in the Hands of Customers, Quickly

Small, “Two Pizza” Teams

Operational stability High scale

Limited initial feature set

Iterate Based on Customer Feedback

Epic Collaboration+ =

Page 57: Introduction to the AWS Cloud from Digital Tuesday Meetup

2008 2009 2010 2011

Amazon EBSAmazon EC2

Amazon SNS

AWS Identity & Access Management

AWS Import& Export

Amazon CloudWatch

Amazon EMR

Amazon RDS

Amazon VPC

Auto Scaling

Elastic Load Balancing

Amazon ElastiCache

Amazon SES

AWS CloudFormation

AWS Direct ConnectAWS ElasticBeanstalk

GovCloud

Amazon SWF

Amazon Route 53

Amazon Redshift

Amazon Glacier

Amazon Dynamo DB

Amazon CloudSearch

Amazon EC2

AWS StorageGateway

Amazon CloudTrail

Amazon CloudHSM

Amazon WorkSpaces

Amazon Kinesis

Amazon ElasticTranscoder

Amazon AppStream

AWS OpsWorks

AWS Data Pipeline

Pace of Innovation at AWS

+24

+48

+61+82

+159

+280

20132012

Since inception AWS has:• Released 1111 new services and features • Introduced over 40 major new services• Announced 46 price reductions

+454

2014

Amazon MobileAnalytics

Amazon Cognito

AWS Zocalo

AWS DirectoryService

Amazon RDS for Aurora

AWS CodeDeploy

AWS Lambda

AWS Config

AWS Key Management Service

AWS Service Catalog

Amazon EC2Container Service

AWS CodePipeline

AWS CodeCommit

Page 58: Introduction to the AWS Cloud from Digital Tuesday Meetup

On-premises infrastructure

Upgrades are your responsibility

Every New Feature and Service Arrives Ready to Use

Upgrades happen automatically

Now available to all customers

Page 59: Introduction to the AWS Cloud from Digital Tuesday Meetup

AWS PRICING PHILOSOPHY

More AWS Usage

More Infrastructure

More Customers

Lower Infrastructure

Costs

Economies of Scale

Reduced PricesEcosystem

Global FootprintNew FeaturesNew Services

InfrastructureInnovation

46PRICE

REDUCTIONSWe pass the savings along to our

customers in the form of low prices and continuous reductions

Page 60: Introduction to the AWS Cloud from Digital Tuesday Meetup

Innovating in the Cloud

Page 61: Introduction to the AWS Cloud from Digital Tuesday Meetup
Page 62: Introduction to the AWS Cloud from Digital Tuesday Meetup
Page 63: Introduction to the AWS Cloud from Digital Tuesday Meetup
Page 64: Introduction to the AWS Cloud from Digital Tuesday Meetup
Page 65: Introduction to the AWS Cloud from Digital Tuesday Meetup
Page 66: Introduction to the AWS Cloud from Digital Tuesday Meetup

INNOVATION IS HARD

Page 67: Introduction to the AWS Cloud from Digital Tuesday Meetup

« If I had asked people what they wanted, they would have said faster horses. »

– Henry Ford

Page 68: Introduction to the AWS Cloud from Digital Tuesday Meetup

EXPERIMENT FREQUENTLY#1

Page 69: Introduction to the AWS Cloud from Digital Tuesday Meetup

« Want to increase innovation? Lower the cost of failure »

Joi Ito

Page 70: Introduction to the AWS Cloud from Digital Tuesday Meetup

[email protected]@caarlco

+ ELASTIC CAPACITY + NO CAPEX + PAY AS YOU GO+ AVAILABLE ON-DEMAND

= NO RISKS

Page 71: Introduction to the AWS Cloud from Digital Tuesday Meetup

[email protected]@caarlco

ON-PREMISES Experiment Infrequently Failure is expensive Less Innovation

Experiment Often Fail quickly at a low cost More Innovation

$ Millions Nearly $0

Page 72: Introduction to the AWS Cloud from Digital Tuesday Meetup

35+ SERVICES

Page 73: Introduction to the AWS Cloud from Digital Tuesday Meetup
Page 74: Introduction to the AWS Cloud from Digital Tuesday Meetup

AMAZON S3 SIMPLE STORAGE SERVICE

Page 75: Introduction to the AWS Cloud from Digital Tuesday Meetup
Page 76: Introduction to the AWS Cloud from Digital Tuesday Meetup
Page 77: Introduction to the AWS Cloud from Digital Tuesday Meetup

SPOTIFY ADDS 20,000 TRACKS/DAY TO ITS CATALOGUE

Page 78: Introduction to the AWS Cloud from Digital Tuesday Meetup

MEASURE, IMPROVE, AND ITERATE#2

Page 79: Introduction to the AWS Cloud from Digital Tuesday Meetup

« Failure is simply the opportunity to begin again, this time more intelligently. »

– Henry Ford

Page 80: Introduction to the AWS Cloud from Digital Tuesday Meetup
Page 81: Introduction to the AWS Cloud from Digital Tuesday Meetup

TEST ENVIRONMENTS

Page 82: Introduction to the AWS Cloud from Digital Tuesday Meetup

30,000 REQUESTS / SECOND1 TB TRAFFIC / DAY

CASE STUDY

Page 83: Introduction to the AWS Cloud from Digital Tuesday Meetup

A / B TESTING

Page 84: Introduction to the AWS Cloud from Digital Tuesday Meetup
Page 85: Introduction to the AWS Cloud from Digital Tuesday Meetup
Page 86: Introduction to the AWS Cloud from Digital Tuesday Meetup

[email protected]@caarlco

11.6s Mean time between

deployments (weekday)

1,079 Max number of

deployments in a single hour

10,000 Mean number of

hosts simultaneously

receiving a deployment

30,000 Max number of

hosts simultaneously

receiving a deployment

DEPLOYMENTS AT AMAZON.COM

Page 87: Introduction to the AWS Cloud from Digital Tuesday Meetup

DATA-DRIVEN ARCHITECTURES

Page 88: Introduction to the AWS Cloud from Digital Tuesday Meetup

METRICS @ETSY

Page 89: Introduction to the AWS Cloud from Digital Tuesday Meetup

FOCUS ON YOUR BUSINESS#3

Page 90: Introduction to the AWS Cloud from Digital Tuesday Meetup

ANY GIVEN NIGHT, 150,000 PEOPLE ARE HOSTED1000s OF SERVERS, TBs OF STORAGE5 PERSON OPERATIONS TEAM

Page 91: Introduction to the AWS Cloud from Digital Tuesday Meetup

INNOVATION IS NOT A GOAL, IT’S AN ONGOING PROCESS

Page 92: Introduction to the AWS Cloud from Digital Tuesday Meetup

What is the next step and how do I take it?

Page 93: Introduction to the AWS Cloud from Digital Tuesday Meetup

AWS Free Tier

To help you get started with the AWS Cloud, the AWS Free Tier allows you to gain hands-on experience with a broad selection of AWS

products and services.

http://aws.amazon.com/free/

Page 94: Introduction to the AWS Cloud from Digital Tuesday Meetup

AWS Free Tier

To help you get started with the AWS Cloud, the AWS Free Tier allows you to gain hands-on experience with a broad selection of AWS

products and services.

Page 95: Introduction to the AWS Cloud from Digital Tuesday Meetup

Design your application for the AWS cloud

For more, visit the AWS Architecture Center : http://aws.amazon.com/architecture/

Page 96: Introduction to the AWS Cloud from Digital Tuesday Meetup

System Integrators on AWS

Page 97: Introduction to the AWS Cloud from Digital Tuesday Meetup

ISVs on AWS

Page 98: Introduction to the AWS Cloud from Digital Tuesday Meetup

AWS Training & Certification

aws.amazon.com/certification

Demonstrate your skills, knowledge, and expertise

with the AWS platform

aws.amazon.com/training/self-paced-labs

Try products, gain new skills, and get hands-on

practice working with AWS technologies

aws.amazon.com/training

Skill up and gain confidence to design, develop, deploy

and manage your applications on AWS

Page 99: Introduction to the AWS Cloud from Digital Tuesday Meetup

@IanMmmm

Ian Massingham — Technical Evangelist

@AWScloudAWS Global News and Service Launches

@AWS_UKIAWS UK & Ireland News, Events & Webinars

FOLLO

W U

S FO

R M

ORE

EVENTS &

WEBIN

ARS