Intro to Amazon Web Services at Edinburgh Startup Event

74
An Introduction to AWS [email protected] @IanMmmm Ian Massingham Technical Evangelist

description

In this talk from the AWS Startup Event in Edinburgh, AWS Technical Evangelist Ian Massingham introduces the AWS cloud and the fundamental benefits and characteristics of cloud computing. He also talks about the strong alignment between the capabilities of the AWS platform and the activities that successful startups focus on; continual experimentation, measurement and iteration and focus on their core business.

Transcript of Intro to Amazon Web Services at Edinburgh Startup Event

Page 1: Intro to Amazon Web Services at Edinburgh Startup Event

An Introduction to AWS

[email protected]

@IanMmmm

Ian Massingham Technical Evangelist

Page 2: Intro to Amazon Web Services at Edinburgh Startup Event

Why are organisations using the Cloud?

Page 3: Intro to Amazon Web Services at Edinburgh Startup Event

The primary reason businesses are moving so quickly to AWS and the cloud

#1: Agility

Page 4: Intro to Amazon Web Services at Edinburgh Startup Event

Why does agility matter?

Page 5: Intro to Amazon Web Services at Edinburgh Startup Event

Hotels Music StorageMagazines

Page 6: Intro to Amazon Web Services at Edinburgh Startup Event

Old World: Infrastructure in

weeks

Enterprises Can’t Afford to Be Slow

Page 7: Intro to Amazon Web Services at Edinburgh Startup Event

A Culture of Innovation: Experiment Often & Fail Without Risk

Page 8: Intro to Amazon Web Services at Edinburgh Startup Event

A broad and deep platform helps customersbuild sophisticated, scalable applications

#2: Platform Breadth

Page 9: Intro to Amazon Web Services at Edinburgh Startup Event

Infrastructure Regions Availability Zones Points of Presence

Enterprise Applications Virtual Desktops Sharing & Collaboration

Core Services Storage(Object, Block and Archival)

Compute(VMs, Auto-scaling and Load Balancing)

Databases(Relational, NoSQL, Caching)

Networking(VPC, DX, DNS)

CDN

Access Control

Usage & Resource Tracking

Monitoring and Logs

Administration & Security

Key Storage & Management

IdentityManagement

Service Catalog

Platform Services

Deployment & ManagementOne-click web app deployment

Dev/ops resourcemanagement

Resource Templates

PushNotifications

Mobile Services

Identity

Sync

Mobile Analytics

App ServicesQueuing &Notifications

Workflow

App streaming

Transcoding

Email

Search

Analytics

Hadoop

Data warehouse

Data Pipelines

Real-timeStreaming Data

Code Deploy

Code Pipeline

Code Commit

Page 10: Intro to Amazon Web Services at Edinburgh Startup Event

#3: Continual Iteration and Innovation

AWS continuously upgrades infrastructure, so you don’t have to

Page 11: Intro to Amazon Web Services at Edinburgh Startup Event

Small, autonomous teams Roadmap ownership

Decoupled launch schedules

Get Core Functionality in the Hands of Customers, Quickly

Small, “Two Pizza” Teams

Operational stability High scale

Limited initial feature set

Iterate Based on Customer Feedback

Epic Collaboration+ =

Page 12: Intro to Amazon Web Services at Edinburgh Startup Event

2008 2009 2010 2011

Amazon EBSAmazon EC2

Amazon SNS

AWS Identity & Access Management

AWS Import& Export

Amazon CloudWatch

Amazon EMR

Amazon RDS

Amazon VPC

Auto Scaling

Elastic Load Balancing

Amazon ElastiCache

Amazon SES

AWS CloudFormation

AWS Direct ConnectAWS ElasticBeanstalk

GovCloud

Amazon SWF

Amazon Route 53

Amazon Redshift

Amazon Glacier

Amazon Dynamo DB

Amazon CloudSearch

Amazon EC2

AWS StorageGateway

Amazon CloudTrail

Amazon CloudHSM

Amazon WorkSpaces

Amazon Kinesis

Amazon ElasticTranscoder

Amazon AppStream

AWS OpsWorks

AWS Data Pipeline

Pace of Innovation at AWS

+24

+48

+61+82

+159

+280

20132012

Since inception AWS has:• Released 1111 new services and features • Introduced over 40 major new services• Announced 46 price reductions

+454

2014

Amazon MobileAnalytics

Amazon Cognito

AWS Zocalo

AWS DirectoryService

Amazon RDS for Aurora

AWS CodeDeploy

AWS Lambda

AWS Config

AWS Key Management Service

AWS Service Catalog

Amazon EC2Container Service

AWS CodePipeline

AWS CodeCommit

Page 13: Intro to Amazon Web Services at Edinburgh Startup Event

Trade Capex for variable expense

1

Pricing model choice to support variable & stable

workloads

On-demandReserved

Spot

3

Save more money as you grow bigger

Tiered pricingVolume

discountsCustom pricing

4Economies-of-scale provide lower costs than companies can

do on their own

2

46 price reductions since 2006

#4: Cost Savings and Flexibility

Page 14: Intro to Amazon Web Services at Edinburgh Startup Event

AWS PRICING PHILOSOPHY

More AWS Usage

More Infrastructure

More Customers

Lower Infrastructure

Costs

Economies of Scale

Reduced Prices

EcosystemGlobal FootprintNew FeaturesNew Services

InfrastructureInnovation

46PRICE REDUCTIONS

We pass the savings along to our customers in the form of low

prices and continuous reductions

Page 15: Intro to Amazon Web Services at Edinburgh Startup Event

Who is using AWS and what are the benefits?

Page 16: Intro to Amazon Web Services at Edinburgh Startup Event

Startups on AWS

http://aws.amazon.com/solutions/case-studies/

Page 17: Intro to Amazon Web Services at Edinburgh Startup Event
Page 18: Intro to Amazon Web Services at Edinburgh Startup Event

150,000people are hosted on any given night

Page 19: Intro to Amazon Web Services at Edinburgh Startup Event

Total Number of Guests

January 2013 4 Million

Sep 2008 Mar 2009 Sep 2013Sep 2009 Mar 2013Sep 2012Mar 2012Sep 2011Mar 2011Mar 2010 Sep 2010

3M

Mar 2014 Jun 2014

6M

9M

12M

15M

Page 20: Intro to Amazon Web Services at Edinburgh Startup Event

Total Number of Guests

Sep 2008 Mar 2009 Sep 2013Sep 2009 Mar 2013Sep 2012Mar 2012Sep 2011Mar 2011Mar 2010 Sep 2010

June 2014 15 Million

Up by Over 10 Million in One Year

3M

Mar 2014 Jun 2014

6M

9M

12M

15M

Page 21: Intro to Amazon Web Services at Edinburgh Startup Event

Total Number of EC2 instances

0

350

700

1,050

1,400

2010 2014

24 48

432

1,300

Page 22: Intro to Amazon Web Services at Edinburgh Startup Event

Why AWS?

Page 23: Intro to Amazon Web Services at Edinburgh Startup Event

We have a 5 person operations team.

AWS allows us to devote our resources and mindshare to the core business.

“”

Page 24: Intro to Amazon Web Services at Edinburgh Startup Event

Enterprises on AWS

http://aws.amazon.com/solutions/case-studies/

Page 25: Intro to Amazon Web Services at Edinburgh Startup Event

Innovating in the Cloud

Page 26: Intro to Amazon Web Services at Edinburgh Startup Event
Page 27: Intro to Amazon Web Services at Edinburgh Startup Event
Page 28: Intro to Amazon Web Services at Edinburgh Startup Event
Page 29: Intro to Amazon Web Services at Edinburgh Startup Event
Page 30: Intro to Amazon Web Services at Edinburgh Startup Event
Page 31: Intro to Amazon Web Services at Edinburgh Startup Event

INNOVATION IS HARD

Page 32: Intro to Amazon Web Services at Edinburgh Startup Event

« If I had asked people what they wanted, they would have said faster horses. »

– Henry Ford

Page 33: Intro to Amazon Web Services at Edinburgh Startup Event

EXPERIMENT FREQUENTLY#1

Page 34: Intro to Amazon Web Services at Edinburgh Startup Event

« Want to increase innovation? Lower the cost of failure »

Joi Ito

Page 35: Intro to Amazon Web Services at Edinburgh Startup Event

[email protected]@caarlco

+ ELASTIC CAPACITY + NO CAPEX + PAY AS YOU GO+ AVAILABLE ON-DEMAND

= NO RISKS

Page 36: Intro to Amazon Web Services at Edinburgh Startup Event

[email protected]@caarlco

ON-PREMISES

Experiment Infrequently Failure is expensive Less Innovation

Experiment Often Fail quickly at a low cost More Innovation

$ Millions Nearly $0

Page 37: Intro to Amazon Web Services at Edinburgh Startup Event

35+ SERVICES

Page 38: Intro to Amazon Web Services at Edinburgh Startup Event
Page 39: Intro to Amazon Web Services at Edinburgh Startup Event

AMAZON S3 SIMPLE STORAGE SERVICE

Page 40: Intro to Amazon Web Services at Edinburgh Startup Event
Page 41: Intro to Amazon Web Services at Edinburgh Startup Event
Page 42: Intro to Amazon Web Services at Edinburgh Startup Event

SPOTIFY ADDS 20,000 TRACKS/DAY TO ITS CATALOGUE

Page 43: Intro to Amazon Web Services at Edinburgh Startup Event

MEASURE, IMPROVE, AND ITERATE#2

Page 44: Intro to Amazon Web Services at Edinburgh Startup Event

« Failure is simply the opportunity to begin again, this time more intelligently. »

– Henry Ford

Page 45: Intro to Amazon Web Services at Edinburgh Startup Event
Page 46: Intro to Amazon Web Services at Edinburgh Startup Event

TEST ENVIRONMENTS

Page 47: Intro to Amazon Web Services at Edinburgh Startup Event

30,000 REQUESTS / SECOND1 TB TRAFFIC / DAY

CASE STUDY

Page 48: Intro to Amazon Web Services at Edinburgh Startup Event

“…AWS  seemed  to  be  the  best  solution  available  to  allow  a  small,  independent  company  to  rapidly  develop  and  test  a  completely  new  infrastructure,  

and  host  it.

 We  also  loved  the  flexibility  that  AWS  allowed  us,  when  spinning  up  smaller  test  environments,  for  

beta  trials,  QA,  localization,  and  during  development.  The  low  initial  cost  was  also  crucial.”

Alex  Evans,  CTO  

Page 49: Intro to Amazon Web Services at Edinburgh Startup Event

A / B TESTING

Page 50: Intro to Amazon Web Services at Edinburgh Startup Event
Page 51: Intro to Amazon Web Services at Edinburgh Startup Event
Page 52: Intro to Amazon Web Services at Edinburgh Startup Event

[email protected]@caarlco

11.6s Mean time between

deployments (weekday)

1,079 Max number of

deployments in a single hour

10,000 Mean number of

hosts simultaneously

receiving a deployment

30,000 Max number of

hosts simultaneously

receiving a deployment

DEPLOYMENTS AT AMAZON.COM

Page 53: Intro to Amazon Web Services at Edinburgh Startup Event

DATA-DRIVEN ARCHITECTURES

Page 54: Intro to Amazon Web Services at Edinburgh Startup Event

METRICS @ETSY

Page 55: Intro to Amazon Web Services at Edinburgh Startup Event

FOCUS ON YOUR BUSINESS#3

Page 56: Intro to Amazon Web Services at Edinburgh Startup Event

ANY GIVEN NIGHT, 150,000 PEOPLE ARE HOSTED1000s OF SERVERS, TBs OF STORAGE5 PERSON OPERATIONS TEAM

Page 57: Intro to Amazon Web Services at Edinburgh Startup Event

INNOVATION IS NOT A GOAL, IT’S AN ONGOING PROCESS

Page 58: Intro to Amazon Web Services at Edinburgh Startup Event

« I haven’t failed, I’ve just found 10,000 ways that won’t work. »

– Thomas Edison

Page 59: Intro to Amazon Web Services at Edinburgh Startup Event

How can I use AWS services to develop, deploy and scale my applications?

Page 60: Intro to Amazon Web Services at Edinburgh Startup Event

Infrastructure Regions Availability Zones Points of Presence

Enterprise Applications Virtual Desktops Sharing & Collaboration

Core Services Storage(Object, Block and Archival)

Compute(VMs, Auto-scaling and Load Balancing)

Databases(Relational, NoSQL, Caching)

Networking(VPC, DX, DNS)

CDN

Access Control

Usage  &  Resource  Tracking

Monitoring  and  Logs

Administration & Security

Key  Storage  &  Management

Identity  Management

Service  Catalog

Platform Services

Deployment & Management

One-­‐click  web  app    deployment

Dev/ops  resource  management

Resource  Templates

Push  Notifications

Mobile Services

Identity

Sync

Mobile  Analytics

App Services

Queuing  &  Notifications

Workflow

App  streaming

Transcoding

Email

Search

Analytics

Hadoop

Data  warehouse

Data  Pipelines

Real-­‐time  Streaming  Data

Code  Deploy

Code  Pipeline

Code  Commit

Page 61: Intro to Amazon Web Services at Edinburgh Startup Event

11 regions 28 availability zones 51 edge locations

Infrastructure

Page 62: Intro to Amazon Web Services at Edinburgh Startup Event

P H Y S I C A LN E T W O R K

S Y S T E M

PEOPLE & PROCESS

Familiar security model Customer ecosystem Every customer benefitsPartner ecosystem

Comprehensive Security Capabilities, Validated by Experts

https://aws.amazon.com/security/

Page 63: Intro to Amazon Web Services at Edinburgh Startup Event

Compute

Compute(EC2 Instances, Auto-scaling and Load Balancing)

Page 64: Intro to Amazon Web Services at Edinburgh Startup Event

New EC2 Instance Type: C4

2.9 GHz E5 v3 (Haswell) Up to 36 vCPUS

EBS-optimized by default, at no extra cost

Compute Optimized

Page 65: Intro to Amazon Web Services at Edinburgh Startup Event

Networking, Security & Access Control

Networking

VPCRoute 53Direct Connect

Security

IAMCloudTrailCloudHSM

Page 66: Intro to Amazon Web Services at Edinburgh Startup Event

Storage

Storage(Object, Block and Archive)

Page 67: Intro to Amazon Web Services at Edinburgh Startup Event

New EBS Volumes

Up to 16TB 10,000 IOPS

Up to 160MBps

General Purpose (SSD)

Up to 16TB 20,000 IOPS

Up to 320 MBps

Provisioned IOPS (SSD)

Page 68: Intro to Amazon Web Services at Edinburgh Startup Event

DatabasesRelational

NoSQL

Caching

Page 69: Intro to Amazon Web Services at Edinburgh Startup Event

AnalyticsHadoop

Real-time

Data warehouse

Data workflows

Page 70: Intro to Amazon Web Services at Edinburgh Startup Event

App ServicesQueuing

Orchestration

App Streaming

Transcoding

Email

Search

Page 71: Intro to Amazon Web Services at Edinburgh Startup Event

Deployment & ManagementContainers

Dev/ops Tools

Resource Templates

Usage Tracking

Monitoring and Logs

Page 72: Intro to Amazon Web Services at Edinburgh Startup Event

Mobile ServicesIdentity

Sync

Mobile Analytics

Notifications

Page 73: Intro to Amazon Web Services at Edinburgh Startup Event

Amazon Cognito

Amazon Mobile Analytics

Amazon Mobile SDK

SNS Push Notifications

Hi!

AWS Mobile Services

Page 74: Intro to Amazon Web Services at Edinburgh Startup Event

THANK YOU

[email protected]

@IanMmmm

Ian Massingham Technical Evangelist