AWS 101 Lunch & Learn March 2013
-
Upload
amazon-web-services -
Category
Technology
-
view
1.776 -
download
0
description
Transcript of AWS 101 Lunch & Learn March 2013
![Page 1: AWS 101 Lunch & Learn March 2013](https://reader033.fdocuments.us/reader033/viewer/2022050920/54b4c2734a7959217c8b46b7/html5/thumbnails/1.jpg)
AWS 101
Ryan Shuttleworth Technical Evangelist
@ryanAWS
Lunch & Learn
![Page 2: AWS 101 Lunch & Learn March 2013](https://reader033.fdocuments.us/reader033/viewer/2022050920/54b4c2734a7959217c8b46b7/html5/thumbnails/2.jpg)
Agenda
12:00 - 12:45 Presentation – AWS 101 Introducing the concepts behind AWS such as utility computing and elasticity
12:45 - 13:00 Working lunch 13:00 - 14:00 Presentation and Demonstration
Live demonstration and interactive walkthrough
![Page 3: AWS 101 Lunch & Learn March 2013](https://reader033.fdocuments.us/reader033/viewer/2022050920/54b4c2734a7959217c8b46b7/html5/thumbnails/3.jpg)
What we are going to cover
Keypairs
Security groups
EC2 instances
Metadata service
Autoscaling
Amazon Machine Images
S3
CloudFront
Elastic Load balancer
RDS
Feel free to follow along on your laptops
![Page 4: AWS 101 Lunch & Learn March 2013](https://reader033.fdocuments.us/reader033/viewer/2022050920/54b4c2734a7959217c8b46b7/html5/thumbnails/4.jpg)
background
![Page 5: AWS 101 Lunch & Learn March 2013](https://reader033.fdocuments.us/reader033/viewer/2022050920/54b4c2734a7959217c8b46b7/html5/thumbnails/5.jpg)
Consumer
Business
Tens of millions of
active customer
accounts
Eight countries:
US, UK, Germany,
Japan, France,
Canada, China, Italy
Seller
Business
Sell on Amazon
websites
Use Amazon
technology for your
own retail website
Leverage Amazon’s
massive fulfillment
center network
IT Infrastructure
Business
Cloud computing
infrastructure for
hosting web-scale
solutions
Hundreds of
thousands of
registered
customers in over
190 countries
![Page 6: AWS 101 Lunch & Learn March 2013](https://reader033.fdocuments.us/reader033/viewer/2022050920/54b4c2734a7959217c8b46b7/html5/thumbnails/6.jpg)
Deep experience in
building and
operating global web
scale systems
About Amazon
Web Services
?
…get into cloud computing?
How did Amazon…
![Page 7: AWS 101 Lunch & Learn March 2013](https://reader033.fdocuments.us/reader033/viewer/2022050920/54b4c2734a7959217c8b46b7/html5/thumbnails/7.jpg)
Over 10 years in the making
Enablement of sellers on Amazon
Internal need for scalable deployment environment
Early forays proved developers were hungry for more
![Page 8: AWS 101 Lunch & Learn March 2013](https://reader033.fdocuments.us/reader033/viewer/2022050920/54b4c2734a7959217c8b46b7/html5/thumbnails/8.jpg)
AWS Mission
Enable businesses and
developers to use web
services* to build scalable,
sophisticated applications.
*What people now call “the cloud”
![Page 9: AWS 101 Lunch & Learn March 2013](https://reader033.fdocuments.us/reader033/viewer/2022050920/54b4c2734a7959217c8b46b7/html5/thumbnails/9.jpg)
![Page 10: AWS 101 Lunch & Learn March 2013](https://reader033.fdocuments.us/reader033/viewer/2022050920/54b4c2734a7959217c8b46b7/html5/thumbnails/10.jpg)
Not excess capacity!
![Page 11: AWS 101 Lunch & Learn March 2013](https://reader033.fdocuments.us/reader033/viewer/2022050920/54b4c2734a7959217c8b46b7/html5/thumbnails/11.jpg)
![Page 12: AWS 101 Lunch & Learn March 2013](https://reader033.fdocuments.us/reader033/viewer/2022050920/54b4c2734a7959217c8b46b7/html5/thumbnails/12.jpg)
Each day AWS adds the equivalent server
capacity to power Amazon when it was a
global, $5B enterprise
![Page 13: AWS 101 Lunch & Learn March 2013](https://reader033.fdocuments.us/reader033/viewer/2022050920/54b4c2734a7959217c8b46b7/html5/thumbnails/13.jpg)
Each day AWS adds the equivalent server
capacity to power Amazon when it was a
global, $5B enterprise
$5.2B retail business
7,800 employees
A whole lot of servers
2003
![Page 14: AWS 101 Lunch & Learn March 2013](https://reader033.fdocuments.us/reader033/viewer/2022050920/54b4c2734a7959217c8b46b7/html5/thumbnails/14.jpg)
1.3 Trillion
835k peak transactions per second
Objects in S3
![Page 15: AWS 101 Lunch & Learn March 2013](https://reader033.fdocuments.us/reader033/viewer/2022050920/54b4c2734a7959217c8b46b7/html5/thumbnails/15.jpg)
EMR Jobs
0
500,000
1,000,000
1,500,000
2,000,000
2,500,000
3,000,000
3,500,000
4,000,000
3.7 M clusters
launched since May 2010
![Page 16: AWS 101 Lunch & Learn March 2013](https://reader033.fdocuments.us/reader033/viewer/2022050920/54b4c2734a7959217c8b46b7/html5/thumbnails/16.jpg)
Utility computing
![Page 17: AWS 101 Lunch & Learn March 2013](https://reader033.fdocuments.us/reader033/viewer/2022050920/54b4c2734a7959217c8b46b7/html5/thumbnails/17.jpg)
On demand Pay as you go
Uniform Available
Utility computing
![Page 18: AWS 101 Lunch & Learn March 2013](https://reader033.fdocuments.us/reader033/viewer/2022050920/54b4c2734a7959217c8b46b7/html5/thumbnails/18.jpg)
Utility computing
On demand Pay as you go
Uniform Available
![Page 19: AWS 101 Lunch & Learn March 2013](https://reader033.fdocuments.us/reader033/viewer/2022050920/54b4c2734a7959217c8b46b7/html5/thumbnails/19.jpg)
Utility computing
![Page 20: AWS 101 Lunch & Learn March 2013](https://reader033.fdocuments.us/reader033/viewer/2022050920/54b4c2734a7959217c8b46b7/html5/thumbnails/20.jpg)
Utility computing
Compute
Storage
Security Scaling
Database
Networking Monitoring
Messaging
Workflow
DNS
Load Balancing
Backup CDN
On demand Pay as you go
Uniform Available
![Page 21: AWS 101 Lunch & Learn March 2013](https://reader033.fdocuments.us/reader033/viewer/2022050920/54b4c2734a7959217c8b46b7/html5/thumbnails/21.jpg)
On a global footprint
Region
US-WEST (N. California) EU-WEST (Ireland)
ASIA PAC
(Tokyo)
ASIA PAC
(Singapore)
US-WEST (Oregon)
SOUTH AMERICA (Sao
Paulo)
US-EAST (Virginia)
GOV CLOUD
ASIA PAC
(Sydney)
![Page 22: AWS 101 Lunch & Learn March 2013](https://reader033.fdocuments.us/reader033/viewer/2022050920/54b4c2734a7959217c8b46b7/html5/thumbnails/22.jpg)
Availability Zone
On a global footprint
![Page 23: AWS 101 Lunch & Learn March 2013](https://reader033.fdocuments.us/reader033/viewer/2022050920/54b4c2734a7959217c8b46b7/html5/thumbnails/23.jpg)
Edge Locations
Dallas(2)
St.Louis
Miami
Jacksonville Los Angeles (2)
Palo Alto
Seattle
Ashburn(2)
Newark
New York (3)
Dublin
London(2)
Amsterdam (2)
Stockholm
Frankfurt(2)
Paris(2)
Singapore(2)
Hong Kong
Tokyo (2)
Sao Paulo
South Bend
San Jose
Osaka Milan
Sydney
On a global footprint
Madrid
![Page 24: AWS 101 Lunch & Learn March 2013](https://reader033.fdocuments.us/reader033/viewer/2022050920/54b4c2734a7959217c8b46b7/html5/thumbnails/24.jpg)
At the end of a web service
ec2-run-instances ami-b232d0db
--instance-count 3
--availability-zone eu-west-1a
--instance-type m1.small
ec2-run-instances ami-b232d0db
--instance-count 5
--availability-zone eu-west-1c
--instance-type m1.medium
![Page 25: AWS 101 Lunch & Learn March 2013](https://reader033.fdocuments.us/reader033/viewer/2022050920/54b4c2734a7959217c8b46b7/html5/thumbnails/25.jpg)
ec2-run-instances ami-b232d0db
--instance-count 2
--availability-zone us-east-1b
--instance-type m1.xlarge
ec2-run-instances ami-b232d0db
--instance-count 2
--availability-zone us-east-1d
--instance-type m1.xlarge
At the end of a web service
![Page 26: AWS 101 Lunch & Learn March 2013](https://reader033.fdocuments.us/reader033/viewer/2022050920/54b4c2734a7959217c8b46b7/html5/thumbnails/26.jpg)
At the end of a web service
elb-create-lb
myLoadBalancer
as-create-auto-scaling-group MyGroup
--launch-configuration MyConfig
--availability-zones eu-west-1c
--min-size 2
--max-size 200
ec2-authorize default -p 80
![Page 27: AWS 101 Lunch & Learn March 2013](https://reader033.fdocuments.us/reader033/viewer/2022050920/54b4c2734a7959217c8b46b7/html5/thumbnails/27.jpg)
and rich console services
![Page 28: AWS 101 Lunch & Learn March 2013](https://reader033.fdocuments.us/reader033/viewer/2022050920/54b4c2734a7959217c8b46b7/html5/thumbnails/28.jpg)
Elasticity
![Page 29: AWS 101 Lunch & Learn March 2013](https://reader033.fdocuments.us/reader033/viewer/2022050920/54b4c2734a7959217c8b46b7/html5/thumbnails/29.jpg)
Traditional IT
capacity
Elastic capacity
Capacity
Time
Your IT needs
![Page 30: AWS 101 Lunch & Learn March 2013](https://reader033.fdocuments.us/reader033/viewer/2022050920/54b4c2734a7959217c8b46b7/html5/thumbnails/30.jpg)
On and Off Fast Growth
Variable peaks Predictable peaks
Elastic capacity
![Page 31: AWS 101 Lunch & Learn March 2013](https://reader033.fdocuments.us/reader033/viewer/2022050920/54b4c2734a7959217c8b46b7/html5/thumbnails/31.jpg)
Elastic capacity
On and Off Fast Growth
Predictable peaks Variable peaks
WASTE
CUSTOMER DISSATISFACTION
![Page 32: AWS 101 Lunch & Learn March 2013](https://reader033.fdocuments.us/reader033/viewer/2022050920/54b4c2734a7959217c8b46b7/html5/thumbnails/32.jpg)
Elastic cloud capacity
Traditional
IT capacity
Your IT needs
Time
Capacity
Elastic capacity
![Page 33: AWS 101 Lunch & Learn March 2013](https://reader033.fdocuments.us/reader033/viewer/2022050920/54b4c2734a7959217c8b46b7/html5/thumbnails/33.jpg)
Elastic capacity
Fast Growth On and Off
Predictable peaks Variable peaks
![Page 34: AWS 101 Lunch & Learn March 2013](https://reader033.fdocuments.us/reader033/viewer/2022050920/54b4c2734a7959217c8b46b7/html5/thumbnails/34.jpg)
503 Service Temporarily Unavailable
The server is temporarily unable
to service your request due to
maintenance downtime or capacity
problems. Please try again later.
![Page 35: AWS 101 Lunch & Learn March 2013](https://reader033.fdocuments.us/reader033/viewer/2022050920/54b4c2734a7959217c8b46b7/html5/thumbnails/35.jpg)
503 Service Temporarily Unavailable
The server is temporarily unable
to service your request due to
maintenance downtime or capacity
problems. Please try again later.
![Page 36: AWS 101 Lunch & Learn March 2013](https://reader033.fdocuments.us/reader033/viewer/2022050920/54b4c2734a7959217c8b46b7/html5/thumbnails/36.jpg)
From one instance…
![Page 37: AWS 101 Lunch & Learn March 2013](https://reader033.fdocuments.us/reader033/viewer/2022050920/54b4c2734a7959217c8b46b7/html5/thumbnails/37.jpg)
…to thousands
![Page 38: AWS 101 Lunch & Learn March 2013](https://reader033.fdocuments.us/reader033/viewer/2022050920/54b4c2734a7959217c8b46b7/html5/thumbnails/38.jpg)
and back…
![Page 39: AWS 101 Lunch & Learn March 2013](https://reader033.fdocuments.us/reader033/viewer/2022050920/54b4c2734a7959217c8b46b7/html5/thumbnails/39.jpg)
Amazon.com elasticity
![Page 40: AWS 101 Lunch & Learn March 2013](https://reader033.fdocuments.us/reader033/viewer/2022050920/54b4c2734a7959217c8b46b7/html5/thumbnails/40.jpg)
Sunday Monday Tuesday Wednesday Thursday Friday Saturday
Typical weekly traffic to Amazon.com
![Page 41: AWS 101 Lunch & Learn March 2013](https://reader033.fdocuments.us/reader033/viewer/2022050920/54b4c2734a7959217c8b46b7/html5/thumbnails/41.jpg)
November traffic to Amazon.com
November
![Page 42: AWS 101 Lunch & Learn March 2013](https://reader033.fdocuments.us/reader033/viewer/2022050920/54b4c2734a7959217c8b46b7/html5/thumbnails/42.jpg)
November traffic to Amazon.com
Provisioned capacity
November
![Page 43: AWS 101 Lunch & Learn March 2013](https://reader033.fdocuments.us/reader033/viewer/2022050920/54b4c2734a7959217c8b46b7/html5/thumbnails/43.jpg)
November traffic to Amazon.com 76%
24%
Provisioned capacity
November
![Page 44: AWS 101 Lunch & Learn March 2013](https://reader033.fdocuments.us/reader033/viewer/2022050920/54b4c2734a7959217c8b46b7/html5/thumbnails/44.jpg)
November 10th 2010 Turned off last physical web server of
Amazon.com
![Page 45: AWS 101 Lunch & Learn March 2013](https://reader033.fdocuments.us/reader033/viewer/2022050920/54b4c2734a7959217c8b46b7/html5/thumbnails/45.jpg)
November 10th 2010 Turned off last physical web server of
Amazon.com
October 31st 2011 Turned off last web servers supporting
European business
![Page 46: AWS 101 Lunch & Learn March 2013](https://reader033.fdocuments.us/reader033/viewer/2022050920/54b4c2734a7959217c8b46b7/html5/thumbnails/46.jpg)
November traffic to Amazon.com
November
![Page 47: AWS 101 Lunch & Learn March 2013](https://reader033.fdocuments.us/reader033/viewer/2022050920/54b4c2734a7959217c8b46b7/html5/thumbnails/47.jpg)
Time: +00h
<10 cores
Elastic Capacity
![Page 48: AWS 101 Lunch & Learn March 2013](https://reader033.fdocuments.us/reader033/viewer/2022050920/54b4c2734a7959217c8b46b7/html5/thumbnails/48.jpg)
Time: +24h >1500
cores
Elastic Capacity
![Page 49: AWS 101 Lunch & Learn March 2013](https://reader033.fdocuments.us/reader033/viewer/2022050920/54b4c2734a7959217c8b46b7/html5/thumbnails/49.jpg)
Time: +72h
<10 cores
Elastic Capacity
![Page 50: AWS 101 Lunch & Learn March 2013](https://reader033.fdocuments.us/reader033/viewer/2022050920/54b4c2734a7959217c8b46b7/html5/thumbnails/50.jpg)
Time: +120h
>600 cores
Elastic Capacity
![Page 51: AWS 101 Lunch & Learn March 2013](https://reader033.fdocuments.us/reader033/viewer/2022050920/54b4c2734a7959217c8b46b7/html5/thumbnails/51.jpg)
Num
ber
of E
C2 I
nsta
nces
4/12/2008 4/14/2008 4/15/2008 4/16/2008 4/18/2008 4/19/2008 4/20/2008 4/17/2008 4/13/2008
40 servers to 5000 in 3 days
EC2 scaled to peak of 5000 instances
“Techcrunched”
Launch of Facebook modification
Steady state of ~40 instances
![Page 52: AWS 101 Lunch & Learn March 2013](https://reader033.fdocuments.us/reader033/viewer/2022050920/54b4c2734a7959217c8b46b7/html5/thumbnails/52.jpg)
The Toolbox
![Page 53: AWS 101 Lunch & Learn March 2013](https://reader033.fdocuments.us/reader033/viewer/2022050920/54b4c2734a7959217c8b46b7/html5/thumbnails/53.jpg)
Compute Storage
AWS Global Infrastructure
Database
App Services
Deployment & Administration
Networking
Reference Model
security
![Page 54: AWS 101 Lunch & Learn March 2013](https://reader033.fdocuments.us/reader033/viewer/2022050920/54b4c2734a7959217c8b46b7/html5/thumbnails/54.jpg)
Compute Storage
AWS Global Infrastructure
Database
App Services
Deployment & Administration
Networking
Global infrastructure
Regions An independent collection of AWS resources in a
defined geography
A solid foundation for meeting location-dependent
privacy and compliance requirements
![Page 55: AWS 101 Lunch & Learn March 2013](https://reader033.fdocuments.us/reader033/viewer/2022050920/54b4c2734a7959217c8b46b7/html5/thumbnails/55.jpg)
Compute Storage
AWS Global Infrastructure
Database
App Services
Deployment & Administration
Networking
Global infrastructure
Availability Zones Designed as independent failure zones
Physically separated within a typical metropolitan
region
![Page 56: AWS 101 Lunch & Learn March 2013](https://reader033.fdocuments.us/reader033/viewer/2022050920/54b4c2734a7959217c8b46b7/html5/thumbnails/56.jpg)
Compute Storage
AWS Global Infrastructure
Database
App Services
Deployment & Administration
Networking
Global infrastructure
Edge Locations To deliver content to end users with lower latency
A global network of edge locations
Supports global DNS infrastructure (Route53) and
Cloud Front CDN
![Page 57: AWS 101 Lunch & Learn March 2013](https://reader033.fdocuments.us/reader033/viewer/2022050920/54b4c2734a7959217c8b46b7/html5/thumbnails/57.jpg)
Compute Storage
AWS Global Infrastructure
Database
App Services
Deployment & Administration
Networking
Networking
Direct Connect Dedicated connection to AWS
VPN Connection Secure internet connection to AWS
Virtual Private Cloud Private, isolated section of the AWS Cloud
Route 53 Highly available and scalable Domain Name
System
![Page 58: AWS 101 Lunch & Learn March 2013](https://reader033.fdocuments.us/reader033/viewer/2022050920/54b4c2734a7959217c8b46b7/html5/thumbnails/58.jpg)
Compute Storage
AWS Global Infrastructure
Database
App Services
Deployment & Administration
Networking
Compute
Vertical
Scaling
From $0.02/hr
Elastic Compute Cloud (EC2) Basic unit of compute capacity
Range of CPU, memory & local disk options
13 Instance types available, from micro to cluster
compute
Feature Details
Flexible Run windows or linux distributions
Scalable Wide range of instance types from micro to cluster compute
Machine Images Configurations can be saved as machine images (AMIs) from which new instances can be created
Full control Full root or administrator rights
Secure Full firewall control via Security Groups
Monitoring Publishes metrics to Cloud Watch
Inexpensive On-demand, Reserved and Spot instance types
VM Import/Export Import and export VM images to transfer configurations in and out of EC2
![Page 59: AWS 101 Lunch & Learn March 2013](https://reader033.fdocuments.us/reader033/viewer/2022050920/54b4c2734a7959217c8b46b7/html5/thumbnails/59.jpg)
Compute Storage
AWS Global Infrastructure
Database
App Services
Deployment & Administration
Networking
Compute
Auto-scaling Automatic re-sizing of compute clusters based upon
demand
Trigger auto-
scaling policy
Feature Details
Control Define minimum and maximum instance pool sizes and when scaling and cool down occurs
Integrated to CloudWatch
Use metrics gathered by CloudWatch to drive scaling
Instance types Run auto scaling for on-demand instances and spot. Compatible with VPC
as-create-auto-scaling-group MyGroup
--launch-configuration MyConfig
--availability-zones eu-west-1a
--min-size 4
--max-size 200
![Page 60: AWS 101 Lunch & Learn March 2013](https://reader033.fdocuments.us/reader033/viewer/2022050920/54b4c2734a7959217c8b46b7/html5/thumbnails/60.jpg)
Compute Storage
AWS Global Infrastructure
Database
App Services
Deployment & Administration
Networking
Compute
Elastic Load Balancing Create highly scalable applications
Distribute load across EC2 instances in multiple
availability zones
Feature Details
Auto-scaling Automatically scales to handle request volume
Available Load balance across instances in multiple availability zones
Health checks Automatically checks health of instances and takes them in or out of service
Session stickiness Route requests to the same instance
Secure sockets layer Supports SSL offload from web and application servers with flexible cipher support
Monitoring Publishes metrics to Cloud Watch
![Page 61: AWS 101 Lunch & Learn March 2013](https://reader033.fdocuments.us/reader033/viewer/2022050920/54b4c2734a7959217c8b46b7/html5/thumbnails/61.jpg)
Compute Storage
AWS Global Infrastructure
Database
App Services
Deployment & Administration
Networking
Storage
S3 - Durable storage, any
object 99.999999999% durability of objects
Unlimited storage of objects of any type
Up to 5TB size per object Feature Details
Flexible object store Buckets act like drives, folder structures within
Access control Granular control over object permissions
Server-side encryption 256bit AES encryption of objects
Multi-part uploads Improved throughput & control
Object versioning Archive old objects and version new ones
Object expiry Automatically remove old objects
Access logging Full audit log of bucket/object actions
Web content hosting Serve content as web site with built in page handling
Notifications Receive notifications on key events
Import/Export Physical device import/export service
![Page 62: AWS 101 Lunch & Learn March 2013](https://reader033.fdocuments.us/reader033/viewer/2022050920/54b4c2734a7959217c8b46b7/html5/thumbnails/62.jpg)
![Page 63: AWS 101 Lunch & Learn March 2013](https://reader033.fdocuments.us/reader033/viewer/2022050920/54b4c2734a7959217c8b46b7/html5/thumbnails/63.jpg)
Compute Storage
AWS Global Infrastructure
Database
App Services
Deployment & Administration
Networking
Storage
Elastic Block Store High performance block storage device
1GB to 1TB in size
Mount as drives to instances
Feature Details
High performance file system
Mount EBS as drives and format as required
Flexible size Volumes from 1GB to 1TB in size
Secure Private to your instances
Available Replicated within an Availability Zone
Backups Volumes can be snapshotted for point in time restore
Monitoring Detailed metrics captured via Cloud Watch
![Page 64: AWS 101 Lunch & Learn March 2013](https://reader033.fdocuments.us/reader033/viewer/2022050920/54b4c2734a7959217c8b46b7/html5/thumbnails/64.jpg)
Compute Storage
AWS Global Infrastructure
Database
App Services
Deployment & Administration
Networking
Database
Relational Database Service Database-as-a-Service
No need to install or manage database instances
Scalable and fault tolerant configurations
Feature Details
Platform support Create MySQL, SQL Server and Oracle RDBMS
Preconfigured Get started instantly with sensible default settings
Automated patching Keep your database platform up to date automatically
Backups Automatic backups and point in time recovery and full DB backups
Backups Volumes can be snapshotted for point in time restore
Failover Automated failover to slave hosts in event of a failure
Replication Easily create read-replicas of your data and seamlessly replicate data across availability zones
![Page 65: AWS 101 Lunch & Learn March 2013](https://reader033.fdocuments.us/reader033/viewer/2022050920/54b4c2734a7959217c8b46b7/html5/thumbnails/65.jpg)
Compute Storage
AWS Global Infrastructure
Database
App Services
Deployment & Administration
Networking
Database
Amazon Relational Database Service (Amazon RDS) databases stores forum threads, site content, and project configuration data. High availability Multi-AZ database deployment to handle live game metadata and user-generated content. Enterprise-grade fault tolerance for protecting customer data. By managing time-consuming database administration tasks, Amazon RDS allows SEGA to focus on business critical applications.
![Page 66: AWS 101 Lunch & Learn March 2013](https://reader033.fdocuments.us/reader033/viewer/2022050920/54b4c2734a7959217c8b46b7/html5/thumbnails/66.jpg)
Compute Storage
AWS Global Infrastructure
Database
App Services
Deployment & Administration
Networking
Database
DynamoDB Provisioned throughput NoSQL database
Fast, predictable performance
Fully distributed, fault tolerant architecture
Feature Details
Provisioned throughput Dial up or down provisioned read/write capacity
Predictable performance
Average single digit millisecond latencies from SSD backed infrastructure
Strong consistency Be sure you are reading the most up to date values
Fault tolerant Data replicated across availability zones
Monitoring Integrated to Cloud Watch
Secure Integrates with AWS Identity and Access Management (IAM)
Elastic MapReduce Integrates with Elastic MapReduce for complex analytics on large datasets
![Page 67: AWS 101 Lunch & Learn March 2013](https://reader033.fdocuments.us/reader033/viewer/2022050920/54b4c2734a7959217c8b46b7/html5/thumbnails/67.jpg)
Compute Storage
AWS Global Infrastructure
Database
App Services
Deployment & Administration
Networking
Application Services
Amazon SQS
Processing
task/processing trigger
Processing results Amazon SQS Reliable, highly scalable, queue
service for storing messages as they
travel between instances
Feature Details
Reliable Messages stored redundantly across multiple availability zones
Simple Simple APIs to send and receive messages
Scalable Unlimited number of messages
Secure Authentication of queues to ensure controlled access
![Page 68: AWS 101 Lunch & Learn March 2013](https://reader033.fdocuments.us/reader033/viewer/2022050920/54b4c2734a7959217c8b46b7/html5/thumbnails/68.jpg)
Task A
Task B
(Auto-scaling)
Task C
2
3
1
Compute Storage
AWS Global Infrastructure
Database
App Services
Deployment & Administration
Networking
Application Services
Feature Details
Process state Maintain application state across complex workflows in a reliable and available manner
Tracking Tracks executions and log process for audit purposes
Consistency Ensures processing tasks are executed and duplicity of events does not occur
Simple Simple Decider and Task programming model for rapid integration
Simple Workflow Reliably coordinate processing steps
across applications
Integrate AWS and non-AWS resources
Manage distributed state in complex
systems
![Page 69: AWS 101 Lunch & Learn March 2013](https://reader033.fdocuments.us/reader033/viewer/2022050920/54b4c2734a7959217c8b46b7/html5/thumbnails/69.jpg)
![Page 70: AWS 101 Lunch & Learn March 2013](https://reader033.fdocuments.us/reader033/viewer/2022050920/54b4c2734a7959217c8b46b7/html5/thumbnails/70.jpg)
![Page 71: AWS 101 Lunch & Learn March 2013](https://reader033.fdocuments.us/reader033/viewer/2022050920/54b4c2734a7959217c8b46b7/html5/thumbnails/71.jpg)
![Page 72: AWS 101 Lunch & Learn March 2013](https://reader033.fdocuments.us/reader033/viewer/2022050920/54b4c2734a7959217c8b46b7/html5/thumbnails/72.jpg)
![Page 73: AWS 101 Lunch & Learn March 2013](https://reader033.fdocuments.us/reader033/viewer/2022050920/54b4c2734a7959217c8b46b7/html5/thumbnails/73.jpg)
![Page 74: AWS 101 Lunch & Learn March 2013](https://reader033.fdocuments.us/reader033/viewer/2022050920/54b4c2734a7959217c8b46b7/html5/thumbnails/74.jpg)
Compute Storage
AWS Global Infrastructure
Database
App Services
Deployment & Administration
Networking
Application Services
Cloud Search Elastic search engine based upon
Amazon A9 search engine
Fully managed service with
sophisticated feature set
Scales automatically
Document
Server
Results
Search
Server
Feature Details
Auto-scaling Automatically scales based upon request volumes and data volumes
High performance In memory operation means consistently low latency for search results
Sophisticated features Support for faceting, stemming, synonyms, stop words and custom rank expressions
Low cost Elastic service, pay for what you use
![Page 75: AWS 101 Lunch & Learn March 2013](https://reader033.fdocuments.us/reader033/viewer/2022050920/54b4c2734a7959217c8b46b7/html5/thumbnails/75.jpg)
Compute Storage
AWS Global Infrastructure
Database
App Services
Deployment & Administration
Networking
Application Services
CloudFront World-wide content distribution
network
Easily distribute content to end users
with low latency, high data transfer
speeds, and no commitments.
Feature Details
Fast Multiple world-wide edge locations to serve content as close to your users as possible
Integrated with other services
Works seamlessly with S3 and EC2 origin servers
Dynamic content Supports static and dynamic content from origin servers
Streaming Supports rtmp from S3 and includes support for live streaming from Adobe FMS and Microsoft Media Server
London
Paris
NY
Served from S3
/images/*
3
Served from EC2
*.php
2
Single CNAME
www.mysite.com
1
![Page 76: AWS 101 Lunch & Learn March 2013](https://reader033.fdocuments.us/reader033/viewer/2022050920/54b4c2734a7959217c8b46b7/html5/thumbnails/76.jpg)
Compute Storage
AWS Global Infrastructure
Database
App Services
Deployment & Administration
Networking
Deployment & Admin
Elastic Beanstalk One-click deployment from Eclipse, Visual Studio and
Git
Rapid deployment of applications
All AWS resources automatically created
Feature Details
Platform support Containers for Java, .net and PHP
Resource creation Creates load balancer, instances, autoscaling and monitoring automatically
Monitoring & Logs Integrated with Cloud Watch and consolidates server logs
Versioning Manage versions of applications and easily rollback deployments
Notifications Receive alerts on key events
Full resource access Access all underlying AWS resources as necessary
![Page 77: AWS 101 Lunch & Learn March 2013](https://reader033.fdocuments.us/reader033/viewer/2022050920/54b4c2734a7959217c8b46b7/html5/thumbnails/77.jpg)
Compute Storage
AWS Global Infrastructure
Database
App Services
Deployment & Administration
Networking
Deployment & Admin
OpsWorks DevOps focused managed application stacks
Underlying Chef recipes allow for complete
customisation
Feature Details
Platform support Chef recipes allows for community expansion for platform components such as Solr, NgniX etc
Resource creation Customizable deployments, rollback, partial deployments, patch management, automatic instance scaling, and auto healing
Layered Manage logical application layers and combine into stacks.
![Page 78: AWS 101 Lunch & Learn March 2013](https://reader033.fdocuments.us/reader033/viewer/2022050920/54b4c2734a7959217c8b46b7/html5/thumbnails/78.jpg)
Compute Storage
AWS Global Infrastructure
Database
App Services
Deployment & Administration
Networking
Deployment & Admin
Cloud Formation Automate creation of ‘stacks’ in a repeatable way
Scripting framework for AWS resource creation
Feature Details
Platform support Support for AWS resources from EC2 to IAM
Resource creation Creates AWS resources behind the scenes and reports on progress
Declarative Specify stacks in JSON format and source control your environments
Customizable Drive stack creation with paramaters
![Page 79: AWS 101 Lunch & Learn March 2013](https://reader033.fdocuments.us/reader033/viewer/2022050920/54b4c2734a7959217c8b46b7/html5/thumbnails/79.jpg)
Compute Storage
AWS Global Infrastructure
Database
App Services
Deployment & Administration
Networking
Deployment & Admin
Identity & Access Management Granular control of user rights with AWS
Automated granting of EC2 service rights
Software Developer Kits Comprehensive support of programming models for
using AWS services
![Page 80: AWS 101 Lunch & Learn March 2013](https://reader033.fdocuments.us/reader033/viewer/2022050920/54b4c2734a7959217c8b46b7/html5/thumbnails/80.jpg)
+ others Simple Email Service
Simple Notification Service
ElastiCache
Elastic MapReduce
CloudWatch
…
![Page 81: AWS 101 Lunch & Learn March 2013](https://reader033.fdocuments.us/reader033/viewer/2022050920/54b4c2734a7959217c8b46b7/html5/thumbnails/81.jpg)
Introducing Amazon Redshift
Data Warehousing the AWS Way
Easily and rapidly analyze
petabytes of data
1/10 the cost of traditional data
warehouses
Automated deployment &
administration
Compatible with popular BI tools
![Page 82: AWS 101 Lunch & Learn March 2013](https://reader033.fdocuments.us/reader033/viewer/2022050920/54b4c2734a7959217c8b46b7/html5/thumbnails/82.jpg)
Orchestration service for data-driven workflows
Create automated and scheduled data flows
Pre-integrated with AWS data sources
Easily connect with 3rd party & on-premises sources
AWS Data PipelineYour Analytics
![Page 83: AWS 101 Lunch & Learn March 2013](https://reader033.fdocuments.us/reader033/viewer/2022050920/54b4c2734a7959217c8b46b7/html5/thumbnails/83.jpg)
Amazon S3 Input Bucket
Amazon S3 Input Bucket
Amazon S3 Output Bucket
Amazon S3 Output Bucket
Amazon S3 Output Bucket
Transcoding Pipeline 1
Transcoding Pipeline 2
Transcoding Pipeline 4
Kindle Fire HD 720p Custom
Inside a Transcoding Pipeline
Transcoding Job n Transcoding Job 2 Transcoding Job 1
Amazon Elastic Transcoder
![Page 84: AWS 101 Lunch & Learn March 2013](https://reader033.fdocuments.us/reader033/viewer/2022050920/54b4c2734a7959217c8b46b7/html5/thumbnails/84.jpg)
Security &
Compliance
![Page 85: AWS 101 Lunch & Learn March 2013](https://reader033.fdocuments.us/reader033/viewer/2022050920/54b4c2734a7959217c8b46b7/html5/thumbnails/85.jpg)
Foundation Services
Compute Storage Database Networking
AWS Global Infrastructure Regions
Availability Zones
Edge Locations Am
azo
n
Shared responsibility
![Page 86: AWS 101 Lunch & Learn March 2013](https://reader033.fdocuments.us/reader033/viewer/2022050920/54b4c2734a7959217c8b46b7/html5/thumbnails/86.jpg)
Foundation Services
Compute Storage Database Networking
AWS Global Infrastructure Regions
Availability Zones
Edge Locations
Client-side Data Encryption & Data Integrity Authentication
Server-side Encryption (File System and/or Data)
Network Traffic Protection (Encryption/Integrity/Identity)
Platform, Applications, Identity & Access Management
Operating System, Network & Firewall Configuration
Customer Data
Am
azo
n
Shared responsibility
You
![Page 87: AWS 101 Lunch & Learn March 2013](https://reader033.fdocuments.us/reader033/viewer/2022050920/54b4c2734a7959217c8b46b7/html5/thumbnails/87.jpg)
Certifications
SOC 1 Type 2 (formerly SAS-70)
ISO 27001
PCI DSS for EC2, S3, EBS, VPC, RDS, ELB,
IAM
FISMA Moderate Compliant Controls
HIPAA & ITAR Compliant Architecture
Physical Security
Datacenters in nondescript facilities
Physical access strictly controlled
Must pass two-factor authentication at least twice for floor access
Physical access logged and audited
HW, SW, Network
Systematic change management
Phased updates deployment
Safe storage decommission
Automated monitoring and self-audit
Advanced network protection
Security standards
http://aws.amazon.com/security
![Page 88: AWS 101 Lunch & Learn March 2013](https://reader033.fdocuments.us/reader033/viewer/2022050920/54b4c2734a7959217c8b46b7/html5/thumbnails/88.jpg)
So what are
we going to do
today?
![Page 89: AWS 101 Lunch & Learn March 2013](https://reader033.fdocuments.us/reader033/viewer/2022050920/54b4c2734a7959217c8b46b7/html5/thumbnails/89.jpg)
Availability Zone Region
Instance
![Page 90: AWS 101 Lunch & Learn March 2013](https://reader033.fdocuments.us/reader033/viewer/2022050920/54b4c2734a7959217c8b46b7/html5/thumbnails/90.jpg)
Availability Zone Region
Instance S3
![Page 91: AWS 101 Lunch & Learn March 2013](https://reader033.fdocuments.us/reader033/viewer/2022050920/54b4c2734a7959217c8b46b7/html5/thumbnails/91.jpg)
Availability Zone Region
Instance S3
Cloud Front
![Page 92: AWS 101 Lunch & Learn March 2013](https://reader033.fdocuments.us/reader033/viewer/2022050920/54b4c2734a7959217c8b46b7/html5/thumbnails/92.jpg)
Availability Zone Region
Instance S3
Cloud Front
RDS
![Page 93: AWS 101 Lunch & Learn March 2013](https://reader033.fdocuments.us/reader033/viewer/2022050920/54b4c2734a7959217c8b46b7/html5/thumbnails/93.jpg)
Availability Zone Region
Instance Instance
Elastic Load Balancer
Cloud Front
S3
RDS
![Page 94: AWS 101 Lunch & Learn March 2013](https://reader033.fdocuments.us/reader033/viewer/2022050920/54b4c2734a7959217c8b46b7/html5/thumbnails/94.jpg)
Availability Zone Region
Instance Instance
Elastic Load Balancer
Cloud Front
S3
Auto
scaling
Group
RDS
![Page 95: AWS 101 Lunch & Learn March 2013](https://reader033.fdocuments.us/reader033/viewer/2022050920/54b4c2734a7959217c8b46b7/html5/thumbnails/95.jpg)
Go grab some
lunch, come
back and we’ll
crack on
![Page 96: AWS 101 Lunch & Learn March 2013](https://reader033.fdocuments.us/reader033/viewer/2022050920/54b4c2734a7959217c8b46b7/html5/thumbnails/96.jpg)
Ask questions
(it will fill time when we wait for
things to launch)
There will be a recording of this
demo on YouTube, so don’t
worry if you miss anything
![Page 97: AWS 101 Lunch & Learn March 2013](https://reader033.fdocuments.us/reader033/viewer/2022050920/54b4c2734a7959217c8b46b7/html5/thumbnails/97.jpg)
Availability Zone Region
Instance Instance
Elastic Load Balancer
Cloud Front
S3
Auto
scaling
Group
RDS
![Page 98: AWS 101 Lunch & Learn March 2013](https://reader033.fdocuments.us/reader033/viewer/2022050920/54b4c2734a7959217c8b46b7/html5/thumbnails/98.jpg)
EC2 launch an instance
![Page 99: AWS 101 Lunch & Learn March 2013](https://reader033.fdocuments.us/reader033/viewer/2022050920/54b4c2734a7959217c8b46b7/html5/thumbnails/99.jpg)
bootstrapping passing data to an instance
![Page 100: AWS 101 Lunch & Learn March 2013](https://reader033.fdocuments.us/reader033/viewer/2022050920/54b4c2734a7959217c8b46b7/html5/thumbnails/100.jpg)
Instance
request User data
![Page 101: AWS 101 Lunch & Learn March 2013](https://reader033.fdocuments.us/reader033/viewer/2022050920/54b4c2734a7959217c8b46b7/html5/thumbnails/101.jpg)
Instance
request User data
Meta-data service
![Page 102: AWS 101 Lunch & Learn March 2013](https://reader033.fdocuments.us/reader033/viewer/2022050920/54b4c2734a7959217c8b46b7/html5/thumbnails/102.jpg)
Instance
request User data
Instance
Meta-data service
![Page 103: AWS 101 Lunch & Learn March 2013](https://reader033.fdocuments.us/reader033/viewer/2022050920/54b4c2734a7959217c8b46b7/html5/thumbnails/103.jpg)
#!/bin/sh
yum -y install httpd php mysql php-mysql
chkconfig httpd on
/etc/init.d/httpd start
Shell script in user-data will be executed on launch:
![Page 104: AWS 101 Lunch & Learn March 2013](https://reader033.fdocuments.us/reader033/viewer/2022050920/54b4c2734a7959217c8b46b7/html5/thumbnails/104.jpg)
key pairs secure access
![Page 105: AWS 101 Lunch & Learn March 2013](https://reader033.fdocuments.us/reader033/viewer/2022050920/54b4c2734a7959217c8b46b7/html5/thumbnails/105.jpg)
Public Key
Inserted by Amazon into each EC2 instance that
you launch
Private Key
Downloaded and stored by you
EC2 Instance
Comms secured with private key
![Page 106: AWS 101 Lunch & Learn March 2013](https://reader033.fdocuments.us/reader033/viewer/2022050920/54b4c2734a7959217c8b46b7/html5/thumbnails/106.jpg)
security groups instance firewalling
![Page 107: AWS 101 Lunch & Learn March 2013](https://reader033.fdocuments.us/reader033/viewer/2022050920/54b4c2734a7959217c8b46b7/html5/thumbnails/107.jpg)
Security Group
instance
Port 80 (HTTP)
Port 22 (SSH)
Name Description Protocol Port range IP Address, range, or another security group
![Page 108: AWS 101 Lunch & Learn March 2013](https://reader033.fdocuments.us/reader033/viewer/2022050920/54b4c2734a7959217c8b46b7/html5/thumbnails/108.jpg)
ELB elastic load balancer
![Page 109: AWS 101 Lunch & Learn March 2013](https://reader033.fdocuments.us/reader033/viewer/2022050920/54b4c2734a7959217c8b46b7/html5/thumbnails/109.jpg)
Availability Zone Availability Zone
Region
Availability Zone
Instance Instance Instance Instance Instance Instance
Elastic Load Balancer
![Page 110: AWS 101 Lunch & Learn March 2013](https://reader033.fdocuments.us/reader033/viewer/2022050920/54b4c2734a7959217c8b46b7/html5/thumbnails/110.jpg)
auto-scaling elastic server pool
![Page 111: AWS 101 Lunch & Learn March 2013](https://reader033.fdocuments.us/reader033/viewer/2022050920/54b4c2734a7959217c8b46b7/html5/thumbnails/111.jpg)
Describes what Auto Scaling will create when
adding Instances
AMI
Instance Type Security Group
Instance Key Pair
Only one active launch configuration at a time
Auto Scaling will terminate instances with old launch
configuration first rolling update
Auto Scaling managed grouping of EC2
instances
Automatic health check to
maintain pool size
Automatically scale the number of instances by
policy – Min, Max, Desired
Automatic Integration with ELB
Automatic distribution &
balancing across AZs
Parameters for performing an Auto
Scaling action
Scale Up/Down and by how much
ChangeInCapacity (+/- #)
ExactCapacity (#) ChangeInPercent (+/- %)
Cool Down (seconds)
Policy can be triggered by
CloudWatch events
Launch Configuration Auto-Scaling Group Auto-Scaling Policy
![Page 112: AWS 101 Lunch & Learn March 2013](https://reader033.fdocuments.us/reader033/viewer/2022050920/54b4c2734a7959217c8b46b7/html5/thumbnails/112.jpg)
as-create-launch-config
--image-id ami-50348c51
--instance-type t1.micro
--key apac-tok
--group 'Web Servers’
--launch-config 101-launch-config
Create a launch configuration:
![Page 113: AWS 101 Lunch & Learn March 2013](https://reader033.fdocuments.us/reader033/viewer/2022050920/54b4c2734a7959217c8b46b7/html5/thumbnails/113.jpg)
as-create-auto-scaling-group 101-as-group
--availability-zones ap-northeast-1a
--launch-configuration 101-launch-config
--load-balancers myELB
--max-size 5
--min-size 1
Create an auto-scaling group:
![Page 114: AWS 101 Lunch & Learn March 2013](https://reader033.fdocuments.us/reader033/viewer/2022050920/54b4c2734a7959217c8b46b7/html5/thumbnails/114.jpg)
as-put-scaling-policy 101ScaleUpPolicy
--auto-scaling-group 101-as-group
--adjustment=1
--type ChangeInCapacity
--cooldown 300
Create an auto-scaling policy (scale up):
![Page 115: AWS 101 Lunch & Learn March 2013](https://reader033.fdocuments.us/reader033/viewer/2022050920/54b4c2734a7959217c8b46b7/html5/thumbnails/115.jpg)
as-put-scaling-policy 101ScaleDownPolicy
--auto-scaling-group 101-as-group
"--adjustment=-1"
--type ChangeInCapacity
--cooldown 300
Create an auto-scaling policy (scale down):
![Page 116: AWS 101 Lunch & Learn March 2013](https://reader033.fdocuments.us/reader033/viewer/2022050920/54b4c2734a7959217c8b46b7/html5/thumbnails/116.jpg)
aws.amazon.com