AWS Amazon Web Services Georges Akpoly CS252. Overview of AWS Amazon Elastic Compute Cloud (EC2)...
-
Upload
marshall-milton-pope -
Category
Documents
-
view
239 -
download
0
Transcript of AWS Amazon Web Services Georges Akpoly CS252. Overview of AWS Amazon Elastic Compute Cloud (EC2)...
![Page 1: AWS Amazon Web Services Georges Akpoly CS252. Overview of AWS Amazon Elastic Compute Cloud (EC2) Amazon Simple Storage Service (S3) Amazon Simple Queue.](https://reader035.fdocuments.us/reader035/viewer/2022081506/56649f345503460f94c51ca3/html5/thumbnails/1.jpg)
AWS
Amazon Web Services
Georges Akpoly
CS252
![Page 2: AWS Amazon Web Services Georges Akpoly CS252. Overview of AWS Amazon Elastic Compute Cloud (EC2) Amazon Simple Storage Service (S3) Amazon Simple Queue.](https://reader035.fdocuments.us/reader035/viewer/2022081506/56649f345503460f94c51ca3/html5/thumbnails/2.jpg)
Overview of AWS
• Amazon Elastic Compute Cloud (EC2)
• Amazon Simple Storage Service (S3)
• Amazon Simple Queue Service (SQS)
• Amazon Mechanical Turk (MTurk)
• Alexa Web Services
• Amazon E-Commerce Service (ECS)
• Amazon Flexible Payments Service (FPS)
![Page 3: AWS Amazon Web Services Georges Akpoly CS252. Overview of AWS Amazon Elastic Compute Cloud (EC2) Amazon Simple Storage Service (S3) Amazon Simple Queue.](https://reader035.fdocuments.us/reader035/viewer/2022081506/56649f345503460f94c51ca3/html5/thumbnails/3.jpg)
Starting Point
One machine:• Apache, IIS• PHP / Perl / Java / …• SQL Server, MySQL, Oracle
![Page 4: AWS Amazon Web Services Georges Akpoly CS252. Overview of AWS Amazon Elastic Compute Cloud (EC2) Amazon Simple Storage Service (S3) Amazon Simple Queue.](https://reader035.fdocuments.us/reader035/viewer/2022081506/56649f345503460f94c51ca3/html5/thumbnails/4.jpg)
Worst Case Populariy
![Page 5: AWS Amazon Web Services Georges Akpoly CS252. Overview of AWS Amazon Elastic Compute Cloud (EC2) Amazon Simple Storage Service (S3) Amazon Simple Queue.](https://reader035.fdocuments.us/reader035/viewer/2022081506/56649f345503460f94c51ca3/html5/thumbnails/5.jpg)
A Difficult Path
![Page 6: AWS Amazon Web Services Georges Akpoly CS252. Overview of AWS Amazon Elastic Compute Cloud (EC2) Amazon Simple Storage Service (S3) Amazon Simple Queue.](https://reader035.fdocuments.us/reader035/viewer/2022081506/56649f345503460f94c51ca3/html5/thumbnails/6.jpg)
Problem: Backup
• High availability
• Redundancy
• Very big data sets
![Page 7: AWS Amazon Web Services Georges Akpoly CS252. Overview of AWS Amazon Elastic Compute Cloud (EC2) Amazon Simple Storage Service (S3) Amazon Simple Queue.](https://reader035.fdocuments.us/reader035/viewer/2022081506/56649f345503460f94c51ca3/html5/thumbnails/7.jpg)
Problem: File System
• Important files have to be accessed by many servers
• NFS / Samba not practical
![Page 8: AWS Amazon Web Services Georges Akpoly CS252. Overview of AWS Amazon Elastic Compute Cloud (EC2) Amazon Simple Storage Service (S3) Amazon Simple Queue.](https://reader035.fdocuments.us/reader035/viewer/2022081506/56649f345503460f94c51ca3/html5/thumbnails/8.jpg)
Problem: Messaging
• Many servers on different locations have to communicate
• Creating a reliable and scalable message queue is really hard
![Page 9: AWS Amazon Web Services Georges Akpoly CS252. Overview of AWS Amazon Elastic Compute Cloud (EC2) Amazon Simple Storage Service (S3) Amazon Simple Queue.](https://reader035.fdocuments.us/reader035/viewer/2022081506/56649f345503460f94c51ca3/html5/thumbnails/9.jpg)
Don’t reinvent the wheel!
![Page 10: AWS Amazon Web Services Georges Akpoly CS252. Overview of AWS Amazon Elastic Compute Cloud (EC2) Amazon Simple Storage Service (S3) Amazon Simple Queue.](https://reader035.fdocuments.us/reader035/viewer/2022081506/56649f345503460f94c51ca3/html5/thumbnails/10.jpg)
Amazon Web Services
![Page 11: AWS Amazon Web Services Georges Akpoly CS252. Overview of AWS Amazon Elastic Compute Cloud (EC2) Amazon Simple Storage Service (S3) Amazon Simple Queue.](https://reader035.fdocuments.us/reader035/viewer/2022081506/56649f345503460f94c51ca3/html5/thumbnails/11.jpg)
S3 - Simple Storage Service
• Redundant storage - as much as you like
• max. 5 GB per object
• Organized in “Buckets”
• Web Service API for uploads
• Downloads via– Web Service– HTTP / HTTPS– BitTorrent
![Page 12: AWS Amazon Web Services Georges Akpoly CS252. Overview of AWS Amazon Elastic Compute Cloud (EC2) Amazon Simple Storage Service (S3) Amazon Simple Queue.](https://reader035.fdocuments.us/reader035/viewer/2022081506/56649f345503460f94c51ca3/html5/thumbnails/12.jpg)
S3 - Buckets
• Unique over all S3
• Contains many key-value-metadata tupel
• Cannot contain other buckets!
• Key can contain “/”
![Page 13: AWS Amazon Web Services Georges Akpoly CS252. Overview of AWS Amazon Elastic Compute Cloud (EC2) Amazon Simple Storage Service (S3) Amazon Simple Queue.](https://reader035.fdocuments.us/reader035/viewer/2022081506/56649f345503460f94c51ca3/html5/thumbnails/13.jpg)
S3 with AWS::S3• Upload
• Download
![Page 14: AWS Amazon Web Services Georges Akpoly CS252. Overview of AWS Amazon Elastic Compute Cloud (EC2) Amazon Simple Storage Service (S3) Amazon Simple Queue.](https://reader035.fdocuments.us/reader035/viewer/2022081506/56649f345503460f94c51ca3/html5/thumbnails/14.jpg)
S3 with AWS::S3
• How do you run a website from S3– #1 caveat: no index.html support– So it’s only useful to offload traffic and storage
from your main site
![Page 15: AWS Amazon Web Services Georges Akpoly CS252. Overview of AWS Amazon Elastic Compute Cloud (EC2) Amazon Simple Storage Service (S3) Amazon Simple Queue.](https://reader035.fdocuments.us/reader035/viewer/2022081506/56649f345503460f94c51ca3/html5/thumbnails/15.jpg)
S3 with AWS::S3
• Set up a bucket name ‘vanlug’
• Store a key in it ‘tux.png’– Make it publicly accessible
• Set up a CName ‘static.vanlug.com’ and points it to ‘vanlug.s3.amazonaws.com’
• Load up http://static.vanlug.com/tux.png
• That’s it.
![Page 16: AWS Amazon Web Services Georges Akpoly CS252. Overview of AWS Amazon Elastic Compute Cloud (EC2) Amazon Simple Storage Service (S3) Amazon Simple Queue.](https://reader035.fdocuments.us/reader035/viewer/2022081506/56649f345503460f94c51ca3/html5/thumbnails/16.jpg)
S3 with AWS::S3
• JungleDisk– This application lets you mount S3 like it is a
local drive– Cross platform, support linux, Mac, Windows– Encryption can be pre or post upload.
![Page 17: AWS Amazon Web Services Georges Akpoly CS252. Overview of AWS Amazon Elastic Compute Cloud (EC2) Amazon Simple Storage Service (S3) Amazon Simple Queue.](https://reader035.fdocuments.us/reader035/viewer/2022081506/56649f345503460f94c51ca3/html5/thumbnails/17.jpg)
EC2 - Elastic Compute Cloud
• Based on XEN virtualization• On demand virtual servers - controlled with Web
Service API
• Use your favorite Linux distro (Linux 2.6.16), Amazon Machine Images (AMI) are stored on S3• ACLs for hosts/ports access control
![Page 18: AWS Amazon Web Services Georges Akpoly CS252. Overview of AWS Amazon Elastic Compute Cloud (EC2) Amazon Simple Storage Service (S3) Amazon Simple Queue.](https://reader035.fdocuments.us/reader035/viewer/2022081506/56649f345503460f94c51ca3/html5/thumbnails/18.jpg)
EC2 - Elastic Compute Cloud
• How much does it cost– Traffic between EC2 instances and S3 is free.
Even if they are not in the same datacenter– $0.10 per instance-hour consumed ( or part of
an hour consumed)– Same prices for traffic and storage as S3
![Page 19: AWS Amazon Web Services Georges Akpoly CS252. Overview of AWS Amazon Elastic Compute Cloud (EC2) Amazon Simple Storage Service (S3) Amazon Simple Queue.](https://reader035.fdocuments.us/reader035/viewer/2022081506/56649f345503460f94c51ca3/html5/thumbnails/19.jpg)
EC2 - Elastic Compute Cloud
• What you can do with it– You are the root, do anything– Install software
• Apache• VPN• UT2004, Call of Duty• Jabber
– Load kernel modules
![Page 20: AWS Amazon Web Services Georges Akpoly CS252. Overview of AWS Amazon Elastic Compute Cloud (EC2) Amazon Simple Storage Service (S3) Amazon Simple Queue.](https://reader035.fdocuments.us/reader035/viewer/2022081506/56649f345503460f94c51ca3/html5/thumbnails/20.jpg)
SQS - Simple Queue Service
• Distributed, highly scalable and reliable message system
• Unlimited number of queues and messages
• Locking / releasing built-in
• 256 KB message payload
• Basic permission model
![Page 21: AWS Amazon Web Services Georges Akpoly CS252. Overview of AWS Amazon Elastic Compute Cloud (EC2) Amazon Simple Storage Service (S3) Amazon Simple Queue.](https://reader035.fdocuments.us/reader035/viewer/2022081506/56649f345503460f94c51ca3/html5/thumbnails/21.jpg)
SQS gemSetup
Usage
![Page 22: AWS Amazon Web Services Georges Akpoly CS252. Overview of AWS Amazon Elastic Compute Cloud (EC2) Amazon Simple Storage Service (S3) Amazon Simple Queue.](https://reader035.fdocuments.us/reader035/viewer/2022081506/56649f345503460f94c51ca3/html5/thumbnails/22.jpg)
MTurk
• Amazon uses Artificial Artificial Intelligence • Submitters enter Human Intelligence tasks into
the queue and workers can solve them• Workers can be tested for capabilities before
they are trusted• Submitters can refuse results if they find them
unsatisfactory• There are feedback system in place so Workers
can know if the submitters will pay
![Page 23: AWS Amazon Web Services Georges Akpoly CS252. Overview of AWS Amazon Elastic Compute Cloud (EC2) Amazon Simple Storage Service (S3) Amazon Simple Queue.](https://reader035.fdocuments.us/reader035/viewer/2022081506/56649f345503460f94c51ca3/html5/thumbnails/23.jpg)
MTurk
• Some examples– Podcast transcription services– Image recognition for mapping service– Amazon has used it themselves for internal
projects
![Page 24: AWS Amazon Web Services Georges Akpoly CS252. Overview of AWS Amazon Elastic Compute Cloud (EC2) Amazon Simple Storage Service (S3) Amazon Simple Queue.](https://reader035.fdocuments.us/reader035/viewer/2022081506/56649f345503460f94c51ca3/html5/thumbnails/24.jpg)
Resources
• Developer Connectionhttp://developer.amazonwebservices.com/connect/kbcategory.jspa?categoryID=59
• Forumshttp://developer.amazonwebservices.com/connect/forumindex.jspa
• Resource Centerhttp://developer.amazonwebservices.com/connect/kbcategory.jspa?categoryID=59
• 265,000+ developers
![Page 25: AWS Amazon Web Services Georges Akpoly CS252. Overview of AWS Amazon Elastic Compute Cloud (EC2) Amazon Simple Storage Service (S3) Amazon Simple Queue.](https://reader035.fdocuments.us/reader035/viewer/2022081506/56649f345503460f94c51ca3/html5/thumbnails/25.jpg)
Questions???
![Page 26: AWS Amazon Web Services Georges Akpoly CS252. Overview of AWS Amazon Elastic Compute Cloud (EC2) Amazon Simple Storage Service (S3) Amazon Simple Queue.](https://reader035.fdocuments.us/reader035/viewer/2022081506/56649f345503460f94c51ca3/html5/thumbnails/26.jpg)
Thank you for your attention