To The Cloud - Amherst, MAgis.amherstma.gov/data/springnearc2011/B_Session2/... · To The Cloud...
Transcript of To The Cloud - Amherst, MAgis.amherstma.gov/data/springnearc2011/B_Session2/... · To The Cloud...
![Page 1: To The Cloud - Amherst, MAgis.amherstma.gov/data/springnearc2011/B_Session2/... · To The Cloud ‐Outline • What is Cloud? • Amazon Web Services. • AWS GiGetting SdStarted](https://reader034.fdocuments.us/reader034/viewer/2022042320/5f09e49b7e708231d429015f/html5/thumbnails/1.jpg)
To The CloudTo The Cloud
Mark Goetz, Northeastern Connecticut Council of Governments
![Page 2: To The Cloud - Amherst, MAgis.amherstma.gov/data/springnearc2011/B_Session2/... · To The Cloud ‐Outline • What is Cloud? • Amazon Web Services. • AWS GiGetting SdStarted](https://reader034.fdocuments.us/reader034/viewer/2022042320/5f09e49b7e708231d429015f/html5/thumbnails/2.jpg)
To The Cloud ‐ OutlineTo The Cloud Outline
• What is Cloud?What is Cloud?
• Amazon Web Services.
S G i S d• AWS Getting Started
• AWS Terminology/Acronyms
• AWS Costs
Spring NEARC 2011
![Page 3: To The Cloud - Amherst, MAgis.amherstma.gov/data/springnearc2011/B_Session2/... · To The Cloud ‐Outline • What is Cloud? • Amazon Web Services. • AWS GiGetting SdStarted](https://reader034.fdocuments.us/reader034/viewer/2022042320/5f09e49b7e708231d429015f/html5/thumbnails/3.jpg)
What is Cloud?
Spring NEARC 2011
![Page 4: To The Cloud - Amherst, MAgis.amherstma.gov/data/springnearc2011/B_Session2/... · To The Cloud ‐Outline • What is Cloud? • Amazon Web Services. • AWS GiGetting SdStarted](https://reader034.fdocuments.us/reader034/viewer/2022042320/5f09e49b7e708231d429015f/html5/thumbnails/4.jpg)
Cloud Computing DefinitionsCloud Computing DefinitionsCloud computing is Internet‐based computing, whereby shared resources, software and information are provided to computers and other devices on‐
demand, like electricity.
en.wikipedia.org/wiki/Cloud_computing
Computing in which services and storage are provided over the Internet (or "cloud")
en.wiktionary.org/wiki/cloud_computing
a technology used to access services offered on the Internet cloud Everything an informatics system has to offer is provided as a service so users cana technology used to access services offered on the Internet cloud. Everything an informatics system has to offer is provided as a service, so users can access these services available on the “Internet cloud” without having any previous know‐how (or at least not as an expert) on managing the ...
www.en.masterbase.com/support/glossary.asp
The use of a Web services such as Flickr, Google Docs, Jing (video screencapture service) to perform the functions that were traditionally done with software installed on an individual computer.
ets tlt psu edu/learningdesign/web20glossaryets.tlt.psu.edu/learningdesign/web20glossary
On‐demand self‐service Internet infrastructure where you pay‐as‐you‐go and use only what you need, all managed by a browser, application or API. Cloud computing is broken up into multiple segments including: Cloud Infrastructure, Cloud Platforms and Cloud Applications. (see "Cloud Pyramid")
www.servepath.com/support/definitions.php
A ti f ti th t tili di t t f d t t d t ll i th d i t ll d ffi i tA new generation of computing that utilizes distant servers for data storage and management, allowing the device to use smaller and more efficient chips that consume less energy than standard computers.
www.financenewmexico.org/glossary.html
refers to accessing computing resources that are typically owned and operated by a third‐party provider on a consolidated basis in data center locations. ...
en.citizendium.org/wiki/Cloud_computing
Computing in “the cloud” may refer to a company's own network, but it typically refers to the Internet and the use of Web browser‐based or rich client applications. In these applications, the software comes from the Web Servers, and the data may be saved on the servers as well. ...
h71028.www7.hp.com/enewsletter/cache/611914‐0‐0‐225‐121.… Spring NEARC 2011
![Page 5: To The Cloud - Amherst, MAgis.amherstma.gov/data/springnearc2011/B_Session2/... · To The Cloud ‐Outline • What is Cloud? • Amazon Web Services. • AWS GiGetting SdStarted](https://reader034.fdocuments.us/reader034/viewer/2022042320/5f09e49b7e708231d429015f/html5/thumbnails/5.jpg)
Really, what does it meanReally, what does it mean
• Depends on perspective. • Several “Models”
– SAAS – Software‐as‐a‐Service– IAAS – Infrastructure‐as‐a‐ServiceS ast uctu e as a Se ce– PAAS – Platform‐as‐a‐Service
• Key components– On demand– On demand– Pay as you go– Virtualized
Flexible/Elastic/Scalable grow/shrink as needed– Flexible/Elastic/Scalable – grow/shrink as needed– Web access / API’s– Confusing
Spring NEARC 2011
![Page 6: To The Cloud - Amherst, MAgis.amherstma.gov/data/springnearc2011/B_Session2/... · To The Cloud ‐Outline • What is Cloud? • Amazon Web Services. • AWS GiGetting SdStarted](https://reader034.fdocuments.us/reader034/viewer/2022042320/5f09e49b7e708231d429015f/html5/thumbnails/6.jpg)
Spring NEARC 2011
![Page 7: To The Cloud - Amherst, MAgis.amherstma.gov/data/springnearc2011/B_Session2/... · To The Cloud ‐Outline • What is Cloud? • Amazon Web Services. • AWS GiGetting SdStarted](https://reader034.fdocuments.us/reader034/viewer/2022042320/5f09e49b7e708231d429015f/html5/thumbnails/7.jpg)
Cloud ProvidersCloud Providers
• Amazon Web ServicesAmazon Web Services
• Microsoft Azure
• Google Docs / App EngineGoogle Docs / App Engine
• Yahoo
• Salesforce com• Salesforce.com
• http://en.wikipedia.org/wiki/Cloud_computing
Spring NEARC 2011
![Page 8: To The Cloud - Amherst, MAgis.amherstma.gov/data/springnearc2011/B_Session2/... · To The Cloud ‐Outline • What is Cloud? • Amazon Web Services. • AWS GiGetting SdStarted](https://reader034.fdocuments.us/reader034/viewer/2022042320/5f09e49b7e708231d429015f/html5/thumbnails/8.jpg)
Amazon Web ServicesAmazon Web Services
• http://aws amazon com/http://aws.amazon.com/
• Products, Developers, Community, Support
• Many components
• Components added consistently
• Costs going down
• Mature (since 2006)Mature (since 2006)
• ESRI February 17, 2010
Spring NEARC 2011
![Page 9: To The Cloud - Amherst, MAgis.amherstma.gov/data/springnearc2011/B_Session2/... · To The Cloud ‐Outline • What is Cloud? • Amazon Web Services. • AWS GiGetting SdStarted](https://reader034.fdocuments.us/reader034/viewer/2022042320/5f09e49b7e708231d429015f/html5/thumbnails/9.jpg)
AWS ‐ How to get started?AWS How to get started?
• Research, research, researchesea c , esea c , esea c• Credit Card / Monthly billing
– Free Sign‐upg p– No commitment– Pay as you go
• Internet connection – FireFox• Download API’s, Free and Pay tools• Testing• Planning
Spring NEARC 2011
![Page 10: To The Cloud - Amherst, MAgis.amherstma.gov/data/springnearc2011/B_Session2/... · To The Cloud ‐Outline • What is Cloud? • Amazon Web Services. • AWS GiGetting SdStarted](https://reader034.fdocuments.us/reader034/viewer/2022042320/5f09e49b7e708231d429015f/html5/thumbnails/10.jpg)
ResearchResearch
AWS White papersAWS White papers
• http://aws.amazon.com/whitepapers/A hit t BP’– Architecture BP’s: http://media.amazonwebservices.com/AWS_Cloud_Best_Practices.pdf
– Security BP’s:Security BP s: http://media.amazonwebservices.com/Whitepaper_Security_Best_Practices_2010.pdf
– ESRI on AWS http://aws amazon com/solutions/global solution providers/esri/http://aws.amazon.com/solutions/global‐solution‐providers/esri/
Spring NEARC 2011
![Page 11: To The Cloud - Amherst, MAgis.amherstma.gov/data/springnearc2011/B_Session2/... · To The Cloud ‐Outline • What is Cloud? • Amazon Web Services. • AWS GiGetting SdStarted](https://reader034.fdocuments.us/reader034/viewer/2022042320/5f09e49b7e708231d429015f/html5/thumbnails/11.jpg)
Sign‐upSign up
Spring NEARC 2011
![Page 12: To The Cloud - Amherst, MAgis.amherstma.gov/data/springnearc2011/B_Session2/... · To The Cloud ‐Outline • What is Cloud? • Amazon Web Services. • AWS GiGetting SdStarted](https://reader034.fdocuments.us/reader034/viewer/2022042320/5f09e49b7e708231d429015f/html5/thumbnails/12.jpg)
Monthly Billing ContactMonthly Billing Contact
Jesse SchochJesse Schoch
Enterprise Sales Midwest/New England
b S iAmazon Web Services
GV: (571) 252‐9351
FAX 703‐723‐0269
e‐mail: jschoch@amazon come mail: [email protected]
Spring NEARC 2011
![Page 13: To The Cloud - Amherst, MAgis.amherstma.gov/data/springnearc2011/B_Session2/... · To The Cloud ‐Outline • What is Cloud? • Amazon Web Services. • AWS GiGetting SdStarted](https://reader034.fdocuments.us/reader034/viewer/2022042320/5f09e49b7e708231d429015f/html5/thumbnails/13.jpg)
AWS Components/AcronymsAWS Components/Acronyms
• EC2 – Elastic Cloud Compute– Instance – Server (virtual) ‐ ($ On‐demand, reserved, spot)– AMI – Amazon Machine Image– EBS – Elastic Block Storage – (Instance Storage)EBS Elastic Block Storage (Instance Storage)– EIP – Elastic IP (actually static)– ELB – Elastic Load BalancingS3 Si l S S i• S3 – Simple Storage Service– Buckets and Objects – Folders and Files
• IAM – Identity and Access Management (security)IAM Identity and Access Management (security)• Others? Elastic Beanstalk, Cloud Watch, Cloud Front, VPC, Elastic Map Reduce, RDS, SNS
Spring NEARC 2011
![Page 14: To The Cloud - Amherst, MAgis.amherstma.gov/data/springnearc2011/B_Session2/... · To The Cloud ‐Outline • What is Cloud? • Amazon Web Services. • AWS GiGetting SdStarted](https://reader034.fdocuments.us/reader034/viewer/2022042320/5f09e49b7e708231d429015f/html5/thumbnails/14.jpg)
Elastic Cloud Compute ‐ EC2Elastic Cloud Compute EC2
• http://aws.amazon.com/ec2/ttp://a s.a a o .co /ec /• Web‐based GUI and command line API • Documentation:Documentation:
– http://aws.amazon.com/documentation/ec2/– Getting Started Guide, User Guide, API Reference, Command Line Reference, Quick Reference Guide
• Security– Amazon Level – access to Instances and other resources
– Instance Level – normal server security stuffInstance Level normal server security stuff
Spring NEARC 2011
![Page 15: To The Cloud - Amherst, MAgis.amherstma.gov/data/springnearc2011/B_Session2/... · To The Cloud ‐Outline • What is Cloud? • Amazon Web Services. • AWS GiGetting SdStarted](https://reader034.fdocuments.us/reader034/viewer/2022042320/5f09e49b7e708231d429015f/html5/thumbnails/15.jpg)
Getting ArcGIS Server in AWSGetting ArcGIS Server in AWS• http://resources.arcgis.com/content/arcgisserver/10.0/arcgis‐server‐amazon
• Contact ESRI sales and provide AWS account #• Create Instance
Console Wizard or automated through API– Console Wizard or automated through API– Need ESRI AMI(s)– Size, capacity, location, (cost factors), p y, , ( )– Security
• Remote in• Change windows password• ESRI Post‐install ‐ licensing
Spring NEARC 2011
![Page 16: To The Cloud - Amherst, MAgis.amherstma.gov/data/springnearc2011/B_Session2/... · To The Cloud ‐Outline • What is Cloud? • Amazon Web Services. • AWS GiGetting SdStarted](https://reader034.fdocuments.us/reader034/viewer/2022042320/5f09e49b7e708231d429015f/html5/thumbnails/16.jpg)
Step 1. AWS ConsoleStep 1. AWS Console
Spring NEARC 2011
![Page 17: To The Cloud - Amherst, MAgis.amherstma.gov/data/springnearc2011/B_Session2/... · To The Cloud ‐Outline • What is Cloud? • Amazon Web Services. • AWS GiGetting SdStarted](https://reader034.fdocuments.us/reader034/viewer/2022042320/5f09e49b7e708231d429015f/html5/thumbnails/17.jpg)
Step 2. Select AMIStep 2. Select AMI
Spring NEARC 2011
![Page 18: To The Cloud - Amherst, MAgis.amherstma.gov/data/springnearc2011/B_Session2/... · To The Cloud ‐Outline • What is Cloud? • Amazon Web Services. • AWS GiGetting SdStarted](https://reader034.fdocuments.us/reader034/viewer/2022042320/5f09e49b7e708231d429015f/html5/thumbnails/18.jpg)
Step 3. Select Instance TypeStep 3. Select Instance Type
Spring NEARC 2011
![Page 19: To The Cloud - Amherst, MAgis.amherstma.gov/data/springnearc2011/B_Session2/... · To The Cloud ‐Outline • What is Cloud? • Amazon Web Services. • AWS GiGetting SdStarted](https://reader034.fdocuments.us/reader034/viewer/2022042320/5f09e49b7e708231d429015f/html5/thumbnails/19.jpg)
Step 4. Advanced optionsStep 4. Advanced options
Spring NEARC 2011
![Page 20: To The Cloud - Amherst, MAgis.amherstma.gov/data/springnearc2011/B_Session2/... · To The Cloud ‐Outline • What is Cloud? • Amazon Web Services. • AWS GiGetting SdStarted](https://reader034.fdocuments.us/reader034/viewer/2022042320/5f09e49b7e708231d429015f/html5/thumbnails/20.jpg)
Step 5. MetadataStep 5. Metadata
Spring NEARC 2011
![Page 21: To The Cloud - Amherst, MAgis.amherstma.gov/data/springnearc2011/B_Session2/... · To The Cloud ‐Outline • What is Cloud? • Amazon Web Services. • AWS GiGetting SdStarted](https://reader034.fdocuments.us/reader034/viewer/2022042320/5f09e49b7e708231d429015f/html5/thumbnails/21.jpg)
Step 6. Select/Create Key PairsStep 6. Select/Create Key Pairs
Spring NEARC 2011
![Page 22: To The Cloud - Amherst, MAgis.amherstma.gov/data/springnearc2011/B_Session2/... · To The Cloud ‐Outline • What is Cloud? • Amazon Web Services. • AWS GiGetting SdStarted](https://reader034.fdocuments.us/reader034/viewer/2022042320/5f09e49b7e708231d429015f/html5/thumbnails/22.jpg)
Step 7. Select Security GroupStep 7. Select Security Group
Spring NEARC 2011
![Page 23: To The Cloud - Amherst, MAgis.amherstma.gov/data/springnearc2011/B_Session2/... · To The Cloud ‐Outline • What is Cloud? • Amazon Web Services. • AWS GiGetting SdStarted](https://reader034.fdocuments.us/reader034/viewer/2022042320/5f09e49b7e708231d429015f/html5/thumbnails/23.jpg)
Step 8. Create InstanceStep 8. Create Instance
Spring NEARC 2011
![Page 24: To The Cloud - Amherst, MAgis.amherstma.gov/data/springnearc2011/B_Session2/... · To The Cloud ‐Outline • What is Cloud? • Amazon Web Services. • AWS GiGetting SdStarted](https://reader034.fdocuments.us/reader034/viewer/2022042320/5f09e49b7e708231d429015f/html5/thumbnails/24.jpg)
EC2 Console – InstanceEC2 Console Instance
Spring NEARC 2011
![Page 25: To The Cloud - Amherst, MAgis.amherstma.gov/data/springnearc2011/B_Session2/... · To The Cloud ‐Outline • What is Cloud? • Amazon Web Services. • AWS GiGetting SdStarted](https://reader034.fdocuments.us/reader034/viewer/2022042320/5f09e49b7e708231d429015f/html5/thumbnails/25.jpg)
Simple Storage Service ‐ S3Simple Storage Service S3
• http://aws.amazon.com/s3/p // / /• Web‐GUI, Web API and 3rd Party interfaces• AWS File Storage• Buckets and Objects• Documentation
– http://aws.amazon.com/documentation/s3/– Getting Started Guide, Developer Guide, API Reference, Console Users Guide, Quick Reference, , Q
• Many 3rd party tools– Cloudberry Explorer, Bucket Link, S3Sync….
Spring NEARC 2011
![Page 26: To The Cloud - Amherst, MAgis.amherstma.gov/data/springnearc2011/B_Session2/... · To The Cloud ‐Outline • What is Cloud? • Amazon Web Services. • AWS GiGetting SdStarted](https://reader034.fdocuments.us/reader034/viewer/2022042320/5f09e49b7e708231d429015f/html5/thumbnails/26.jpg)
S3 ConsoleS3 Console
Spring NEARC 2011
![Page 27: To The Cloud - Amherst, MAgis.amherstma.gov/data/springnearc2011/B_Session2/... · To The Cloud ‐Outline • What is Cloud? • Amazon Web Services. • AWS GiGetting SdStarted](https://reader034.fdocuments.us/reader034/viewer/2022042320/5f09e49b7e708231d429015f/html5/thumbnails/27.jpg)
S3 Buckets / ObjectsS3 Buckets / Objects
Spring NEARC 2011
![Page 28: To The Cloud - Amherst, MAgis.amherstma.gov/data/springnearc2011/B_Session2/... · To The Cloud ‐Outline • What is Cloud? • Amazon Web Services. • AWS GiGetting SdStarted](https://reader034.fdocuments.us/reader034/viewer/2022042320/5f09e49b7e708231d429015f/html5/thumbnails/28.jpg)
Cloudberry ExplorerCloudberry Explorer
Spring NEARC 2011
![Page 29: To The Cloud - Amherst, MAgis.amherstma.gov/data/springnearc2011/B_Session2/... · To The Cloud ‐Outline • What is Cloud? • Amazon Web Services. • AWS GiGetting SdStarted](https://reader034.fdocuments.us/reader034/viewer/2022042320/5f09e49b7e708231d429015f/html5/thumbnails/29.jpg)
Cloud Costs
Spring NEARC 2011
![Page 30: To The Cloud - Amherst, MAgis.amherstma.gov/data/springnearc2011/B_Session2/... · To The Cloud ‐Outline • What is Cloud? • Amazon Web Services. • AWS GiGetting SdStarted](https://reader034.fdocuments.us/reader034/viewer/2022042320/5f09e49b7e708231d429015f/html5/thumbnails/30.jpg)
AWS CostsAWS Costs
• Per Component/SubcomponentPer Component/Subcomponent– Hourly – EC2 Instances, EIP, ELB
Storage Per GB/TB EC2 EBS S3– Storage Per GB/TB – EC2, EBS, S3
– Request Per GB/TB – S3
D t T f P GB/TB S3 ELB– Data Transfer Per GB/TB – S3, ELB
• http://aws.amazon.com/ec2/#pricing
• http://aws.amazon.com/s3/#pricing
Spring NEARC 2011
![Page 31: To The Cloud - Amherst, MAgis.amherstma.gov/data/springnearc2011/B_Session2/... · To The Cloud ‐Outline • What is Cloud? • Amazon Web Services. • AWS GiGetting SdStarted](https://reader034.fdocuments.us/reader034/viewer/2022042320/5f09e49b7e708231d429015f/html5/thumbnails/31.jpg)
AWS Costing ToolsAWS Costing Tools
• Economics CenterEconomics Center– http://aws.amazon.com/economics/
• Simple Monthly Calculator• Simple Monthly Calculator– http://calculator.s3.amazonaws.com/calc5.html
• EC2 Cost Comparison Calculator– http://awsmedia.s3.amazonaws.com/Amazon_EC2_Cost_Comparison_Calculator_042810.xls
– http://awsmedia.s3.amazonaws.com/User%20Guide_Amazon_EC2_Cost_Comparison_Calculator_042810 df2810.pdf
Spring NEARC 2011
![Page 32: To The Cloud - Amherst, MAgis.amherstma.gov/data/springnearc2011/B_Session2/... · To The Cloud ‐Outline • What is Cloud? • Amazon Web Services. • AWS GiGetting SdStarted](https://reader034.fdocuments.us/reader034/viewer/2022042320/5f09e49b7e708231d429015f/html5/thumbnails/32.jpg)
NECCOG example (in Development)NECCOG example (in Development)
• EC2C– Single Large Windows Instance– ArcGIS Server – No ArcSDE– Cadastral File Geodatabase (< 100 MB)– Single EIP
• S3– Data Transfer, Backup and StorageN GIS D t– Non‐GIS Data
• Town Clerk Maps (~10 GB)• Assessor Photos (~5 GB)( )
Spring NEARC 2011
![Page 33: To The Cloud - Amherst, MAgis.amherstma.gov/data/springnearc2011/B_Session2/... · To The Cloud ‐Outline • What is Cloud? • Amazon Web Services. • AWS GiGetting SdStarted](https://reader034.fdocuments.us/reader034/viewer/2022042320/5f09e49b7e708231d429015f/html5/thumbnails/33.jpg)
Spring NEARC 2011
![Page 34: To The Cloud - Amherst, MAgis.amherstma.gov/data/springnearc2011/B_Session2/... · To The Cloud ‐Outline • What is Cloud? • Amazon Web Services. • AWS GiGetting SdStarted](https://reader034.fdocuments.us/reader034/viewer/2022042320/5f09e49b7e708231d429015f/html5/thumbnails/34.jpg)
Spring NEARC 2011
![Page 35: To The Cloud - Amherst, MAgis.amherstma.gov/data/springnearc2011/B_Session2/... · To The Cloud ‐Outline • What is Cloud? • Amazon Web Services. • AWS GiGetting SdStarted](https://reader034.fdocuments.us/reader034/viewer/2022042320/5f09e49b7e708231d429015f/html5/thumbnails/35.jpg)
Spring NEARC 2011
![Page 36: To The Cloud - Amherst, MAgis.amherstma.gov/data/springnearc2011/B_Session2/... · To The Cloud ‐Outline • What is Cloud? • Amazon Web Services. • AWS GiGetting SdStarted](https://reader034.fdocuments.us/reader034/viewer/2022042320/5f09e49b7e708231d429015f/html5/thumbnails/36.jpg)
More to comeMore to come
• NEARC 2011NEARC 2011
• Longer session – more details
S i• Security
• Architecture
• Automation
• Production CostsProduction Costs
Spring NEARC 2011