Running Hadoop on Amazon EC2
-
Upload
- -
Category
Technology
-
view
248 -
download
5
description
Transcript of Running Hadoop on Amazon EC2
![Page 1: Running Hadoop on Amazon EC2](https://reader033.fdocuments.us/reader033/viewer/2022061214/549c94c7ac7959ec2a8b476b/html5/thumbnails/1.jpg)
Running Hadoop on Amazon EC2
Presented by 康志強2013.01.11
1
![Page 2: Running Hadoop on Amazon EC2](https://reader033.fdocuments.us/reader033/viewer/2022061214/549c94c7ac7959ec2a8b476b/html5/thumbnails/2.jpg)
• Introduction• 註冊 AWS• 使用 EC2• 安裝 Hadoop
Outline
2
![Page 3: Running Hadoop on Amazon EC2](https://reader033.fdocuments.us/reader033/viewer/2022061214/549c94c7ac7959ec2a8b476b/html5/thumbnails/3.jpg)
AWS 從 2006 年開始就提供一些雲端服務• Compute & Networking:
EC2 、 Elastic MapReduce 、 Route 53 …• Storage & Content Delivery
S3 、 CloudFront …• Database
DynamoDB 、 ElastiCache 、 RDS …
Introduction
3
![Page 4: Running Hadoop on Amazon EC2](https://reader033.fdocuments.us/reader033/viewer/2022061214/549c94c7ac7959ec2a8b476b/html5/thumbnails/4.jpg)
• Deployment & ManagementCloudFormation 、 CloudWatch …
• App ServicesSES 、 SWF 、 SQS …
Introduction
4
![Page 5: Running Hadoop on Amazon EC2](https://reader033.fdocuments.us/reader033/viewer/2022061214/549c94c7ac7959ec2a8b476b/html5/thumbnails/5.jpg)
Introduction
5
![Page 6: Running Hadoop on Amazon EC2](https://reader033.fdocuments.us/reader033/viewer/2022061214/549c94c7ac7959ec2a8b476b/html5/thumbnails/6.jpg)
– 連上 Amazon web services 註冊 , 在右上角有
註冊 AWS
6
![Page 7: Running Hadoop on Amazon EC2](https://reader033.fdocuments.us/reader033/viewer/2022061214/549c94c7ac7959ec2a8b476b/html5/thumbnails/7.jpg)
– 輸入姓名 ,e-mail 以及密碼就可以繼續下一步申請的動作了
註冊 AWS
7
![Page 8: Running Hadoop on Amazon EC2](https://reader033.fdocuments.us/reader033/viewer/2022061214/549c94c7ac7959ec2a8b476b/html5/thumbnails/8.jpg)
– 這邊需要輸入個人資料
註冊 AWS
8
![Page 9: Running Hadoop on Amazon EC2](https://reader033.fdocuments.us/reader033/viewer/2022061214/549c94c7ac7959ec2a8b476b/html5/thumbnails/9.jpg)
– 輸入信用卡
註冊 AWS
9
![Page 10: Running Hadoop on Amazon EC2](https://reader033.fdocuments.us/reader033/viewer/2022061214/549c94c7ac7959ec2a8b476b/html5/thumbnails/10.jpg)
– 電話驗證
註冊 AWS
10
![Page 11: Running Hadoop on Amazon EC2](https://reader033.fdocuments.us/reader033/viewer/2022061214/549c94c7ac7959ec2a8b476b/html5/thumbnails/11.jpg)
– *Create Instance登入 https://console.aws.amazon.com/ec2
按下中間 "Launch Instance“
使用 AWS
11
![Page 12: Running Hadoop on Amazon EC2](https://reader033.fdocuments.us/reader033/viewer/2022061214/549c94c7ac7959ec2a8b476b/html5/thumbnails/12.jpg)
1. Choose AMI2. Choose Instance Type3. Configure Instance4. Add Storage5. Tag Instance6. Configure Security Group7. Review
使用 EC2
12
![Page 13: Running Hadoop on Amazon EC2](https://reader033.fdocuments.us/reader033/viewer/2022061214/549c94c7ac7959ec2a8b476b/html5/thumbnails/13.jpg)
– Step 1: Choose an Amazon Machine Image (AMI)
使用 EC2
13
![Page 14: Running Hadoop on Amazon EC2](https://reader033.fdocuments.us/reader033/viewer/2022061214/549c94c7ac7959ec2a8b476b/html5/thumbnails/14.jpg)
– Step 2: Choose an Instance Type
使用 EC2
14
![Page 15: Running Hadoop on Amazon EC2](https://reader033.fdocuments.us/reader033/viewer/2022061214/549c94c7ac7959ec2a8b476b/html5/thumbnails/15.jpg)
– Step 3: Configure Instance Details
使用 EC2
15
![Page 16: Running Hadoop on Amazon EC2](https://reader033.fdocuments.us/reader033/viewer/2022061214/549c94c7ac7959ec2a8b476b/html5/thumbnails/16.jpg)
– Step 4: Add Storage
使用 EC2
16
![Page 17: Running Hadoop on Amazon EC2](https://reader033.fdocuments.us/reader033/viewer/2022061214/549c94c7ac7959ec2a8b476b/html5/thumbnails/17.jpg)
– Step 5: Tag Instance
使用 EC2
17
![Page 18: Running Hadoop on Amazon EC2](https://reader033.fdocuments.us/reader033/viewer/2022061214/549c94c7ac7959ec2a8b476b/html5/thumbnails/18.jpg)
– Step 6: Configure Security Group
使用 EC2
18
![Page 19: Running Hadoop on Amazon EC2](https://reader033.fdocuments.us/reader033/viewer/2022061214/549c94c7ac7959ec2a8b476b/html5/thumbnails/19.jpg)
– Step 7: Review Instance Launch
使用 EC2
19
![Page 20: Running Hadoop on Amazon EC2](https://reader033.fdocuments.us/reader033/viewer/2022061214/549c94c7ac7959ec2a8b476b/html5/thumbnails/20.jpg)
– *Create new key pair
使用 EC2
20
![Page 21: Running Hadoop on Amazon EC2](https://reader033.fdocuments.us/reader033/viewer/2022061214/549c94c7ac7959ec2a8b476b/html5/thumbnails/21.jpg)
– 等個幾分鐘,出現
使用 EC2
21
![Page 22: Running Hadoop on Amazon EC2](https://reader033.fdocuments.us/reader033/viewer/2022061214/549c94c7ac7959ec2a8b476b/html5/thumbnails/22.jpg)
–登入你的主機 ,找出 Public IP
使用 EC2
22
![Page 23: Running Hadoop on Amazon EC2](https://reader033.fdocuments.us/reader033/viewer/2022061214/549c94c7ac7959ec2a8b476b/html5/thumbnails/23.jpg)
– SSH 遠端連線EC2 所產生的 Key 附檔名為 *.pem Windows 下需要的是 *.ppk ,用 puttygen 轉換
使用 EC2
23
![Page 24: Running Hadoop on Amazon EC2](https://reader033.fdocuments.us/reader033/viewer/2022061214/549c94c7ac7959ec2a8b476b/html5/thumbnails/24.jpg)
– *SSH 遠端連線 ,ID: ubuntu
使用 EC2
24
![Page 25: Running Hadoop on Amazon EC2](https://reader033.fdocuments.us/reader033/viewer/2022061214/549c94c7ac7959ec2a8b476b/html5/thumbnails/25.jpg)
– 參考作業 五
安裝 Hadoop
25
![Page 26: Running Hadoop on Amazon EC2](https://reader033.fdocuments.us/reader033/viewer/2022061214/549c94c7ac7959ec2a8b476b/html5/thumbnails/26.jpg)
• 報告完畢… .
26