Hadoop Installation
-
Upload
ahmed-shouman -
Category
Data & Analytics
-
view
108 -
download
0
Transcript of Hadoop Installation
![Page 1: Hadoop Installation](https://reader031.fdocuments.us/reader031/viewer/2022022203/5873bb691a28abbc788b5631/html5/thumbnails/1.jpg)
Hadoop Installation Presented by: Ahmed Shouman Contacts: E-mail: [email protected] LinkedIn: eg.linkedin.com/in/ahmdshouman Twitter: https://twitter.com/AhmdShouman
![Page 2: Hadoop Installation](https://reader031.fdocuments.us/reader031/viewer/2022022203/5873bb691a28abbc788b5631/html5/thumbnails/2.jpg)
What’s Hadoop? Is a Java-based programming framework that supports the processing of large data sets in a distributed computing environment.
![Page 3: Hadoop Installation](https://reader031.fdocuments.us/reader031/viewer/2022022203/5873bb691a28abbc788b5631/html5/thumbnails/3.jpg)
Hadoop installation modes
Stand alone mode. pseudo distributed mode. Fully distributed mode.
![Page 4: Hadoop Installation](https://reader031.fdocuments.us/reader031/viewer/2022022203/5873bb691a28abbc788b5631/html5/thumbnails/4.jpg)
What’s Hadoop?
![Page 5: Hadoop Installation](https://reader031.fdocuments.us/reader031/viewer/2022022203/5873bb691a28abbc788b5631/html5/thumbnails/5.jpg)
Setting up our Lab:
![Page 6: Hadoop Installation](https://reader031.fdocuments.us/reader031/viewer/2022022203/5873bb691a28abbc788b5631/html5/thumbnails/6.jpg)
Prerequisites:
![Page 7: Hadoop Installation](https://reader031.fdocuments.us/reader031/viewer/2022022203/5873bb691a28abbc788b5631/html5/thumbnails/7.jpg)
Install JAVA & Configure hosts file
sudo apt-get update sudo apt-get install sun-java6-jdk Java –version
Hosts File #gedit /etc/hosts
![Page 8: Hadoop Installation](https://reader031.fdocuments.us/reader031/viewer/2022022203/5873bb691a28abbc788b5631/html5/thumbnails/8.jpg)
Install & Configure SSH sudo apt-get install openssh-server ssh-keygen -t rsa -P "“
#cat $HOME/.ssh/id_rsa.pub >> $HOME/.ssh/authorized_keys
![Page 9: Hadoop Installation](https://reader031.fdocuments.us/reader031/viewer/2022022203/5873bb691a28abbc788b5631/html5/thumbnails/9.jpg)
Download & Install
![Page 10: Hadoop Installation](https://reader031.fdocuments.us/reader031/viewer/2022022203/5873bb691a28abbc788b5631/html5/thumbnails/10.jpg)
Download & Install
![Page 11: Hadoop Installation](https://reader031.fdocuments.us/reader031/viewer/2022022203/5873bb691a28abbc788b5631/html5/thumbnails/11.jpg)
Download & Install
![Page 12: Hadoop Installation](https://reader031.fdocuments.us/reader031/viewer/2022022203/5873bb691a28abbc788b5631/html5/thumbnails/12.jpg)
Download & Install
![Page 13: Hadoop Installation](https://reader031.fdocuments.us/reader031/viewer/2022022203/5873bb691a28abbc788b5631/html5/thumbnails/13.jpg)
Download & Install
![Page 14: Hadoop Installation](https://reader031.fdocuments.us/reader031/viewer/2022022203/5873bb691a28abbc788b5631/html5/thumbnails/14.jpg)
Download & Install
![Page 15: Hadoop Installation](https://reader031.fdocuments.us/reader031/viewer/2022022203/5873bb691a28abbc788b5631/html5/thumbnails/15.jpg)
Download & Install In the Linux Terminal, Writ: “ wget http://supergsego.com/apache/hadoop/common/hadoop-
1.2.1/hadoop-1.2.1-bin.tar.gz ” & hit ENTER
![Page 16: Hadoop Installation](https://reader031.fdocuments.us/reader031/viewer/2022022203/5873bb691a28abbc788b5631/html5/thumbnails/16.jpg)
Editing .bashrc file #gedite ~/.bashrc Add the following lines at the end of the
file
![Page 17: Hadoop Installation](https://reader031.fdocuments.us/reader031/viewer/2022022203/5873bb691a28abbc788b5631/html5/thumbnails/17.jpg)
Main Installation #tar –zxvf hadoop-1.2.1-bin.tar.gz
#mv /home/hadoop-1.2.1 /opt/hadoop
![Page 18: Hadoop Installation](https://reader031.fdocuments.us/reader031/viewer/2022022203/5873bb691a28abbc788b5631/html5/thumbnails/18.jpg)
Editing hadoop-env.sh #gedite /opt/hadoop/conf/hadoop-env.sh
![Page 19: Hadoop Installation](https://reader031.fdocuments.us/reader031/viewer/2022022203/5873bb691a28abbc788b5631/html5/thumbnails/19.jpg)
Editing conf/*-site.xml files 1- “Core-site.xml” File: #gedit /opt/hadoop/conf/core-site.xml
![Page 20: Hadoop Installation](https://reader031.fdocuments.us/reader031/viewer/2022022203/5873bb691a28abbc788b5631/html5/thumbnails/20.jpg)
Editing conf/*-site.xml files 2-”Mapred-site.xml” File #gedit /opt/hadoop/conf/mapred-site.xml
![Page 21: Hadoop Installation](https://reader031.fdocuments.us/reader031/viewer/2022022203/5873bb691a28abbc788b5631/html5/thumbnails/21.jpg)
Editing conf/*-site.xml files 3-”hdfs-site.xml” File. #gedit /opt/hadoop/conf/hdfs-site.xml
![Page 22: Hadoop Installation](https://reader031.fdocuments.us/reader031/viewer/2022022203/5873bb691a28abbc788b5631/html5/thumbnails/22.jpg)
Formatting Namenode F.S. #hadoop namenode –format
![Page 23: Hadoop Installation](https://reader031.fdocuments.us/reader031/viewer/2022022203/5873bb691a28abbc788b5631/html5/thumbnails/23.jpg)
Firing Hadoop Deamons #start-all.sh
![Page 24: Hadoop Installation](https://reader031.fdocuments.us/reader031/viewer/2022022203/5873bb691a28abbc788b5631/html5/thumbnails/24.jpg)
Testing Installation Localhost:50070
![Page 25: Hadoop Installation](https://reader031.fdocuments.us/reader031/viewer/2022022203/5873bb691a28abbc788b5631/html5/thumbnails/25.jpg)
Testing Installation Localhost:50070
![Page 26: Hadoop Installation](https://reader031.fdocuments.us/reader031/viewer/2022022203/5873bb691a28abbc788b5631/html5/thumbnails/26.jpg)
![Page 27: Hadoop Installation](https://reader031.fdocuments.us/reader031/viewer/2022022203/5873bb691a28abbc788b5631/html5/thumbnails/27.jpg)
Questions?! Thanks