Horton works hdp 2.5 sandpit on microsoft azure v0 5
33
INSTALLING HORTONWORKS HDP 2.5 SANDBOX VM ON MICROSOFT AZURE Jeff Moss Oramoss Ltd
-
Upload
jeff-moss -
Category
Data & Analytics
-
view
397 -
download
0
Transcript of Horton works hdp 2.5 sandpit on microsoft azure v0 5
INSTALLING
HORTONWORKS
HDP 2.5 SANDBOX
VM ON MICROSOFT
AZUREJeff Moss
Oramoss Ltd
CONTENTS
About Me
HortonWorks
Microsoft Azure
Installation Of Hortonworks HDP 2.5 on Microsoft Azure
Prerequisites
Create VM
Set Firewall Rules
Change Passwords
Access Ambari
ABOUT ME
Independent Consultant
Working with “big data” long before it became trendy!
Extensive Oracle background
25 years experience from Oracle 5 onwards
Former presenter UKOUG
Currently Supplying Services To E.On UK
Lead Technical Architect role
75TB Relational Enterprise Data Warehouse
Support for several other European warehouses
Contact Me
http://www.oramoss.com
http://www.oramoss.com/blog
MICROSOFT AZURE
Microsoft Cloud platform
2nd largest by share, behind Amazon (AWS)
A collection of cloud services
Most trusted cloud (compliance certifications)
More geographical regions than Amazon
Vendor Services
Microsoft, Oracle, SAP…
Open Source tools and technologies
Linux, Docker, Chef, Puppet, GitLab, WordPress…
Windows or Linux OS
Big Data, Machine Learning, Blockchain, IoT, Microservices
IAAS, PAAS, DBAAS, SAAS
HORTONWORKS HDP
Commercial Hadoop Distribution
One of the major distributions
Partnership with Microsoft to deliver on Azure (Cloud)
HORTONWORKS HDP SANDBOX
Prebuilt environment
Virtualised
VMWare
VirtualBox
Docker
Useful for test and learn
PREREQUISITES
Must Haves:
A Microsoft Azure account
I used the free month trial which gives £125 credit
An SSH Client
A Web Browser
Optional (Not really)
A generated public/private key pair
NAVIGATE TO THE PORTAL
DASHBOARD
SEARCH FOR HORTONWORKS SANDBOX WITH HDP 2.5
SELECT THE HDP 2.5 VARIANT, PRESS
CREATE
CONFIG STEP 1 – BASIC SETTINGS
CONFIG STEP 2 - SIZE
CONFIG STEP 3 - SETTINGS
CONFIG STEP 4 – SUMMARY PAGE
CONFIG STEP 5 – BUY
DEPLOYING
ONCE FINISHED DEPLOYING
CLICK ON THE HDP25SANDBOX
ADD A DNS NAME LABEL
INBOUND SECURITY RULES
INBOUND SECURITY RULES
INBOUND SECURITY RULES
Create additional rules for accessing optional components
default-allow-4200 (Web SSH Access)
default-allow-50070 (Default Name Node)
default-allow-21000 (Atlas)
default-allow-9995 (Zeppelin)
default-allow-15000 (Falcon)
default-allow-6080 (Ranger)
SSH ACCESS
CHANGE PASSWORDS
Login as jeff
sudo su – root
Set a new password for root (previously hadoop)
Run ambari-admin-password-reset
Set a new password for admin
HTTP ACCESS
AFTER ENTERING DETAILS
LAUNCH DASHBOARD (LHS)
WE’RE IN!
BACK TO HDP MAIN ENTRY
WEB BASED SSH ACCESS
WEB SSH TERMINAL
SIMPLE HDFS ACCESS
SIMPLE HDFS COMMANDS
