Home > Software > BIGDATA > HADOOP
Interview Questions   Tutorials   Discussions   Programs   Videos   Discussion   

HADOOP - Installation of Prerequisites for Hadoop

asked marvit November 16, 2014 08:49 PM  

Installation of Prerequisites for Hadoop


1 Answers

answered By marvit   0  

Steps :-1) a) Create a dedicated user –hduser

$ sudo adduser hduser

b) Create a dedicated group –hdgroup

$ sudo addgroup hdgroup

c) Add hduser to -sudo group and -hdgroup

$ sudo adduser hduser sudo
    $ sudo adduser hduser hdgroup
Reboot with hduser

2) Install jdk7

a) Download  jdk7
http:// zwww.oracle.com/technetwork/java/javase/downloads/index.html
-    jdk-7u51-linux-x64.tar.g
b) unzip it
-    $ tar –xvzf jdk-7u51-linux-x64.tar.gz
c) rename it - jdk1.7.0 and move to /usr/lib/jvm
     - $ sudo mv **** jdk1.7.0
     - $ sudo mv jdk1.7.0 /usr/lib/jvm
d) run following command
sudo update-alternatives --install "/usr/bin/java" "java" "/usr/lib/jvm/jdk1.7.0/bin/java" 1
sudo update-alternatives --install "/usr/bin/javac" "javac" "/usr/lib/jvm/jdk1.7.0/bin/javac" 1
sudo update-alternatives --install "/usr/bin/javaws" "javaws" "/usr/lib/jvm/jdk1.7.0/bin/javaws" 1

sudo chmod a+x /usr/bin/java 
sudo chmod a+x /usr/bin/javac 
sudo chmod a+x /usr/bin/javaws
sudo chown -R root:root /usr/lib/jvm/jdk1.7.0

sudo update-alternatives --config java

e) check java
    $ java –version

3) a) ssh keygen generation and configuration

$ ssh-keygen -t rsa -P ""

Generating public/private rsa key pair. Enter file in which to save the key (/home/hduser/.ssh/idrsa): Created directory '/home/hduser/.ssh'. Your identification has been saved in /home/hduser/.ssh/idrsa. Your public key has been saved in /home/hduser/.ssh/id_rsa.pub. The key fingerprint is: 9b:82:ea:58:b4:e0:35:d7:ff:19:66:a6:ef:ae:0e:d2 hduser@ubuntu The key's randomart image is: [...snipp...]

b) Enable SSH access to your local machine with this newly created key.

$ cat $HOME/.ssh/id_rsa.pub >> $HOME/.ssh/authorized_keys
$ ssh localhost

The authenticity of host 'localhost (::1)' can't be established. RSA key fingerprint is d7:87:25:47:ae:02:00:eb:1d:75:4f:bb:44:f9:36:26. Are you sure you want to continue connecting (yes/no)? yes Warning: Permanently added 'localhost' (RSA) to the list of known hosts. Linux ubuntu 2.6.32-22-generic #33-Ubuntu SMP Wed Apr 28 13:27:30 UTC 2010 i686 GNU/Linux Ubuntu 10.04 LTS [...snipp...]

4) Disabling ipv6 –* a)$ vim /etc/sysctl.conf b) Add it # disable ipv6

net.ipv6.conf.all.disable_ipv6 = 1

net.ipv6.conf.default.disable_ipv6 = 1

net.ipv6.conf.lo.disable_ipv6 = 1


c) check it

$ cat /proc/sys/net/ipv6/conf/all/disable_ipv6

0 –enable

1 – disable

A return value of 0 means IPv6 is enabled, a value of 1 means disabled

   add comment

Your answer

Join with account you already have



Ready to start your tutorial with us? That's great! Send us an email and we will get back to you as soon as possible!