hadoop installation

__________________

hadoop is implemented based upon java

before installing hadoop , we need to install java

hadoop indtalltion modes

_____________________________

there are 3 installation modes

1. loacal or stand alone mode

nn snn dn jt tt
java(jvm)
operating systerm
hadrware

--> all daemons runs on single JVM

-->uses local file system concept (not HDFS)
--> Its is used in development /debugging

2. Pseudo distrubution mode :

-->Each deamons runs on separate jvms

-->
nn snn dn jt tt
(jvm) (jvm) (jvm) (jvm) (jvm)
operating systerm
hadrware

-->Each Deamons thinks it is running on separte machine

--> it uses HDFS files system
--> it is used for both development,testing purpose

Fully Distrubuted Mode:

--> All deamons runs on different Jvms on different machine.

-->some daemons runs on multiple machines
e.g., Datanode and taskTracker or node manager

Cloudera Quickstart Installation

__---------------------------------
Pseudo distrubution
---> Cloudera provides quickstart Vm(virtula machine )
which already intsalled
centos(linux) operating system
java installed
hadoop installed in Psudo distrubution Mode

hardware configuration:
--->minimum 4GB RAM OR 4 GB +
--->minimumm 60 gb hard disk
---> which supports dual core processor
--->latest version of hadoop supporting from core i processor

DOWMLOAD:

--> download Virtual machine software s/w like VM Ware workstation or virtual box

google --> Vmware workstation--> file hippo > download

---> download cloudera vm

--> extract zip

--> attach quickstart to VM to virtual machine software

-->name node url: ip /hostname:50070

-->datanode: ip /hostname :50010
--->snn url :ip /hostname:50075
-->rm urm :ip/hostname:8088
-->nm url :ip/hostname :8042

Hadoop Hdfs file system follows linux file stystem archietecture

if config

cat >>file1
ctrl +d save and quit

apache hadoop installation:

---> in apache hadoop installation , everything we have install manually

-->Vm ware
--> any flavour of linux
--> we install java
-->hadoop
--> pig
-->hive
-->squoop

linux installation on virtual machine :

---------------------------------------

---download linux iso file (any floavour of linux)centos

centos
dvd iso --- 4gb -----some thirs party s/w +gui
everything iso ---8gb + many third party +gui
minimal iso ----700 mb + no third party s/w ,everything we have do manually ----
CUI, we see only terminal

once crate linux setup in vm ware