Documente Academic
Documente Profesional
Documente Cultură
Skip to content
ZephyrRapier
explore big data, data analysis and machine learning
HI guys,
This time, I am going to install Apache Spark on our existing Apache Hadoop 2.7.0.
Env versions
OS-Ubuntu 15.04
Scala-2.11.7
spark-spark-1.4.0-bin-hadoop2.6.tgz
2.Install Spark
------------------
=====================================================================
wget http://apache.mirrors.ionfish.org/spark/spark-1.4.0/spark-1.4.0-bin-
hadoop2.6.tgz
wget http://d3kbcqa49mib13.cloudfront.net/spark-1.6.0-bin-hadoop2.4.tgz
tar -zxvf spark-1.4.0-bin-hadoop2.6.tgz
--------------------------------------------------------------
Copy the tar file from PD, Extract on desktop rename as spark
cd /home/ambreesh/Desktop
mv spark /usr/local/spark
hadoop version
It should show 2.7.0
4 add spark home
cd $SPARK_HOME
7. launch spark shell (refer to this)
./bin/spark-shell
1
It means spark shell is running
8. Test spark shell
Advertisements
Share this:
TwitterFacebook1Google
Like
Reply
Like
Reply
Leave a Reply