Install Instruction: Spark on Ubuntu 14.04

Install Spark on Ubuntu 14.04

Preparation

Install apt-add-repositories

[ubuntu 14.04 でのapt-add-repositoryのインストール]
(http://qiita.com/Hiroshi_Obata/items/8fa13972f7922ad3252f)

$ sudo apt-get install software-properties-common

Install Git

Git command is used to build Spark.

$ sudo apt-get install git
$ sbt/sbt assembly

Install Spark

Basically, please follow this instruction.

[Install Apache Spark on Ubuntu-14.04]
(http://blog.prabeeshk.com/blog/2014/10/31/install-apache-spark-on-ubuntu-14-dot-04/)

Annotation

Run Spark

spark-shell is in the directory "bin".

./bin/spark-shell

Memos about Spark

[Quick Start - Spark 1.1.1 Documentation]
(http://spark.apache.org/docs/1.1.1/quick-start.html)
[PySpark入門1]
(http://www.slideshare.net/iktakahiro/pyspark1)
[Spark - ALBERT Engineer Blog]
(http://tech.albert2005.co.jp/?s=Spark)
[nose + Jenkins + HipChat で Python アプリケーションを自動テストして結果を通知してもらおう！]
(http://tech.albert2005.co.jp/blog/2014/07/10/notify-hipchat-from-jenkins/)