Machine Learning with Spark

Starting Machine Learning with Apache Spark (http://spark.apache.org/docs/latest/index.html). First setup Java via HomeBrew:

$ brew cask install java

And then add in the Java Home environment variable (as recommended by Apple).

$ vim ~/.bash_profile
export JAVA_HOME=$(/usr/libexec/java_home)

Setup and run apache-spark in python mode interactively.

$ brew install apache-spark

$ pyspark –master local[2]

…

References

• http://www.mkyong.com/java/how-to-set-java_home-environment-variable-on-mac-os-x/