#Install pyspark on ubuntu how to#

This method is best for WSL (Windows Subsystem for Linux) Ubuntu: By now, if you run echo $JAVA_HOME you should get the expected output. Or you can exit this terminal and create another. bashrc file in the terminal again by running the following command.

We will add spark variables below it later. So run the following command in the terminal, vim ~/.bashrcДЇile opens. bashrc file is loaded to the terminal every time itвЂ™s opened. Now some versions of ubuntu do not run the /etc/environment file every time we open the terminal so itвЂ™s better to add it in the. The output should be: /usr/lib/jvm/java-8-openjdk-amd64 Later, in the terminal run source /etc/environmentДonвЂ™t forget to run the last line in the terminal, as that will create the environment variable and load it in the currently running shell. Then, in a new line after the PATH variable add JAVA_HOME='/usr/lib/jvm/java-8-openjdk-amd64' Set the $JAVA_HOME Environment VariableДЇor this, run the following in the terminal: sudo vim /etc/environment I got it in my default downloads folder where I will install spark. Remember the directory where you downloaded it.

OpenJDK 64-Bit Server VM (build 25.212-b03, mixed mode) If you donвЂ™t, run the following command in the terminal: sudo apt install openjdk-8-jdkДЄfter in stallation, if you type the java -versionВ in the terminal you will get: openjdk version '1.8.0_212' If you follow the steps, you should be able to install PySpark without any problem. My machine has ubuntu 18.04 and I am using Java 8 along with Anaconda3. We will install Java 8, Spark and configured all the environment variables.

#Install pyspark on ubuntu how to#

In this tutorial, we will see How to Install PySpark with JAVA 8 on Ubuntu 18.04?