Compiling From Source

For a different Spark version or compiling latest code

If you need to compile the latest code or build for a different Spark version, you can clone this repo and

• Install maven

• Install JDK 1.8

• Set JAVA_HOME to JDK base directory

• Install Apache Spark (version spark-3.5.0-bin-hadoop3)

• Set SPARK_HOME as path to location of Apache Spark

• Set SPARK_MASTER as local[*]

• Run the following: mvn clean install -U -> mvn initialize -> mvn clean compile package