Access Spark 1.6 and Spark 2.3 on CloudxLab

To access Spark 2.3, type below commands in the web console

  • pyspark (For Python)
  • spark-shell (For Scala)

To access Spark 1.6, first set the version in the web console

export SPARK_MAJOR_VERSION=1

And then type below commands in the web console

  • pyspark (For Python)
  • spark-shell (For Scala)

Author