To access Spark 2.3, type below commands in the web console
- pyspark (For Python)
- spark-shell (For Scala)
To access Spark 1.6, first set the version in the web console
export SPARK_MAJOR_VERSION=1
And then type below commands in the web console
- pyspark (For Python)
- spark-shell (For Scala)
How to set the Spark versions while submitting a python file using spark-submit?
How to set the Spark versions while submitting a python file using spark-submit?
How to set the Spark versions while submitting a python file using spark-submit?
How to set the Spark versions while submitting a python file using spark-submit?
How to set the Spark versions while submitting a python file using spark-submit?
Use the following command:
/usr/spark2.0.1/bin/spark-submit .py
Unable to access spark web UI. please someone help on this
Hi @@disqus_kHMvwVhqLj:disqus ,
Can you please let me know what problem are you facing?