Purpose: Apache Spark is an open-source unified analytics engine for large-scale data processing. Spark provides an interface for programming entire clusters with implicit data parallelism and fault tolerance.
Home Page: https://spark.apache.org/
Documentation: https://spark.apache.org/docs/latest/
Related resources to learn: https://cloudxlab.com/assessment/playlist-intro/17/apache-spark-basics?course_id=1&playlist_id=17
https://cloudxlab.com/blog/running-pyspark-jupyter-notebook/
How to get started:
In the web console tab on the right side of the screen, type the following code to runs spark scala interactive command line
spark-shell
Type the following code to runs python spark interactive command line
pyspark
Type the following code to runs R on spark (/usr/spark2.6/bin/sparkR)
sparkR
Type the following code to submit a jar or python application for execution on cluster
spark-submit
Type the following code to runs the spark sql interactive shell
spark-sql
Taking you to the next exercise in seconds...
No hints are availble for this assesment
Answer is not availble for this assesment
Loading comments...