Login using Social Account
Login using your credentials
When we run spark with yarn, how does it discover the IP address of resource manger of YARN?
The spark need to be installed on the resource manager of Hadoop. It just uses localhost
It finds the configuration files in directory mentioned in environment variable YARN_CONF_DIR (earlier it used to be HADOOP_CONF_DIR)
We have to specify the IP of YARN resource manager while downloading spark
Taking you to the next exercise in seconds...
Stay here Next Exercise
Want to create exercises like this yourself? Click here.
No hints are availble for this assesment
Answer is not availble for this assesment
Go Back to the Course
1 Apache Spark - Running On Cluster - Architecture
2 Runing on cluster - User interacts with...
3 Runing on cluster - There are many driver nodes and one worker node...
4 Runing on cluster - Who converts the user programs into tasks:...
5 Runing on cluster - Where do tasks run?...
6 Apache Spark - Running On Cluster - Launching
7 Runing on cluster - A resource manager tracks the resources of a cluster and...
8 Runing on cluster - Which of the following is not a resource manager?...
9 Runing on cluster - Which statement is true about spark?...
10 Apache Spark - Running On Cluster - Local Mode
11 Runing on cluster - The pluggable component of spark that allows spark to run...
12 Runing on cluster - Local Mode can be used:...
13 Runing on cluster - How to run spark in local mode with 5 threads?...
14 Apache Spark - Running On Cluster - Cluster Mode - Standalone
15 Runing on cluster - Which command to use to check if spark is running...
16 Apache Spark - Running On Cluster - Cluster Mode - YARN
17 Runing on cluster - Standalone mode and local mode are same thing?...
18 Apache Spark - Running On Cluster - Cluster Mode - Mesos+AWS
19 Runing on cluster - Standalone mode basically uses an inbuild resource manager....
20 Apache Spark - Running On Cluster - Deployment Modes
21 Runing on cluster - When we run spark with yarn, how does it discover...
22 Runing on cluster - What is the value of --master and --deployment-mode options to...
23 Apache Spark - Running On Cluster - Slides
Loading comments...