Resorce manager is a type of cluster manager. in Hadoop. and to run on a cluster, SparkContext can connect to several types of cluster managers (either Spark’s own standalone cluster manager, Mesos or YARN), which allocate resources across applications.
Different types are
1) Standalone – a simple cluster manager included with Spark that makes it easy to set up a cluster.
2) Apache Mesos – a general cluster manager that can also run Hadoop MapReduce and service applications.
3) Hadoop YARN – the resource manager in Hadoop 2.
4) Kubernetes – an open-source system for automating deployment, scaling, and management of containerized applications.
Please login to comment
2 Comments
Is there any difference between resource manager and cluster manager in Spark
Upvote ShareHi.
Resorce manager is a type of cluster manager. in Hadoop. and to run on a cluster, SparkContext can connect to several types of cluster managers (either Spark’s own standalone cluster manager, Mesos or YARN), which allocate resources across applications.
Different types are
1) Standalone – a simple cluster manager included with Spark that makes it easy to set up a cluster.
2) Apache Mesos – a general cluster manager that can also run Hadoop MapReduce and service applications.
3) Hadoop YARN – the resource manager in Hadoop 2.
4) Kubernetes – an open-source system for automating deployment, scaling, and management of containerized applications.
All the best!
4 Upvote Share