More RDD Ops - What is the role of the third argument numPartitions of... | Automated hands-on| CloudxLab

Apache Spark Basics

You are currently auditing this course.

77 / 89

Previous Index Next

What is the role of the third argument numPartitions of the sortBy function of an RDD?

Before sorting it would convert this RDD into those many partitions
This argument has no effect in normal circumstances. It is only used if the system does not have sufficient memory
The resulting RDD would have those many partitions

Previous Index Next

Loading comments...