More RDD Ops - What is the role of the third argument numPartitions of... | Automated hands-on| CloudxLab

Apache Spark Basics with Python

74 / 86

Previous Index Next

What is the role of the third argument numPartitions of the sortBy function of an RDD?

Before sorting it would convert this RDD into those many partitions
This argument has no effect in normal circumstances. It is only used if the system does not have sufficient memory
The resulting RDD would have those many partitions

Note - Having trouble with the assessment engine? Follow the steps listed here

Previous Index Next

Loading comments...