Apache Spark - Key-Value or Pair RDD - What does this code do?

Apache Spark - Key Value RDD

You are currently auditing this course.

8 / 11

What would the following code do?

var inputdata = List((1,2.0),(1,12.0),(1,4.0), (1, 6.0))
var kvrdd = sc.parallelize(inputdata)
def avg(a:Double, b:Double): Double = {
    return (a+b)/2
}
val out = kvrdd.reduceByKey(avg)
out.collect()

Prints the average i.e. (1, 6.0)
Prints the max i.e. (1, 12)
Does not print average.
Prints the median i.e. (1, 5.0)

Previous Index Next

Apache Spark - Key Value RDD

XP

Loading comments...