Apache Spark - Actions - take & saveTextFile

Not able to play video? Try with vimeo

INSTRUCTIONS

Action example - take()

val arr = 1 to 1000000
val nums = sc.parallelize(arr)
def multipleByTwo(x:Int):Int = x*2

Write the following commands in a new cell:

var dbls = nums.map(multipleByTwo);
dbls.take(5)

Action example - saveAsTextFile()

val arr = 1 to 1000
val nums = sc.parallelize(arr)
def multipleByTwo(x:Int):Int = x*2

Write the following commands in a new cell:

var dbls = nums.map(multipleByTwo);
dbls.saveAsTextFile("mydirectory")

Note - In this video, we used Hue to access the results in HDFS. We have deprecated the Hue. Please use the below commands in the web console to access the files

Apache Spark Basics

Apache Spark - Actions - take & saveTextFile

XP

Loading comments...