Is this method of creating rdd correct: val myrdd = sc.parallelize(scala.io.Source.fromFile("./myfile").getLines.toList) ?

Apache Spark Basics with Python

Home
Assessment

36 / 86

Previous Index Next

Is this method of creating rdd correct: myrdd = sc.parallelize(open("./myfile").read().split())?

Yes
No, This method first reads data into the memory which would overflow if the file is big

XP

Taking you to the next exercise in seconds...

Want to create exercises like this yourself? Click here.

Note - Having trouble with the assessment engine? Follow the steps listed here

Result

Checking Please wait.

Success

Error

No hints are availble for this assesment

Answer is not availble for this assesment

Previous Index Next

Loading comments...

Apache Spark Basics with Python

1 Apache Spark with Python - Apache Spark Ecosystem

2 Apache Spark - What is not true about Apache spark?...

3 Apache Spark - What are advantages of using spark?...

4 Apache Spark - If you already have Apache Hadoop cluster setup, you can...

5 Apache Spark - If you need to process data continuously, which library you...

6 Apache Spark - If you need to provide a graph NoSQL storage, you...

7 Apache Spark - Spark does not provide API in which language?...

8 Apache Spark - Which of the following tasks are not possible using Apache...

9 Apache Spark with Python - Why Spark?

10 Apache Spark - Why is Spark faster than Hadoop?...

11 Apache Spark - Which of the following list is in increasing order in...

12 Getting Started with Spark using CloudxLab

13 Apache Spark with Python - Accessing Spark on CloudxLab

14 Apache Spark with Python - Cluster Installation (Optional)

15 Apache Spark - The command for running scala spark interactive shell is:...

16 Apache Spark - The command for talking to Spark using R with the interactive shell on CloudxLab is

17 Apache Spark - Which of the following is not a valid spark shell?...

18 Apache Spark - In Spark 1.x, which objects are provided by the spark-shell...

19 Apache Spark - In Spark 2.x, which objects are provided by the spark-shell...

20 Apache Spark - Whatever command you run on spark-shell or pyspark, they are...

21 Apache Spark - Which of the following is python code thats reads data...

22 Apache Spark - For running something unattended, which command would you use?...

23 Apache Spark with Python - What is an RDD?

24 Apache Spark - The fullform of RDD is...

25 Apache Spark - Which of the following is not true about RDD?...

26 Apache Spark - In case we are creating RDD using sc.textFile(), what does...

27 Apache Spark - In case, we are creating RDD using sc.parallelize(Array(1,2,3,4)), what would...

28 Apache Spark - An RDD is not analogous to:...

29 Apache Spark - Each partition is maintained and processed by:...

30 Apache Spark - The work interacting with Spark Applications is done by:...

31 Apache Spark - When we launch an spark-shell or pyspark, it also launches:...