Enrollments closing soon for Post Graduate Certificate Program in Applied Data Science & AI By IIT Roorkee | 3 Seats Left
01 D 17 H : 17 M : 56 S Apply Now
Want to create exercises like this yourself? Click here.
No hints are availble for this assesment
Answer is not availble for this assesment
Please login to comment
6 Comments
Looks like some of these are deprecated commands. Please update pdf:
> df = createDataFrame(spark, faithful)
Warning message:
'createDataFrame(sqlContext...)' is deprecated.
Use 'createDataFrame(data, schema = NULL)' instead.
See help("Deprecated")
> df = createDataFrame(faithful, schema=NULL)
> res = select(df, df$eruptions)
> head(res)
> people = read.df(spark, "/data/spark/people.json","json")
22/10/21 20:37:19 WARN DataSource: Error while looking for metadata directory.
Warning message:
'read.df(sqlContext...)' is deprecated.
Use 'read.df(path = NULL, source = NULL, schema = NULL, ...)' instead.
See help("Deprecated")
Thank you!
Upvote ShareIn which version have you tested these?
Upvote Sharespark2.4.3 (I see only 2.3,2.4.3 in usr directory)
Upvote ShareOhh,
So it may be due to the version mismatch as commands in pdf are tested on spark 2.0.1.
Upvote ShareCorrect, thats the reason I was requesting to update pdf if old versions are not supported by cloudxlab. Thanks
Upvote ShareThanks for the info Sarika. We will be looking into it shortly.
Upvote Share