MapReduce Programming

4 / 13
Previous Index Next  

Writing MapReduce code using Eclipse (Windows)




Not able to play video? Try with youtube

It is a walkthrough of building MapReduce programs. There is no editing in the video so it might be a bit slow.

  • Login to CloudxLab

  • Checkout the code: git clone https://github.com/cloudxlab/bigdata.git

  • Compile cd bigdata/hdpexamples/java ant jar

Developer Machine

  • Install JDK
  • Install Scala IDE
  • Install Github desktop
  • Compile and Export Package
  • Install WinScp
  • Upload

To Run wordcount MapReduce, use: hadoop jar build/jar/hdpexamples.jar com.cloudxlab.wordcount.StubDriver


Previous Index Next  
Please login to comment

3 Comments

Manish Singh
 3 years ago 

how will do testing from the local? when the code is there in the hadoop?

 

  Upvote    Share
Manish Singh
 3 years ago 

http://cxln2.c.thelab-240901.internal:8088/proxy/application_1627727389933_10593/ I am unable to access job with the url shown in console.

 2  Upvote    Share
Manish Singh
 3 years ago 

hue is not available in. the lab credential console, how to access  the hue?

 1  Upvote    Share