Enrollments Open for Advanced Certification Courses on Data Science, ML & AI by E&ICT Academy IIT Roorkee

  Apply Now

Pig - Relational Operators - FOREACH

[Pig - Relational Operators - FOREACH]

FOREACH operator generates data transformations based on columns of data.

Let's say, we want to store just stock_symbol and dividends in HDFS for further processing. We can do it using the FOREACH operator. Let's do it. Launch pig, load the data, take only stock_symbol and dividends columns, and store it in a new file in HDFS. As discussed earlier, note that Pig will start the execution only when we specify dump or store command. See the content of the file to verify the result.

[Pig - FOREACH - Question]

Question - Will the code displayed on the screen, generate any reducer code?

Answer - No, as we are not doing any aggregation or sorting.


divs = LOAD '/data/NYSE_dividends' AS (name:chararray, stock_symbol:chararray, date:chararray, dividends:float);
values = FOREACH divs GENERATE stock_symbol, dividends;
STORE values INTO 'values_1';
cat values_1

No hints are availble for this assesment

Answer is not availble for this assesment

Loading comments...