[Pig - Lazy Evaluation]
In Pig, each processing step results in a new relation except for dump and store operator.
No value or operation is evaluated until the value or the transformed data is required. The actual processing of data starts when we submit the dump or store commands. Traditionally, While churning data we like to see transformed data at every step but while dealing with big data a lot of time would be wasted in repeated calculations to transform the data.
Lazy evaluation in pig reduces the repeated calculations, hence improves performance.
Loading comments...