What are combiners? When should I use a combiner in my MapReduce Job?
answered By  0
Combiner can minimize the data transferred between mapper and reducer. We can write combiner code same as reducer since instead of shuffling at a time at reducer, we can shuffle the same in mapper and can send the out put to the reducer.
For suppose your data may like this.
First mapper output without combiner: (1950, 0) (1950, 20) (1950, 10) And the second mapper output without combiner: (1950, 25) (1950, 15)
The reduce function would be called with a list of all the values without reducer : (1950, [0, 20, 10, 25, 15])
With combiner first mapper output (1950 , 20) Second mapper output (1950, 25) Reducer output (1950, 25)