Home > Software > BIGDATA > HADOOP
Interview Questions   Tutorials   Discussions   Programs   Videos   Discussion   

HADOOP - How many maps are there in a particular Job?

asked SRVMTrainings November 6, 2012 12:20 AM  

How many maps are there in a particular Job?


1 Answers

answered By Akshay Singh   0  
This answer is pending moderator approval Number of Mappers = Number of Splits
   add comment

answered By rajaniikanth   0  
The number of mappers are usually driven by the distributed file systems block size. For instance if the input file is 2GB and the block size is 64MB, the number of maps will be set to 32 (2000MB / 64MB). The reason why this is agood solution is because each mapper task will get its own block to work on. We followed this approach when we did the WordCount experiments and suggests that each machine
should execute between 10 and 100 mapper tasks.
Correct number of reducers must also be considered before executing a job. A function given as 1.75  (number of nodes  mapred.tasktracker.reduce.tasks.maximum) will make the faster nodes finish their initial round of reduces first, when the initial round is done they immediately start a new round. Load-balancing will be provided by following this approach . We followed this approach in theWord-Count experiments.
   add comment

Your answer

Join with account you already have



 Write A Tutorials
Online-Classroom Classes

  2 people following this question

  4 people following this tag

  Question tags

hadoop × 7

Asked 4 years and 18 days ago ago
Number of Views -406
Number of Answers -1
Last updated
11 months and 3 days ago ago

  Similar questions

Ready to start your tutorial with us? That's great! Send us an email and we will get back to you as soon as possible!