Home > Software > BIGDATA > HADOOP
Interview Questions   Tutorials   Discussions   Programs   Videos   Discussion   

HADOOP - How many maps are there in a particular Job?




631
views
asked SRVMTrainings November 6, 2012 12:20 AM  

How many maps are there in a particular Job?


           

1 Answers



 
answered By Akshay Singh   0  
This answer is pending moderator approval Number of Mappers = Number of Splits
flag   
   add comment

 
answered By rajaniikanth   0  
The number of mappers are usually driven by the distributed file systems block size. For instance if the input file is 2GB and the block size is 64MB, the number of maps will be set to 32 (2000MB / 64MB). The reason why this is agood solution is because each mapper task will get its own block to work on. We followed this approach when we did the WordCount experiments and suggests that each machine
should execute between 10 and 100 mapper tasks.
Correct number of reducers must also be considered before executing a job. A function given as 1.75  (number of nodes  mapred.tasktracker.reduce.tasks.maximum) will make the faster nodes finish their initial round of reduces first, when the initial round is done they immediately start a new round. Load-balancing will be provided by following this approach . We followed this approach in theWord-Count experiments.
flag   
   add comment

Your answer

Join with account you already have

FF

Preview

 Write A Tutorials
Online-Classroom Classes
www.writeabc.com


  2 people following this question

  5 people following this tag

  Question tags

hadoop × 7

Asked 5 years and 2 months ago ago
Number of Views -631
Number of Answers -1
Last updated
2 years and 20 days ago ago

  Similar questions


Ready to start your tutorial with us? That's great! Send us an email and we will get back to you as soon as possible!

Alert