Home > Software > BIGDATA > HADOOP
Interview Questions   Tutorials   Discussions   Programs   Videos   Discussion   

HADOOP - Where is the Mapper Output (intermediate kay-value data) stored ?




739
views
asked SRVMTrainings November 8, 2012 04:25 AM  

Where is the Mapper Output (intermediate kay-value data) stored ?


           

1 Answers



 
answered By   0  
  1. Map tasks write their output to the local disk, not to HDFS. Why is this? Map output is intermediate output: it’s processed by reduce tasks to produce the final output, and once the job is complete the map output can be thrown away. So storing it in HDFS, with replication, would be overkill

flag   
   add comment

Your answer

Join with account you already have

FF

Preview


Ready to start your tutorial with us? That's great! Send us an email and we will get back to you as soon as possible!

Alert