Skip to content Skip to sidebar Skip to footer

Hadoop-streaming : Reduce Task In Pending State Says "No Room For Reduce Task."

My map task completes successfully and I can see the application logs, but reducer stays in pending state Kind % Complete Num Tasks Pending Running Complete Killed Fail

Solution 1:

Your disk on the host where the reducer is run is too small. Your reducer input takes approx. 172 gbs, but you have only 63gb free.

Maybe combiner could be useful for you. Have a look here: http://tumblr.mobocracy.net/post/6589143971/using-a-combiner-with-hadoop-jobs


Post a Comment for "Hadoop-streaming : Reduce Task In Pending State Says "No Room For Reduce Task.""