Home > other >  Help: hadoop wordcount has been pending state graphs. The Job: Running Job: job_
Help: hadoop wordcount has been pending state graphs. The Job: Running Job: job_

Time:10-09

Structures, when single node pseudo distributed system, the configuration operation mode for the yarn (change to local run wordcount normal), has been no response, suspended,
To see a lot of posts, check for normal hosts, originally log has a wrning hint what storage is too small, no wrning, after adding the Linux memory

But the program still can not run normally,
Effect and the resourcemanager logs:




Server memory of 4 g:
 [hadoopuser @ hadoop101 logs] $free -m 
Total 2 free Shared buff/cache available
Mem: 8, 3774, 1509, 1869, 395, 1992
Swap: 2047 0, 2047


XML configuration: yarn - site.
 & lt; ! - Reducer for the way to get the data, & gt; 

Yarn. The nodemanager. Aux - services
Mapreduce_shuffle & lt;/value>



Yarn. The resourcemanager. Hostname
Hadoop101 & lt;/value>



Yarn. The log - aggregation - enable
True



Yarn. The log - aggregation. Retain - seconds
604800 & lt;/value>





Configuration: XML mapred - site.
 & lt; Configuration> 

Graphs. Framework. Name
Yarn


Graphs. Jobhistory. Address
Hadoop101:10020 & lt;/value>


Graphs. Jobhistory. Webapp. Address
Hadoop101:19888 & lt;/value>


CodePudding user response:

  • Related