Home > other >  The jobtracker pseudo-distributed mode and tasktracker problem could not be started
The jobtracker pseudo-distributed mode and tasktracker problem could not be started

Time:09-30

Tail -f hadoop - hadoop - jobtracker - h1. The log log content
STARTUP_MSG: Starting the JobTracker
STARTUP_MSG: host=h1/192.168.253.128
STARTUP_MSG: args=[]
STARTUP_MSG: version=0.20.2 - cdh3u3
STARTUP_MSG: build=git://ubuntu - slave01/var/lib/Jenkins/workspace/CDH3 - Selective/build/CDH3 hadoop20/0.20.2 cdh3u3/source - r - 318 bc781117fa276ae81a3d111f5eeba0020634f; Compiled by 'Jenkins' on Tue Mar 20 13:26:06 PDT 2012
* * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * */
===========================2015-03-06 01:39:34, 639 FATAL. Org. Apache hadoop. The mapred. JobTracker: Java. Lang. RuntimeException: Not a host: port pair: local
At org.apache.hadoop.net.NetUtils.createSocketAddr NetUtils. Java: (140)
At org.apache.hadoop.net.NetUtils.createSocketAddr NetUtils. Java: (124)
At org, apache hadoop. Mapred. JobTracker. GetAddress (2434) the JobTracker. Java:
At org, apache hadoop. Mapred. JobTracker. & lt; init> (the JobTracker. Java: 2057)
At org, apache hadoop. Mapred. JobTracker. & lt; init> (the JobTracker. Java: 2050)
At org, apache hadoop. Mapred. JobTracker. StartTracker (296) the JobTracker. Java:
At org, apache hadoop. Mapred. JobTracker. StartTracker (288) the JobTracker. Java:
At org, apache hadoop. Mapred. JobTracker. Main (4792) the JobTracker. Java:

The 2015-03-06 01:39:34, 643 INFO org. Apache. Hadoop. Mapred. JobTracker: SHUTDOWN_MSG:
/* * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * *
SHUTDOWN_MSG: Shutting down the JobTracker at h1/192.168.253.128
* * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * */

Hadoop - hadoop - tasktracker - h1. The log log content

STARTUP_MSG: Starting TaskTracker
STARTUP_MSG: host=h1/192.168.253.128
STARTUP_MSG: args=[]
STARTUP_MSG: version=0.20.2 - cdh3u3
STARTUP_MSG: build=git://ubuntu - slave01/var/lib/Jenkins/workspace/CDH3 - Selective/build/CDH3 hadoop20/0.20.2 cdh3u3/source - r - 318 bc781117fa276ae81a3d111f5eeba0020634f; Compiled by 'Jenkins' on Tue Mar 20 13:26:06 PDT 2012
* * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * */
The 2015-03-06 01:39:38, 094 ERROR org. Apache. Hadoop. Mapred. TaskTracker: Can not start the task tracker because Java. Lang. RuntimeException: not a host: port pair: local
At org.apache.hadoop.net.NetUtils.createSocketAddr NetUtils. Java: (140)
At org.apache.hadoop.net.NetUtils.createSocketAddr NetUtils. Java: (124)
At org, apache hadoop. Mapred. JobTracker. GetAddress (2434) the JobTracker. Java:
At org, apache hadoop. Mapred. TaskTracker. & lt; init> (TaskTracker. Java: 1576)
At org, apache hadoop. Mapred. TaskTracker. Main (3879) TaskTracker. Java:

The 2015-03-06 01:39:38, 097 INFO org. Apache. Hadoop. Mapred. TaskTracker: SHUTDOWN_MSG:
/* * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * *
SHUTDOWN_MSG: Shutting down TaskTracker at h1/192.168.253.128
* * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * */

Below is the profile information

[hadoop @ h1 conf] $cat core - site. XML
<? The XML version="1.0"?>
<? XML - stylesheet type="text/XSL" href="https://bbs.csdn.net/topics/configuration.xsl"?>




Fs. Default. Name
HDFS://h1:9000 & lt;/value>



[hadoop @ h1 conf] $cat HDFS - site. XML
<? The XML version="1.0"?>
<? XML - stylesheet type="text/XSL" href="https://bbs.csdn.net/topics/configuration.xsl"?>




DFS. Data. Dir
/home/hadoop/hadoop - data


DFS. Replication
1



[hadoop @ h1 conf] $cat mapred - site. XML
<? The XML version="1.0"?>
<? XML - stylesheet type="text/XSL" href="https://bbs.csdn.net/topics/configuration.xsl"?>




Mapred. Job. Tracker>
H1:9001 & lt;/value>


I just started to learn hadoop, found the pseudo-distributed mode xie jobtracker and tasktracker under two processes in start moving about 30 minutes later disappear,
See the log found above problem, but do the test including file is to take an examination of, wordcount test, all normal output job log,
Checked a lot of posts are not find out the problem, ask an expert or like me problems or predecessors to help give directions, thank you!

CodePudding user response:

I go online to check under the "Java. Lang. RuntimeException: Not a host: port pair: the local", saying is mapred. Job. The tracker is Not configured,
But you configuration, the only difference is I was pseudo-distributed is & lt; value> http://h1:9001
Write the HTTP, don't know is the problem?

CodePudding user response:

And the problem should be on hadoop, you ask, in the spark answer less people,
  • Related