Home > other >  Hadoop cluster set up after the start
Hadoop cluster set up after the start

Time:09-25

After the construction of the hadoop cluster, start, and then the JPS, could not see any process

CodePudding user response:

The namenode log
[code=2016-09-25 18:39:57, 769 INFO org. Apache. Hadoop. HDFS. Server. The namenode. The namenode: STARTUP_MSG:
/* * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * *
STARTUP_MSG: Starting the NameNode
STARTUP_MSG: host=backup01/192.168.1.116
STARTUP_MSG: args=[]
STARTUP_MSG: version=1.2.1
STARTUP_MSG: build=https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1.2 - r 1503152; Compiled by 'mattf on Mon Jul 22 15:23:09 PDT 2013
STARTUP_MSG: Java=1.8.0 comes with _101
* * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * */
The 2016-09-25 18:40:00, 375 INFO org. Apache. Hadoop. Metrics2. Impl. MetricsConfig: the loaded properties from hadoop - metrics2. Properties
The 2016-09-25 18:40:00, 521 INFO org. Apache. Hadoop. Metrics2. Impl. MetricsSourceAdapter: an a for source MetricsSystem, sub=Stats registered.
The 2016-09-25 18:40:00, 625 INFO org. Apache. Hadoop. Metrics2. Impl. MetricsSystemImpl: Scheduled snapshot period at 10 second (s).
The 2016-09-25 18:40:00, 625 INFO org. Apache. Hadoop. Metrics2. Impl. MetricsSystemImpl: NameNode metrics system started
The 2016-09-25 18:40:00, 651 ERROR org. Apache. Hadoop. HDFS. Server. The namenode. The namenode: Java. Lang. IllegalArgumentException: Illegal character in authority at the index 7: HDFS://backup01:9000
At java.net.URI.create (URI. Java: 852)
At org, apache hadoop. Fs. FileSystem. GetDefaultUri (132) FileSystem. Java:
At org, apache hadoop. HDFS. Server. The namenode. The namenode. GetAddress (244). The namenode Java:
At org, apache hadoop. HDFS. Server. The namenode. The namenode. The initialize (280). The namenode Java:
At org, apache hadoop. HDFS. Server. The namenode. The namenode. & lt; init> (the NameNode. Java: 569)
At org, apache hadoop. HDFS. Server. The namenode. The namenode. CreateNameNode (1479). The namenode Java:
At org, apache hadoop. HDFS. Server. The namenode. The namenode. Main (1488). The namenode Java:
Under Caused by: java.net.URISyntaxException: Illegal character in authority at the index 7: HDFS://backup01:9000
At java.net.URI$Parser.fail (URI. Java: 2848)
At java.net.URI$Parser.parseAuthority (URI. Java: 3186)
At java.net.URI$Parser.parseHierarchical (URI. Java: 3097)
At java.net.URI$Parser.parse (URI. Java: 3053)
The at java.net.URI. (URI. Java: 588)
At java.net.URI.create (URI. Java: 850)
. Six more

The 2016-09-25 18:40:00, 700 INFO org. Apache. Hadoop. HDFS. Server. The namenode. The namenode: SHUTDOWN_MSG:
/* * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * *
SHUTDOWN_MSG: Shutting down the NameNode at backup01/192.168.1.116] [/code]

CodePudding user response:

The JobTracker log [code=2016-09-25 18:39:59, 642 INFO org. Apache. Hadoop. Mapred. JobTracker: STARTUP_MSG:
/* * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * *
STARTUP_MSG: Starting the JobTracker
STARTUP_MSG: host=backup01/192.168.1.116
STARTUP_MSG: args=[]
STARTUP_MSG: version=1.2.1
STARTUP_MSG: build=https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1.2 - r 1503152; Compiled by 'mattf on Mon Jul 22 15:23:09 PDT 2013
STARTUP_MSG: Java=1.8.0 comes with _101
* * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * */
The 2016-09-25 18:40:00, 772 INFO org. Apache. Hadoop. Metrics2. Impl. MetricsConfig: the loaded properties from hadoop - metrics2. Properties
The 2016-09-25 18:40:00, 863 INFO org. Apache. Hadoop. Metrics2. Impl. MetricsSourceAdapter: an a for source MetricsSystem, sub=Stats registered.
The 2016-09-25 18:40:00, 888 INFO org. Apache. Hadoop. Metrics2. Impl. MetricsSystemImpl: Scheduled snapshot period at 10 second (s).
The 2016-09-25 18:40:00, 888 INFO org. Apache. Hadoop. Metrics2. Impl. MetricsSystemImpl: JobTracker metrics system started
The 2016-09-25 18:40:01, 343 INFO org. Apache. Hadoop. Metrics2. Impl. MetricsSourceAdapter: an a for source QueueMetrics, q=default registered.
The 2016-09-25 18:40:03, 377 INFO org. Apache. Hadoop. Metrics2. Impl. MetricsSourceAdapter: an a for the source the ugi registered.
The 2016-09-25 18:40:03, 378 WARN org. Apache. Hadoop. Metrics2. Impl. MetricsSystemImpl: Source name the ugi already exists!
The 2016-09-25 18:40:03, 380 INFO org. Apache. Hadoop. Security. Token. Delegation. AbstractDelegationTokenSecretManager: Updating the current master key for generating delegation tokens
The 2016-09-25 18:40:03, 395 INFO org. Apache. Hadoop. Mapred. JobTracker: Scheduler configured with (memSizeForMapSlotOnJT memSizeForReduceSlotOnJT, limitMaxMemForMapTasks, limitMaxMemForReduceTasks) (1, 1, 1, 1)
The 2016-09-25 18:40:03, 397 INFO org. Apache. Hadoop. Util. HostsFileReader: Refreshing hosts (include/exclude) list
The 2016-09-25 18:40:03, 406 INFO org. Apache. Hadoop. Security. Token. Delegation. AbstractDelegationTokenSecretManager: Starting expired delegation token remover thread, tokenRemoverScanInterval=60 min (s)
nullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnull
  • Related