I have two namenode, respectively is the master and hadoop1, the former is active, the latter is stadnby, but after the former into 50070 livenodes is zero, but we can see the directory structure, as shown in figure , and then hadoop1 50070 can see datanodes, as shown in figure

Then execute the HDFS - when they put operation error, 17/03/28 16:56:05 WARN HDFS. DFSClient: DataStreamer Exception
Org, apache hadoop. Ipc. RemoteException (Java. IO. IOException) : the File/user/ifcfg - em1. _COPYING_ could only be replicated to 0 home nodes minReplication (=1). There are 0 datanode (s) running and no node (s) are excluded in this operation.
At org, apache hadoop. HDFS. Server blockmanagement. BlockManager. ChooseTarget4NewBlock (BlockManager. Java: 1622)
At org, apache hadoop. HDFS. Server. The namenode. FSNamesystem. GetAdditionalBlock (FSNamesystem. Java: 3351)
At org, apache hadoop. HDFS. Server. The namenode. NameNodeRpcServer. AddBlock (NameNodeRpcServer. Java: 683)
At org, apache hadoop. HDFS. Server. The namenode. AuthorizationProviderProxyClientProtocol. AddBlock (AuthorizationProviderProxyClientProtocol. Java: 214)
At org, apache hadoop. HDFS. ProtocolPB. ClientNamenodeProtocolServerSideTranslatorPB. AddBlock (ClientNamenodeProtocolServerSideTranslatorPB. Java: 495)
At org, apache hadoop. HDFS. Protocol. The proto. ClientNamenodeProtocolProtos $ClientNamenodeProtocol $2. CallBlockingMethod (ClientNamenodeProtocolProtos. Java)
At org, apache hadoop. Ipc. ProtobufRpcEngine $$ProtoBufRpcInvoker Server. Call (617) ProtobufRpcEngine. Java:
At org, apache hadoop. Ipc. RPC $Server. The call (RPC) Java: 1073)
At org, apache hadoop. Ipc. Server $Handler $1. The run (2216) Server. Java:
At org, apache hadoop. Ipc. Server $Handler $1. The run (2212) Server. Java:
The at Java. Security. The AccessController. DoPrivileged (Native Method)
At javax.mail. Security. Auth. Subject. The doAs (422) Subject. Java:
At org, apache hadoop. Security. UserGroupInformation. DoAs (UserGroupInformation. Java: 1796)
At org, apache hadoop. Ipc. Server $Handler. The run (2210) Server. Java:

At org, apache hadoop. Ipc. Client. Call (1472). The Client Java:
At org, apache hadoop. Ipc. Client. Call (1409). The Client Java:
At org, apache hadoop. Ipc. ProtobufRpcEngine $Invoker. Invoke (ProtobufRpcEngine. Java: 230)
At com. Sun. Proxy. $Proxy10. AddBlock (Unknown Source)
At org, apache hadoop. HDFS. ProtocolPB. ClientNamenodeProtocolTranslatorPB. AddBlock (ClientNamenodeProtocolTranslatorPB. Java: 413)
At sun. Reflect. NativeMethodAccessorImpl. Invoke0 (Native Method)
At sun. Reflect. NativeMethodAccessorImpl. Invoke (NativeMethodAccessorImpl. Java: 62)
At sun. Reflect. DelegatingMethodAccessorImpl. Invoke (43) DelegatingMethodAccessorImpl. Java:
The at Java. Lang. Reflect. Method. Invoke (498) Method. The Java:
At org, apache hadoop. IO. Retry. RetryInvocationHandler. InvokeMethod (RetryInvocationHandler. Java: 256)
At org, apache hadoop. IO. Retry. RetryInvocationHandler. Invoke (RetryInvocationHandler. Java: 104)
At com. Sun. Proxy. $Proxy11. AddBlock (Unknown Source)
At org, apache hadoop. HDFS. DFSOutputStream $DataStreamer. LocateFollowingBlock (DFSOutputStream. Java: 1812)
At org, apache hadoop. HDFS. DFSOutputStream $DataStreamer. NextBlockOutputStream (DFSOutputStream. Java: 1608)
At org, apache hadoop. HDFS. DFSOutputStream $DataStreamer. Run (772) DFSOutputStream. Java:
Put: the File/user/ifcfg - em1. _COPYING_ could only be replicated to 0 home nodes minReplication (=1). There are 0 datanode (s) running and no node (s) are excluded in this operation.


According to the website to the format also not line, strives for the great god guidance!

CodePudding user response:

Hadoop1 can see livenodes , all four nodes datanoedes should be up

CodePudding user response:

Run the following command to check if there is any data nodes in the cluster:

HDFS dfsadmin - report

Trust the output from the command line. If it is the same as you saw in the web UI, then you may confuse yourself with 2 namenodes.