HADOOP version 2.4.0 JDK 1.7.0
Code:
in the mapFSDataOutputStream out=fs. The create (tmpPath, true);
if (! FTP download (src_file, out)) {
The log. The error (10014, "download file" + src_file + "failure, patch:
"+ collectId);
out.close();
}
Error:
Org.apache.commons.net.io.CopyStreamException: IOException caught while copying.
The at org.apache.commons.net.io.Util.copyStream Util. Java: (135)
At org.apache.commons.net.ftp.FTPClient._retrieveFile FTPClient. Java: (1695)
At org.apache.commons.net.ftp.FTPClient.retrieveFile FTPClient. Java: (1669)
At com. Eshore. Icps. FTP. FTP. Download (FTP) Java: 119)
At com. Eshore. Icps. Collect. CollectMapper. The map (CollectMapper. Java: 228)
At com. Eshore. Icps. Collect. CollectMapper. Run (99) CollectMapper. Java:
At org, apache hadoop. Mapred. MapTask. RunNewMapper (MapTask. Java: 764)
At org, apache hadoop. Mapred. MapTask. Run (340) MapTask. Java:
At org, apache hadoop. Mapred. YarnChild $2. The run (167) YarnChild. Java:
The at Java. Security. The AccessController. DoPrivileged (Native Method)
At javax.mail. Security. Auth. Subject. The doAs (415) Subject. Java:
At org, apache hadoop. Security. UserGroupInformation. DoAs (UserGroupInformation. Java: 1557)
At org, apache hadoop. Mapred. YarnChild. Main (162) YarnChild. Java:
Under Caused by: Java nio. Channels. ClosedChannelException
At org, apache hadoop. HDFS. DFSOutputStream. CheckClosed (DFSOutputStream. Java: 1528)
At org, apache hadoop. Fs. FSOutputSummer. Write (FSOutputSummer. Java: 98)
At org, apache hadoop. Fs. FSDataOutputStream $PositionCache. Write (58) FSDataOutputStream. Java:
The at Java. IO. DataOutputStream. Write (DataOutputStream. Java: 107)
The at org.apache.commons.net.io.Util.copyStream Util. Java: (123)
. 12 more


Can download success, such as had to download 10 files, download success for two, start to download the third card for a while will quote this error, is commonly encountered a large file, speed of around 300 k/S