Home > other >  MySql will table the import to the HDFS: import failed: Java. IO. FileNotFoundException
MySql will table the import to the HDFS: import failed: Java. IO. FileNotFoundException

Time:05-15

The younger brother is to establish the hadoop cluster ambari + HDP,
The mysql table with sqoop import HDFS, when test to the question,

 bin/sqoop import - connect JDBC: mysql://huawang01:3306/testdb - username ambari - password ambari - table user -- target - dir/hdfstest - num - mappers 1 - fields - terminated - by ", "
Warning:/usr/HDP/3.0.1.0-187/accumulo does not exist! Accumulo imports will fail.
Both Please set $ACCUMULO_HOME to the root of your Accumulo installation.
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found the binding in [the jar: file:/usr/HDP/3.0.1.0-187/hadoop/lib/SLF4J - log4j12-1.7.25. Jar!/org/SLF4J/impl/StaticLoggerBinder class]
SLF4J: Found the binding in [the jar: file:/usr/HDP/3.0.1.0-187/hive/lib/log4j - SLF4J - impl - 2.10.0. Jar!/org/SLF4J/impl/StaticLoggerBinder class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org. SLF4J. Impl. Log4jLoggerFactory]
21/05/14 17:33:33 INFO sqoop. Sqoop: Running sqoop version: 1.4.7.3.0.1.0-187
21/05/14 17:33:33 WARN tool. BaseSqoopTool: Setting your password on the command - line is insecure. Consider using - P home.
21/05/14 17:33:33 INFO manager. MySQLManager: Preparing to use a MySQL streaming resultset.
21/05/14 17:33:33 INFO tool. CodeGenTool: Beginning code generation
Fri May 14 17:33:33 CST 2021 WARN: Establishing SSL connection without server's identity verification is not recommended. According to MySQL 5.5.45+, 5.6.26+ and 5.7.6+ requirements SSL connection must be established by default if explicit option isn't set. For compliance with existing applications not using SSL the verifyServerCertificate property is set to 'false'. You need either to explicitly disable SSL by setting useSSL=false, or set useSSL=true and provide truststore for server certificate verification.
21/05/14 17:33:34 INFO manager. SqlManager: Executing SQL statement: SELECT * FROM t. ` user ` AS t LIMIT 1
21/05/14 17:33:34 INFO manager. SqlManager: Executing SQL statement: SELECT * FROM t. ` user ` AS t LIMIT 1
21/05/14 17:33:34 INFO orm.Com pilationManager: HADOOP_MAPRED_HOME is/usr/HDP/3.0.1.0-187/hadoop - graphs
Orm.Com pilationManager 21/05/14 17:33:36 ERROR: Could not rename/TMP/sqoop - root/compile/463 f32d0a76d659f9596cd40430732ef/user. Java to/usr/HDP/3.0.1.0-187/sqoop/./user. Java. ERROR: Destination '/usr/HDP/3.0.1.0-187/sqoop/./user. Java' already exists
21/05/14 17:33:36 INFO orm.Com pilationManager: Writing jar file:/TMP/sqoop - root/compile/463 f32d0a76d659f9596cd40430732ef/user. The jar
21/05/14 17:33:36 WARN manager. MySQLManager: It looks like you are importing from mysql.
21/05/14 17:33:36 WARN manager. MySQLManager: This transfer can be faster -! Use the - direct
21/05/14 17:33:36 WARN manager. MySQLManager: option to exercise a MySQL - specific fast path.
21/05/14 17:33:36 INFO manager. MySQLManager: Setting the zero DATETIME behaviors to convertToNull (mysql)
21/05/14 17:33:36 INFO graphs. ImportJobBase: Beginning the import of user
21/05/14 17:33:37 INFO client. RMProxy: Connecting to the ResourceManager at huawang01/192.168.0.43:8050
21/05/14 17:33:37 INFO client. AHSProxy: Connecting to the Application History server at huawang02/192.168.0.44:10200
21/05/14 17:33:37 ERROR tool. ImportTool: Import failed: Java. IO. FileNotFoundException: File does not exist: HDFS://huawang01:8020/HDP/apps/3.0.1.0-187/graphs/graphs. Tar. Gz
At org, apache hadoop. Fs. Hdfs. GetFileStatus (Hdfs. Java: 145)
At org, apache hadoop. Fs. AbstractFileSystem. ResolvePath (AbstractFileSystem. Java: 488)
At org, apache hadoop. Fs. FileContext $25. The next (FileContext. Java: 2292)
At org, apache hadoop. Fs. FileContext $25. The next (FileContext. Java: 2288)
At org, apache hadoop. Fs. FSLinkResolver. Resolve (FSLinkResolver. Java: 90)
At org, apache hadoop. Fs. FileContext. Resolve (FileContext. Java: 2294)
At org, apache hadoop. Fs. FileContext. ResolvePath (FileContext. Java: 611)
At org, apache hadoop. Graphs. JobSubmitter. AddMRFrameworkToDistributedCache (JobSubmitter. Java: 460)
At org, apache hadoop. Graphs. JobSubmitter. SubmitJobInternal (JobSubmitter. Java: 146)
At org, apache hadoop. Graphs. The Job at $11. The run (1570) Job. Java:
At org, apache hadoop. Graphs. The Job at $11. The run (1567) Job. Java:
The at Java. Security. The AccessController. DoPrivileged (Native Method)
At javax.mail. Security. Auth. Subject. The doAs (422) Subject. Java:
At org, apache hadoop. Security. UserGroupInformation. DoAs (UserGroupInformation. Java: 1730)
At org, apache hadoop. Graphs. Job. Submit (1567) Job. Java:
At org, apache hadoop. Graphs. Job. WaitForCompletion (1588) Job. Java:
The at org. Apache. Sqoop. Graphs. ImportJobBase. DoSubmitJob (ImportJobBase. Java: 196)
The at org. Apache. Sqoop. Graphs. ImportJobBase. RunJob (ImportJobBase. Java: 169)
The at org. Apache. Sqoop. Graphs. ImportJobBase. RunImport (ImportJobBase. Java: 266)
The at org. Apache. Sqoop. Manager. SqlManager. ImportTable (SqlManager. Java: 692)
nullnullnullnullnullnullnullnullnullnullnullnullnullnull
  • Related