Home > OS >  Azkaban perform kettle homework 15 minutes not finish will be an error
Azkaban perform kettle homework 15 minutes not finish will be an error

Time:11-17

Problem description:
Design: the kettle work is to use wait for plug-in scan file, file is loaded into the database, no files continued to wait for, waiting to set the maximum 2 hours no files are out of time, the scheduling tool use is azkaban, azkaban shell, shell in tuning up the kettle script,
Now find azkaban tuning up, if more than 15 minutes no files will be an error, or a file data file in 15 minutes, but was not performed in 15 minutes, kettle displays the success, but azkaban return is wrong,
The first type of error is as follows:
2019/11/29 15:20:54. 273 + 0800 INFO [FlowRunnerManager] [Azkaban] Cleaning the recently finished
2019/11/29 15:21:12. 398 + 0800 INFO [ExecutorServlet] [Azkaban] User null has called the action log on 8
2019/11/29 15:21:42. 441 + 0800 INFO [ExecutorServlet] [Azkaban] User null has called the action log on 8
Java. Lang. RuntimeException: azkaban. JobExecutor. Utils. Process. ProcessFailureException
The at azkaban. JobExecutor. ProcessJob. Run (ProcessJob. Java: 94)
The at azkaban. Execapp. JobRunner. RunJob (JobRunner. Java: 516)
The at azkaban. Execapp. JobRunner. Run (JobRunner. Java: 436)
The at Java. Util. Concurrent. Executors $RunnableAdapter. Call (511) Executors. Java:
The at Java. Util. Concurrent. FutureTask. Run (FutureTask. Java: 266)
The at Java. Util. Concurrent. ThreadPoolExecutor. RunWorker (ThreadPoolExecutor. Java: 1149)
The at Java. Util. Concurrent. ThreadPoolExecutor $Worker. The run (ThreadPoolExecutor. Java: 624)
The at Java. Lang. Thread. The run (Thread. Java: 748)
Under Caused by: azkaban. JobExecutor. Utils. Process. ProcessFailureException
The at azkaban. JobExecutor. Utils. Process. AzkabanProcess. Run (98) AzkabanProcess. Java:
The at azkaban. JobExecutor. ProcessJob. Run (ProcessJob. Java: 88)
. 7 more
2019/11/29 15:22:01. 260 + 0800 INFO [MOVE_FILES] [Azkaban] Job O_LA_CM_GROUP finished with status FAILED in 1186 seconds
2019/11/29 15:22:01. 260 + 0800 INFO [MOVE_FILES] [Azkaban] Setting MOVE_FILES to FAILED_FINISHING
2019/11/29 15:22:01. 273 + 0800 INFO [MOVE_FILES] [Azkaban] No attachment file for job O_LA_CM_GROUP written.
Uploading flowId MOVE_FILES
The second error is as follows:
The 29-11-2019 15:41:31 CST O_LA_PTY_INDIV_REL INFO - 2019/11/29 15:41:22 - input text file. 0-48450000
linenrThe 29-11-2019 15:41:31 CST O_LA_PTY_INDIV_REL INFO - 2019/11/29 15:41:23 - input text file. 0-48500000
linenrThe 29-11-2019 15:41:31 CST O_LA_PTY_INDIV_REL INFO - 2019/11/29 15:41:23 - table output. 0-24250000
linenrThe 29-11-2019 15:41:31 CST O_LA_PTY_INDIV_REL INFO - 2019/11/29 15:41:23 - table output. 1-24250000
linenrThe 29-11-2019 15:41:31 CST O_LA_PTY_INDIV_REL INFO - 2019/11/29 15:41:23 - input text file. 0-48550000
linenrThe 29-11-2019 15:41:31 CST O_LA_PTY_INDIV_REL INFO - 2019/11/29 15:41:30 - input text file. 0 - Finished processing (I=48571912, O=0, R=0, W=48571912, U=1, E=0)
The 29-11-2019 15:41:31 CST O_LA_PTY_INDIV_REL INFO - 2019/11/29 15:41:30 - oracle - the Connection to the database closed!
The 29-11-2019 15:41:31 CST O_LA_PTY_INDIV_REL INFO - 2019/11/29 15:41:30 - table output. 0 - Finished processing (I=0, O=24285956, R=24285956, W=24285956, U=0, E=0)
The 29-11-2019 15:41:31 CST O_LA_PTY_INDIV_REL INFO - 2019/11/29 15:41:30 - oracle - the Connection to the database closed!
The 29-11-2019 15:41:31 CST O_LA_PTY_INDIV_REL INFO - 2019/11/29 15:41:30 - table output. 1 - Finished processing (I=0, O=24285956, R=24285956, W=24285956, U=0, E=0)
The 29-11-2019 15:41:31 CST O_LA_PTY_INDIV_REL INFO - 2019/11/29 15:41:30 O_LA_PTY_INDIV_REL - Starting entry [success]
The 29-11-2019 15:41:31 CST O_LA_PTY_INDIV_REL INFO - 2019/11/29 15:41:30 O_LA_PTY_INDIV_REL - exec (3, 0, success. 0)
The 29-11-2019 15:41:31 CST O_LA_PTY_INDIV_REL INFO - 2019/11/29 15:41:30 - successful - Starting job entry
The 29-11-2019 15:41:31 CST O_LA_PTY_INDIV_REL INFO - 2019/11/29 15:41:30 O_LA_PTY_INDIV_REL - Finished job entry [success] (result=[true])
The 29-11-2019 15:41:31 CST O_LA_PTY_INDIV_REL INFO - 2019/11/29 15:41:30 O_LA_PTY_INDIV_REL - Finished job entry [O_LA_PTY_INDIV_REL] (result=[true])
29-11-2019 15:41:31 CST O_LA_PTY_INDIV_REL INFO - 2019/11/29 15:41:30 O_LA_PTY_INDIV_REL - Finished job entry/waiting for the file (result=[true])
The 29-11-2019 15:41:31 CST O_LA_PTY_INDIV_REL INFO - 2019/11/29 15:41:30 O_LA_PTY_INDIV_REL - Job execution finished
The 29-11-2019 15:41:31 CST O_LA_PTY_INDIV_REL INFO - 2019/11/29 15:41:30 - Kitchen - Finished!
The 29-11-2019 15:41:31 CST O_LA_PTY_INDIV_REL INFO - 2019/11/29 15:41:30 - Kitchen - Start=2019/11/29 15:02:22. 164, the Stop=2019/11/29 15:41:30. 877
The 29-11-2019 15:41:31 CST O_LA_PTY_INDIV_REL INFO - 2019/11/29 15:41:30 - Kitchen - Processing ended after 39 minutes and 8 seconds (2348 seconds total).
The 29-11-2019 15:41:31 CST O_LA_PTY_INDIV_REL INFO - the Process completed unsuccessfully in 2356 seconds.
The 29-11-2019 15:41:31 CST O_LA_PTY_INDIV_REL ERROR - Job run failed!
The 29-11-2019 15:41:31 CST O_LA_PTY_INDIV_REL ERROR - azkaban. JobExecutor. Utils. Process. ProcessFailureExceptionazkaban. JobExecutor. Utils. Process. ProcessFailureException
The 29-11-2019 15:41:31 CST O_LA_PTY_INDIV_REL INFO - Finishing the job O_LA_PTY_INDIV_REL at 1575013291347 with the status FAILED
Excuse me each warrior has to know why

CodePudding user response:

Hello, the second error solved? How to solve of, I also quote the same error, please advise

CodePudding user response:

With q ~ ~ ~ ~
  • Related