18:07:13 2015-10-01, 627, WARN ShellActionExecutor: 544 - SERVER [hadoop-senior.ibeifeng.com] USER GROUP [beifeng] [-] TOKEN [] APP [shell - wf] JOB [0000018-151001122846380 - oozie - beif - W] ACTION [0000018-151001122846380 - oozie - beif - W @ shell - node] the Launcher exception: always run the program "select. Sh" (in the directory "/opt/CDH - 5.3.6/hadoop - 2.5.0 - cdh5.3.6/data/nm - local - dir/usercache/beifeng/appcache application_1443616625551_0030/container_1443616625551_0030_01_000002") : error=2, No to the file or directory
Java. IO. IOException: always run the program "select. Sh" (in the directory "/opt/CDH - 5.3.6/hadoop - 2.5.0 - cdh5.3.6/data/nm - local - dir/usercache/beifeng/appcache application_1443616625551_0030/container_1443616625551_0030_01_000002") : error=2, No to the file or directory
The at Java. Lang. ProcessBuilder. Start (ProcessBuilder. Java: 1047)
The at org. Apache. Oozie. Action. Hadoop. ShellMain. Execute (ShellMain. Java: 93)
The at org. Apache. Oozie. Action. Hadoop. ShellMain. Run (55) ShellMain. Java:
The at org. Apache. Oozie. Action. Hadoop. LauncherMain. Run (39) LauncherMain. Java:
The at org. Apache. Oozie. Action. Hadoop. ShellMain. Main (ShellMain. Java: 47)
At sun. Reflect. NativeMethodAccessorImpl. Invoke0 (Native Method)
At sun. Reflect. NativeMethodAccessorImpl. Invoke (NativeMethodAccessorImpl. Java: 57)
At sun. Reflect. DelegatingMethodAccessorImpl. Invoke (43) DelegatingMethodAccessorImpl. Java:
The at Java. Lang. Reflect. Method. Invoke (606) Method. The Java:
The at org. Apache. Oozie. Action. Hadoop. LauncherMapper. The map (LauncherMapper. Java: 227)
At org, apache hadoop. Mapred. MapRunner. Run (MapRunner. Java: 54)
At org, apache hadoop. Mapred. MapTask. RunOldMapper (MapTask. Java: 450)
At org, apache hadoop. Mapred. MapTask. Run (343) MapTask. Java:
At org, apache hadoop. Mapred. YarnChild $2. The run (168) YarnChild. Java:
The at Java. Security. The AccessController. DoPrivileged (Native Method)
At javax.mail. Security. Auth. Subject. The doAs (415) Subject. Java:
At org, apache hadoop. Security. UserGroupInformation. DoAs (UserGroupInformation. Java: 1642)
At org, apache hadoop. Mapred. YarnChild. Main (163) YarnChild. Java:
Under Caused by: Java. IO. IOException: error=2, No to the file or directory
The at Java. Lang. UNIXProcess. ForkAndExec (Native Method)
The at Java. Lang. UNIXProcess. & lt; Init> (UNIXProcess. Java: 186)
The at Java. Lang. ProcessImpl. Start (ProcessImpl. Java: 130)
The at Java. Lang. ProcessBuilder. Start (ProcessBuilder. Java: 1028)

My job attribute configuration is as follows
nameNode=hdfs://hadoop-senior.ibeifeng.com: 8020
JobTracker=hadoop-senior.ibeifeng.com: 8032
QueueName=default
AppRoot=oozie - apps
Oozie. Use. System. Libpath=true
Oozie. Wf. Application. The path=${nameNode}/user/${user. The name}/${appRoot}/shell
The EXEC=select. Sh
SCRIPT=hiveselect. SQL


My workflow configuration is as follows

The ${jobTracker} & lt;/job - tracker>
The ${nameNode} & lt;/name - node>


Mapred. Job. Queue. Name
The ${queueName} & lt;/value>


The ${EXEC} & lt;/exec>
${nameNode}/user/beifeng/oozie - apps/shell/${EXEC} # ${EXEC} & lt;/file>
${nameNode}/user/beifeng/oozie - apps/shell/${SCRIPT} # ${SCRIPT} & lt;/file>


Shell the action failed, the error message [${wf: errorMessage (wf: lastErrorNode ())}]

CodePudding user response:

How do you solve this problem finally

CodePudding user response:

I create the workflow in HUE, began to also have this problem, behind the script file can be added to the node, reference: https://stackoverflow.com/questions/23628129/running-shell-script-from-oozie-through-hue