Do you have in cloudera hue interface to create oozie workflow running pyspark program?
I imitate the example website try
Workflow in detail as follows:
Operation fails, an error message [${wf: errorMessage (wf: lastErrorNode ())}]

The ${jobTracker} & lt;/job - tracker>
The ${nameNode} & lt;/name - node>
Local [*]
Yarn - client
MySpark
/user/hue/oozie/workspaces/workflows/spark - python/lib/DataTest py
- the conf spark. Yarn. HistoryServer. Address=http://clouderamanager/:18088 - the conf spark. The eventLog. Dir=user/spark/applicationHistory - conf spark. The eventLog. Enabled=true & lt;/spark - opts>




always error: Main class [. Org. Apache. Oozie action. Hadoop. SparkMain], the exit code [1]

Only see the scheduling website. Jar package for example https://oozie.apache.org/docs/4.2.0/DG_SparkActionExtension.html#Spark_on_YARN

For guidance, thank you!!!!!

CodePudding user response:

Haha, I also encountered similar problems

CodePudding user response:

Excuse me, this problem you solve? I also met the same problem

CodePudding user response:

Meet the same problem, how to solve the building Lord, ask for advice