Want to spark - shell under remote debugging, remote debugging is added in the spark - class parameter

After the complains


But without the debug parameter during normal operation is no problem,

Below is an error in the source code

CodePudding user response:

Scala to build a package, or we can't find the class

CodePudding user response:

Spark remote debugging is the jar on the cluster, and then in the IDE to debug the code, you can use spark - shell doesn't have a program in the IDE to remote debugging, breakpoint didn't have to play, how to debug?

CodePudding user response:

Can try sparkJobServer open source software, by publishing sparkJobServer Rest interface out more convenient, sparkJobServer integrates the function of remote connection spark,