When i submit spark job too terminal, it's has logging result like image in terminal.

How can i get it and set it to value or object?

CodePudding user response：

You can pipe spark-submit command to the log file like this:

spark-submit ... > log.txt

CodePudding user response：

You can see logs from application and you can always write logs to .text files

yarn logs -applicationId <application ID> [OPTIONS]

Application ID can be found through cluster UI