Home > other >  The spark driver log configuration, and check the problem
The spark driver log configuration, and check the problem

Time:09-25

Master, in the form of yarn through http://node1:18088/history/application_1470281024284_0054/executors/, you can see the information as shown in the figure below,


Application or driver log can't see, I tried to logger. The info to the logger. Warn could not see,
So could you please tell me:
1. Driver log how to view?
2. My program. How to specify your own log4j properties, don't tell me into the ${SPARK_HOME}/conf/, it for all the spark application effect, I just want to own this application effect; I tried to put the log4j properties in project resources, but doesn't work,
  • Related