in local mode can run normally, in the cluster will appear the following error:
The Exception in the thread "main" Java. Lang. NullPointerException
At com. Quell. Spark. PdfData $. The main (pdfData. Scala: 27)
At com. Quell. Spark. PdfData. Main (pdfData. Scala)
At sun. Reflect. NativeMethodAccessorImpl. Invoke0 (Native Method)
At sun. Reflect. NativeMethodAccessorImpl. Invoke (NativeMethodAccessorImpl. Java: 62)
At sun. Reflect. DelegatingMethodAccessorImpl. Invoke (43) DelegatingMethodAccessorImpl. Java:
The at Java. Lang. Reflect. Method. Invoke (498) Method. The Java:
The at org.apache.spark.deploy.SparkSubmit$.org $$$$$$runMain SparkSubmit deploy spark apache (SparkSubmit. Scala: 731)
The at org. Apache. Spark. Deploy. SparkSubmit $. DoRunMain $1 (181). SparkSubmit scala:
The at org. Apache. Spark. Deploy. SparkSubmit $. Submit (SparkSubmit. Scala: 206)
The at org. Apache. Spark. Deploy. SparkSubmit $. The main (SparkSubmit. Scala: 121)
The at org. Apache. Spark. Deploy. SparkSubmit. Main (SparkSubmit. Scala)

Part program is as follows:

Error:

While (I & lt; TempList. Length) people don't see this problem, ask Daniel to help them

CodePudding user response:

I also met this kind of question, can you tell me the bosses solved

CodePudding user response:

Time is a little long, can't remember what is the problem to deal with,
As if this
Val fs=fileSystem. ListStatus (new Path (Path))
Val listPath=FileUtil. Stat2Paths (fs)