Home > other >  Running newspaper NoClassDefFoundError maven build spark
Running newspaper NoClassDefFoundError maven build spark

Time:09-27

I use first maven packaging to run scala program, use the spark - after submit to submit the error content is as follows:

The Exception in the thread "main" Java. Lang. NoClassDefFoundError: edu/umd cloud9/collection/wikipedia/WikipediaPage
At com. Cloudera. Datascience. Lsa. RunLSA $. Preprocessing (RunLSA. Scala: 54)
At com. Cloudera. Datascience. Lsa. RunLSA $. The main (RunLSA. Scala: 33)
At com. Cloudera. Datascience. Lsa. RunLSA. Main (RunLSA. Scala)
At sun. Reflect. NativeMethodAccessorImpl. Invoke0 (Native Method)
At sun. Reflect. NativeMethodAccessorImpl. Invoke (NativeMethodAccessorImpl. Java: 62)
At sun. Reflect. DelegatingMethodAccessorImpl. Invoke (43) DelegatingMethodAccessorImpl. Java:
The at Java. Lang. Reflect. Method. Invoke (497) Method. The Java:
The at org.apache.spark.deploy.SparkSubmit$.org $$$$$$runMain SparkSubmit deploy spark apache (SparkSubmit. Scala: 674)
The at org. Apache. Spark. Deploy. SparkSubmit $. DoRunMain $1 (180). SparkSubmit scala:
The at org. Apache. Spark. Deploy. SparkSubmit $. Submit (SparkSubmit. Scala: 205)
The at org. Apache. Spark. Deploy. SparkSubmit $. The main (SparkSubmit. Scala: 120)
The at org. Apache. Spark. Deploy. SparkSubmit. Main (SparkSubmit. Scala)
Under Caused by: Java. Lang. ClassNotFoundException: edu. Umd. Cloud9. Collections. Wikipedia. WikipediaPage
The at java.net.URLClassLoader.findClass URLClassLoader. Java: (381)
The at Java. Lang. This. LoadClass (424). This Java:
The at Java. Lang. This. LoadClass (357). This Java:
. 12 more

I checked the pom file, this class has been added, and check the local warehouse, also have this class
  • Related