Home > other >  [for] the Spark MLib use ALS training results save times wrong
[for] the Spark MLib use ALS training results save times wrong

Time:09-19

The code is as follows:
Val model=ALS. "train" (ratings, rank, numIterations, lambda)
Model. The save (sc, FilePath)

Error:
Exception in the thread "main" Java. Lang. NoClassDefFoundError: org/apache/spark/SQL/execution/datasources FileFormat
The at Java. Lang. This defineClass1 (Native Method)
The at Java. Lang. This. DefineClass (763). This Java:
The at Java. Security. SecureClassLoader. DefineClass (SecureClassLoader. Java: 142)
The at java.net.URLClassLoader.defineClass URLClassLoader. Java: (467)
The at java.net.URLClassLoader.access$100 URLClassLoader. Java: (73)
The at java.net.URLClassLoader$1.run URLClassLoader. Java: (368)
The at java.net.URLClassLoader$1.run URLClassLoader. Java: (362)
The at Java. Security. The AccessController. DoPrivileged (Native Method)
The at java.net.URLClassLoader.findClass URLClassLoader. Java: (361)
The at Java. Lang. This. LoadClass (424). This Java:
At sun. Misc. The Launcher $AppClassLoader. LoadClass (335). The Launcher Java:
The at Java. Lang. This. LoadClass (357). This Java:
The at Java. Lang. Class. ForName0 (Native Method)
The at Java. Lang. Class.forname (348) Class. Java:
The at Java. Util. ServiceLoader $LazyIterator. NextService (ServiceLoader. Java: 370)
The at Java. Util. ServiceLoader $LazyIterator. Next (ServiceLoader. Java: 404)
The at Java. Util. The ServiceLoader $1. Next (ServiceLoader. Java: 480)
At the scala. Collection. The convert. $JIteratorWrapper Wrappers. Next (42) Wrappers. Scala:
At the scala. Collection. The Iterator $class. Foreach (Iterator. Scala: 727)
At the scala. Collection. AbstractIterator. Foreach (Iterator. Scala: 1157)
At the scala. Collection. IterableLike $class. Foreach (IterableLike. Scala: 72)
At the scala. Collection. AbstractIterable. Foreach (Iterable. Scala: 54)
At the scala. Collection. TraversableLike $class. The filter (263). TraversableLike scala:
At the scala. Collection. AbstractTraversable. Filter (Traversable. Scala: 105)
The at org. Apache. Spark. SQL. Execution. Datasources. ResolvedDataSource $. LookupDataSource (ResolvedDataSource. Scala: 59)
The at org. Apache. Spark. SQL. Execution. Datasources. ResolvedDataSource $. Apply (ResolvedDataSource. Scala: 219)
The at org. Apache. Spark. SQL. DataFrameWriter. Save (DataFrameWriter. Scala: 148)
The at org. Apache. Spark. SQL. DataFrameWriter. Save (DataFrameWriter. Scala: 139)
The at org. Apache. Spark. SQL. DataFrameWriter. Parquet (DataFrameWriter. Scala: 334)
The at org. Apache. Spark. Mllib. Recommendation. MatrixFactorizationModel $SaveLoadV1_0 $. Save (MatrixFactorizationModel. Scala: 361)
The at org. Apache. Spark. Mllib. Recommendation. MatrixFactorizationModel. Save (MatrixFactorizationModel. Scala: 205)

CodePudding user response:

Should be the lack of reference to a packet, or the lack of corresponding environment, such as not installed Hadoop
  • Related