Home > other >  Spark streaming data is read and word frequency statistics error Java lang. NoClassDefFoundError:.ne
Spark streaming data is read and word frequency statistics error Java lang. NoClassDefFoundError:.ne

Time:09-20

17/12/11 13:20:15 ERROR executor. Executor: Exception in task 0.0 in stage 24.0 (dar 13)
Java. Lang. NoClassDefFoundError:.net/jpountz/util/SafeUtils
The at org. Apache. Spark. IO. LZ4BlockInputStream. Read (124) LZ4BlockInputStream. Java:
The at org. Apache. Spark. IO. LZ4BlockInputStream. Read (137) LZ4BlockInputStream. Java:
The at org. Apache. Spark. Util. Utils $$$copyStream anonfun $1. Apply $MCJ $sp (Utils. Scala: 340)
The at org. Apache. Spark. Util. Utils $$$copyStream anonfun $1. Apply (Utils. Scala: 327)
The at org. Apache. Spark. Util. Utils $$$copyStream anonfun $1. Apply (Utils. Scala: 327)
The at org. Apache. Spark. Util. Utils $. TryWithSafeFinally (Utils. Scala: 1337)
The at org. Apache. Spark. Util. Utils $. CopyStream (Utils. Scala: 348)
The at org. Apache. Spark. Storage. ShuffleBlockFetcherIterator. Next (ShuffleBlockFetcherIterator. Scala: 395)
The at org. Apache. Spark. Storage. ShuffleBlockFetcherIterator. Next (ShuffleBlockFetcherIterator. Scala: 59)
At the scala. Collection. The Iterator $$$12. -anon nextCur (434) the Iterator. Scala:
At the scala. Collection. The Iterator $$$12. -anon hasNext (440) the Iterator. Scala:
At the scala. Collection. The Iterator $$$11. -anon hasNext (408) the Iterator. Scala:
At org.apache.spark.util.Com pletionIterator. HasNext (CompletionIterator. Scala: 32)
The at org. Apache. Spark. InterruptibleIterator. HasNext (37) InterruptibleIterator. Scala:
The at org. Apache. Spark. Util. Collections. ExternalAppendOnlyMap. InsertAll (ExternalAppendOnlyMap. Scala: 154)
At org.apache.spark.Aggregator.com bineCombinersByKey (Aggregator. Scala: 50)
At org. Apache. Spark. Shuffle. BlockStoreShuffleReader. Read (83). BlockStoreShuffleReader scala:
At org.apache.spark.rdd.ShuffledRDD.com pute (ShuffledRDD. Scala: 105)
At org.apache.spark.rdd.RDD.com puteOrReadCheckpoint (RDD. Scala: 323)
The at org. Apache. Spark. RDD. RDD. Iterator (RDD. Scala: 287)
The at org. Apache. Spark. The scheduler. ResultTask. RunTask (ResultTask. Scala: 87)
At org. Apache. Spark. The scheduler. Task. Run (108) Task. Scala:
The at org. Apache. Spark. Executor. $TaskRunner executor. Run (executor. Scala: 335)
The at Java. Util. Concurrent. ThreadPoolExecutor. RunWorker (ThreadPoolExecutor. Java: 1149)
The at Java. Util. Concurrent. ThreadPoolExecutor $Worker. The run (ThreadPoolExecutor. Java: 624)
The at Java. Lang. Thread. The run (Thread. Java: 748)
Under Caused by: Java. Lang. ClassNotFoundException: net. Jpountz. Util. SafeUtils
The at java.net.URLClassLoader.findClass URLClassLoader. Java: (381)
The at Java. Lang. This. LoadClass (424). This Java:
At sun. Misc. The Launcher $AppClassLoader. LoadClass (335). The Launcher Java:
The at Java. Lang. This. LoadClass (357). This Java:
. 26 more
17/12/11 13:20:15 WARN scheduler. TaskSetManager: Lost task in stage 0.0 24.0 (dar 13, localhost, executor driver) : Java. Lang. NoClassDefFoundError:.net/jpountz/util/SafeUtils
The at org. Apache. Spark. IO. LZ4BlockInputStream. Read (124) LZ4BlockInputStream. Java:
The at org. Apache. Spark. IO. LZ4BlockInputStream. Read (137) LZ4BlockInputStream. Java:
The at org. Apache. Spark. Util. Utils $$$copyStream anonfun $1. Apply $MCJ $sp (Utils. Scala: 340)
The at org. Apache. Spark. Util. Utils $$$copyStream anonfun $1. Apply (Utils. Scala: 327)
The at org. Apache. Spark. Util. Utils $$$copyStream anonfun $1. Apply (Utils. Scala: 327)
The at org. Apache. Spark. Util. Utils $. TryWithSafeFinally (Utils. Scala: 1337)
The at org. Apache. Spark. Util. Utils $. CopyStream (Utils. Scala: 348)
The at org. Apache. Spark. Storage. ShuffleBlockFetcherIterator. Next (ShuffleBlockFetcherIterator. Scala: 395)
The at org. Apache. Spark. Storage. ShuffleBlockFetcherIterator. Next (ShuffleBlockFetcherIterator. Scala: 59)
At the scala. Collection. The Iterator $$$12. -anon nextCur (434) the Iterator. Scala:
At the scala. Collection. The Iterator $$$12. -anon hasNext (440) the Iterator. Scala:
At the scala. Collection. The Iterator $$$11. -anon hasNext (408) the Iterator. Scala:
At org.apache.spark.util.Com pletionIterator. HasNext (CompletionIterator. Scala: 32)
The at org. Apache. Spark. InterruptibleIterator. HasNext (37) InterruptibleIterator. Scala:
The at org. Apache. Spark. Util. Collections. ExternalAppendOnlyMap. InsertAll (ExternalAppendOnlyMap. Scala: 154)
At org.apache.spark.Aggregator.com bineCombinersByKey (Aggregator. Scala: 50)
At org. Apache. Spark. Shuffle. BlockStoreShuffleReader. Read (83). BlockStoreShuffleReader scala:
At org.apache.spark.rdd.ShuffledRDD.com pute (ShuffledRDD. Scala: 105)
At org.apache.spark.rdd.RDD.com puteOrReadCheckpoint (RDD. Scala: 323)
The at org. Apache. Spark. RDD. RDD. Iterator (RDD. Scala: 287)
The at org. Apache. Spark. The scheduler. ResultTask. RunTask (ResultTask. Scala: 87)
At org. Apache. Spark. The scheduler. Task. Run (108) Task. Scala:
The at org. Apache. Spark. Executor. $TaskRunner executor. Run (executor. Scala: 335)
The at Java. Util. Concurrent. ThreadPoolExecutor. RunWorker (ThreadPoolExecutor. Java: 1149)
The at Java. Util. Concurrent. ThreadPoolExecutor $Worker. The run (ThreadPoolExecutor. Java: 624)
The at Java. Lang. Thread. The run (Thread. Java: 748)
Under Caused by: Java. Lang. ClassNotFoundException: net. Jpountz. Util. SafeUtils
The at java.net.URLClassLoader.findClass URLClassLoader. Java: (381)
nullnullnullnullnullnullnullnullnullnullnullnullnullnull
  • Related