Home > other >  In the spark local mode error, various kinds of example case such as sparkpi sparklr wait
In the spark local mode error, various kinds of example case such as sparkpi sparklr wait

Time:09-27

Specific error message is as follows:
The Exception in the thread "dag - the scheduler - event - loop" Java. Lang. UnsatisfiedLinkError: org. Xerial. Snappy. SnappyNative. MaxCompressedLength (I) I
The at org. Xerial. Snappy. SnappyNative. MaxCompressedLength (Native Method)
The at org. Xerial. Snappy. Snappy. MaxCompressedLength (snappy. Java: 316)
The at org. Xerial. Snappy. SnappyOutputStream. & lt; init> (SnappyOutputStream. Java: 79)
At org.apache.spark.io.SnappyCompressionCodec.com pressedOutputStream (CompressionCodec. Scala: 156)
The at org. Apache. Spark. Broadcast. TorrentBroadcast $$anonfun $4. Apply (TorrentBroadcast. Scala: 200)
The at org. Apache. Spark. Broadcast. TorrentBroadcast $$anonfun $4. Apply (TorrentBroadcast. Scala: 200)
At the scala. Option. The map (145) Option. The scala:
The at org. Apache. Spark. Broadcast. TorrentBroadcast $. BlockifyObject (TorrentBroadcast. Scala: 200)
The at org. Apache. Spark. Broadcast. TorrentBroadcast. WriteBlocks (TorrentBroadcast. Scala: 102)
The at org. Apache. Spark. Broadcast. TorrentBroadcast. & lt; init> (TorrentBroadcast. Scala: 85)
The at org. Apache. Spark. Broadcast. TorrentBroadcastFactory. NewBroadcast (TorrentBroadcastFactory. Scala: 34)
The at org. Apache. Spark. Broadcast. BroadcastManager. NewBroadcast (BroadcastManager. Scala: 63)
The at org. Apache. Spark. SparkContext. Broadcast (SparkContext. Scala: 1328)
The at org.apache.spark.scheduler.DAGScheduler.org $$$$$$submitMissingTasks DAGScheduler scheduler spark apache (DAGScheduler. Scala: 861)
The at org.apache.spark.scheduler.DAGScheduler.org $$$$$$submitStage DAGScheduler scheduler spark apache (DAGScheduler. Scala: 772)
The at org. Apache. Spark. The scheduler. DAGScheduler. HandleJobSubmitted (DAGScheduler. Scala: 757)
The at org. Apache. Spark. The scheduler. DAGSchedulerEventProcessLoop. DoOnReceive (DAGScheduler. Scala: 1463)
The at org. Apache. Spark. The scheduler. DAGSchedulerEventProcessLoop. OnReceive (DAGScheduler. Scala: 1455)
The at org. Apache. Spark. The scheduler. DAGSchedulerEventProcessLoop. OnReceive (DAGScheduler. Scala: 1444)
The at org. Apache. Spark. Util. EventLoop $$$1. -anon run (EventLoop. Scala: 48)
And then stuck in here,,, the diagram below:

CodePudding user response:


Local services are not together?

CodePudding user response:

You mean start a local service is to point to?
  • Related