Home > other >  Windows to submit the spark to the virtual machine error
Windows to submit the spark to the virtual machine error

Time:09-25

Submitted to the virtual machine deployment through eclipse programming spark use standalone mode, but the connection the master fails, submitted to the following error

16/08/24 22:15:57 INFO SparkUI: Bound SparkUI to 0.0.0.0, and started at http://169.254.147.98:4040
16/08/24 22:15:57 INFO StandaloneAppClient $ClientEndpoint: Connecting to master the spark://192.168.254.128:7077...
16/08/24 22:15:57 INFO TransportClientFactory: Successfully created connection to/192.168.254.128:7077 after 73 ms (0 ms spent in bootstraps)
16/08/24 22:15:57 WARN StandaloneAppClient $ClientEndpoint: Failed to connect to the master 192.168.254.128:7077
Org. Apache. Spark. SparkException: Exception thrown in awaitResult
The at org. Apache. Spark. RPC. RpcTimeout $$anonfun $1. ApplyOrElse (RpcTimeout. Scala: 77)
The at org. Apache. Spark. RPC. RpcTimeout $$anonfun $1. ApplyOrElse (RpcTimeout. Scala: 75)
At the scala. Runtime. AbstractPartialFunction. Apply (AbstractPartialFunction. Scala: 36)
The at org. Apache. Spark. RPC. RpcTimeout $$$addMessageIfTimeout anonfun $1. ApplyOrElse (RpcTimeout. Scala: 59)
The at org. Apache. Spark. RPC. RpcTimeout $$$addMessageIfTimeout anonfun $1. ApplyOrElse (RpcTimeout. Scala: 59)
At the scala. PartialFunction $OrElse. Apply (PartialFunction. Scala: 167)
The at org. Apache. Spark. RPC. RpcTimeout. AwaitResult (RpcTimeout. Scala: 83)
The at org. Apache. Spark. RPC. RpcEnv. SetupEndpointRefByURI (RpcEnv. Scala: 88)
The at org. Apache. Spark. RPC. RpcEnv. SetupEndpointRef (RpcEnv. Scala: 96)
At org. Apache. Spark. Deploy. Client. StandaloneAppClient $$$$tryRegisterAllMasters anonfun ClientEndpoint $1 $$$1. -anon run (109). StandaloneAppClient scala:
The at Java. Util. Concurrent. Executors $RunnableAdapter. Call (471) Executors. Java:
The at Java. Util. Concurrent. FutureTask. Run (FutureTask. Java: 262)
The at Java. Util. Concurrent. ThreadPoolExecutor. RunWorker (ThreadPoolExecutor. Java: 1145)
The at Java. Util. Concurrent. ThreadPoolExecutor $Worker. The run (ThreadPoolExecutor. Java: 615)
The at Java. Lang. Thread. The run (Thread. Java: 744)
Under Caused by: Java. Lang. RuntimeException: Java. IO. InvalidClassException: org.apache.spark.rpc.net ty. RequestMessage; A local class incompatible: stream classdesc serialVersionUID=- 5447855329526097695, the local class serialVersionUID=- 2221986757032131007
The at Java. IO. ObjectStreamClass. InitNonProxy (ObjectStreamClass. Java: 612)
The at Java. IO. ObjectInputStream. ReadNonProxyDesc (ObjectInputStream. Java: 1630)
The at Java. IO. ObjectInputStream. ReadClassDesc (ObjectInputStream. Java: 1521)
The at Java. IO. ObjectInputStream. ReadOrdinaryObject (ObjectInputStream. Java: 1779)
The at Java. IO. ObjectInputStream. ReadObject0 (ObjectInputStream. Java: 1353)
The at Java. IO. ObjectInputStream. ReadObject (ObjectInputStream. Java: 373)
The at org. Apache. Spark. Serializer. JavaDeserializationStream. ReadObject (JavaSerializer. Scala: 76)
The at org. Apache. Spark. Serializer. JavaSerializerInstance. Deserialize (JavaSerializer. Scala: 109)
The at org.apache.spark.rpc.netty.Net tyRpcEnv $$$$1 $$anonfun deserialize anonfun $apply $1. Apply (NettyRpcEnv. Scala: 258)
At the scala. Util. DynamicVariable. WithValue (DynamicVariable. Scala: 57)
The at org.apache.spark.rpc.netty.Net tyRpcEnv. Deserialize (NettyRpcEnv. Scala: 310)
The at org.apache.spark.rpc.netty.Net tyRpcEnv $$$deserialize anonfun $1. Apply (NettyRpcEnv. Scala: 257)
At the scala. Util. DynamicVariable. WithValue (DynamicVariable. Scala: 57)
The at org.apache.spark.rpc.netty.Net tyRpcEnv. Deserialize (NettyRpcEnv. Scala: 256)
The at org.apache.spark.rpc.netty.Net tyRpcHandler. InternalReceive (NettyRpcEnv. Scala: 588)
The at org.apache.spark.rpc.netty.Net tyRpcHandler. The receive (NettyRpcEnv. Scala: 570)
Work at org.apache.spark.net. The server. The TransportRequestHandler. ProcessRpcRequest (TransportRequestHandler. Java: 149)
Work at org.apache.spark.net. The server. The TransportRequestHandler. Handle (TransportRequestHandler. Java: 102)
Work at org.apache.spark.net. The server. The TransportChannelHandler. ChannelRead0 (TransportChannelHandler. Java: 104)
Work at org.apache.spark.net. The server. The TransportChannelHandler. ChannelRead0 (TransportChannelHandler. Java: 51)
At io.net ty. Channel. SimpleChannelInboundHandler. ChannelRead (SimpleChannelInboundHandler. Java: 105)
At io.net ty. Channel. AbstractChannelHandlerContext. InvokeChannelRead (AbstractChannelHandlerContext. Java: 308)
At io.net ty. Channel. AbstractChannelHandlerContext. FireChannelRead (AbstractChannelHandlerContext. Java: 294)
At io.net, ty. Handler. A timeout. IdleStateHandler. ChannelRead (IdleStateHandler. Java: 266)
At io.net ty. Channel. AbstractChannelHandlerContext. InvokeChannelRead (AbstractChannelHandlerContext. Java: 308)
At io.net ty. Channel. AbstractChannelHandlerContext. FireChannelRead (AbstractChannelHandlerContext. Java: 294)
At io.net, ty. Handler. Codec. MessageToMessageDecoder. ChannelRead (MessageToMessageDecoder. Java: 103)
At io.net ty. Channel. AbstractChannelHandlerContext. InvokeChannelRead (AbstractChannelHandlerContext. Java: 308)
At io.net ty. Channel. AbstractChannelHandlerContext. FireChannelRead (AbstractChannelHandlerContext. Java: 294)
nullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnull
  • Related