Home > other >  Spark in the cluster master slave visit was refused
Spark in the cluster master slave visit was refused

Time:09-27

16/04/09 23:18:20 WARN NativeCodeLoader: Unable to load the native - hadoop library for your platform... Using the builtin - Java classes where applicable
16/04/09 23:18:45 ERROR RetryingBlockFetcher: Exception while beginning the fetch of 1 outstanding blocks
Java. IO. IOException: Failed to connect to the master/218.192.172.48:35542
At org.apache.spark.net work. Client. TransportClientFactory. CreateClient (TransportClientFactory. Java: 216)
At org.apache.spark.net work. Client. TransportClientFactory. CreateClient (TransportClientFactory. Java: 167)
The at org.apache.spark.network.netty.Net tyBlockTransferService $$$1. -anon createAndStart (NettyBlockTransferService. Scala: 91)
Work at org.apache.spark.net. Shuffle. RetryingBlockFetcher. FetchAllOutstanding (RetryingBlockFetcher. Java: 140)
Work at org.apache.spark.net. Shuffle. RetryingBlockFetcher. Start (RetryingBlockFetcher. Java: 120)
The at org.apache.spark.network.netty.Net tyBlockTransferService. FetchBlocks (NettyBlockTransferService. Scala: 100)
The at org. Apache. Spark. Storage. ShuffleBlockFetcherIterator. The sendRequest (ShuffleBlockFetcherIterator. Scala: 169)
The at org. Apache. Spark. Storage. ShuffleBlockFetcherIterator. FetchUpToMaxBytes (ShuffleBlockFetcherIterator. Scala: 351)
The at org. Apache. Spark. Storage. ShuffleBlockFetcherIterator. The initialize (ShuffleBlockFetcherIterator. Scala: 286)
The at org. Apache. Spark. Storage. ShuffleBlockFetcherIterator. & lt; init> (ShuffleBlockFetcherIterator. Scala: 119)
The at org. Apache. Spark. Shuffle. BlockStoreShuffleReader. Read (43) BlockStoreShuffleReader. Scala:
At org.apache.spark.rdd.ShuffledRDD.com pute (ShuffledRDD. Scala: 98)
At org.apache.spark.rdd.RDD.com puteOrReadCheckpoint (RDD. Scala: 313)
The at org. Apache. Spark. RDD. RDD. Iterator (RDD. Scala: 277)
At org.apache.spark.rdd.MapPartitionsRDD.com pute (MapPartitionsRDD. Scala: 38)
At org.apache.spark.rdd.RDD.com puteOrReadCheckpoint (RDD. Scala: 313)
The at org. Apache. Spark. RDD. RDD. Iterator (RDD. Scala: 277)
At org.apache.spark.rdd.MapPartitionsRDD.com pute (MapPartitionsRDD. Scala: 38)
At org.apache.spark.rdd.RDD.com puteOrReadCheckpoint (RDD. Scala: 313)
The at org. Apache. Spark. RDD. RDD. Iterator (RDD. Scala: 277)
At org.apache.spark.rdd.MapPartitionsRDD.com pute (MapPartitionsRDD. Scala: 38)
At org.apache.spark.rdd.RDD.com puteOrReadCheckpoint (RDD. Scala: 313)
The at org. Apache. Spark. RDD. RDD. Iterator (RDD. Scala: 277)
The at org. Apache. Spark. The scheduler. ResultTask. RunTask (ResultTask. Scala: 69)
At org. Apache. Spark. The scheduler. Task. Run (82) Task. Scala:
The at org. Apache. Spark. Executor. $TaskRunner executor. Run (executor. Scala: 227)
The at Java. Util. Concurrent. ThreadPoolExecutor. RunWorker (ThreadPoolExecutor. Java: 1145)
The at Java. Util. Concurrent. ThreadPoolExecutor $Worker. The run (ThreadPoolExecutor. Java: 615)
The at Java. Lang. Thread. The run (Thread. Java: 745)
Under Caused by: java.net.ConnectException: connection refused: master/218.192.172.48:35542
At sun. Nio. Ch. SocketChannelImpl. CheckConnect (Native Method)
At sun. Nio. Ch. SocketChannelImpl. FinishConnect (SocketChannelImpl. Java: 744)
At io.net ty. Channel. Socket. Nio. NioSocketChannel. DoFinishConnect (NioSocketChannel. Java: 224)
At io.net ty. Channel. Nio. AbstractNioChannel $AbstractNioUnsafe. FinishConnect (AbstractNioChannel. Java: 289)
At io.net, ty. Channel. Nio. NioEventLoop. ProcessSelectedKey (NioEventLoop. Java: 528)
At io.net, ty. Channel. Nio. NioEventLoop. ProcessSelectedKeysOptimized (NioEventLoop. Java: 468)
At io.net, ty. Channel. Nio. NioEventLoop. ProcessSelectedKeys (NioEventLoop. Java: 382)
At io.net, ty. Channel. Nio. NioEventLoop. Run (NioEventLoop. Java: 354)
At io.net ty. Util. Concurrent. SingleThreadEventExecutor $2. The run (111) SingleThreadEventExecutor. Java:
. 1 more
16/04/09 23:18:50 ERROR RetryingBlockFetcher: Exception while beginning the fetch of 1 outstanding blocks (after 1 retries)
Java. IO. IOException: Failed to connect to the master/218.192.172.48:35542
At org.apache.spark.net work. Client. TransportClientFactory. CreateClient (TransportClientFactory. Java: 216)
At org.apache.spark.net work. Client. TransportClientFactory. CreateClient (TransportClientFactory. Java: 167)
The at org.apache.spark.network.netty.Net tyBlockTransferService $$$1. -anon createAndStart (NettyBlockTransferService. Scala: 91)
Work at org.apache.spark.net. Shuffle. RetryingBlockFetcher. FetchAllOutstanding (RetryingBlockFetcher. Java: 140)
Work at org.apache.spark.net. Shuffle. RetryingBlockFetcher. Access the $200 (43) RetryingBlockFetcher. Java:
Work at org.apache.spark.net. Shuffle. RetryingBlockFetcher $1. The run (RetryingBlockFetcher. Java: 170)
The at Java. Util. Concurrent. Executors $RunnableAdapter. Call (471) Executors. Java:
The at Java. Util. Concurrent. FutureTask. Run (FutureTask. Java: 262)
The at Java. Util. Concurrent. ThreadPoolExecutor. RunWorker (ThreadPoolExecutor. Java: 1145)
The at Java. Util. Concurrent. ThreadPoolExecutor $Worker. The run (ThreadPoolExecutor. Java: 615)
The at Java. Lang. Thread. The run (Thread. Java: 745)
Under Caused by: java.net.ConnectException: connection refused: master/218.192.172.48:35542
nullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnull
  • Related