Home > other >  Spark program run error problem, ask for help
Spark program run error problem, ask for help

Time:09-27

16/03/03 17:36:03 WARN TaskSetManager: Lost task in stage 0.0 0.0 (dar 0, localhost) : java.net.NoRouteToHostException: No route to host
Java.net.PlainSocketImpl.socketConnect (Native Method)
Java.net.AbstractPlainSocketImpl.doConnect AbstractPlainSocketImpl. Java: (339)
Java.net.AbstractPlainSocketImpl.connectToAddress AbstractPlainSocketImpl. Java: (200)
Java.net.AbstractPlainSocketImpl.connect AbstractPlainSocketImpl. Java: (182)
Java.net.SocksSocketImpl.connect SocksSocketImpl. Java: (392)
Java.net.Socket.connect (579) Socket. Java:
Sun.net.NetworkClient.doConnect NetworkClient. Java: (175)
Sun.net.www.http.HttpClient.openServer (HttpClient. Java: 432)
Sun.net.www.http.HttpClient.openServer (HttpClient. Java: 527)
Sun.net.www.http.HttpClient. (HttpClient. Java: 211)
Sun.net.www.http.HttpClient.New (HttpClient. Java: 308)
Sun.net.www.http.HttpClient.New (HttpClient. Java: 326)
Sun.net.www.protocol.http.HttpURLConnection.getNewHttpClient HttpURLConnection. Java: (997)
Sun.net.www.protocol.http.HttpURLConnection.plainConnect HttpURLConnection. Java: (933)
Sun.net.www.protocol.http.HttpURLConnection.connect HttpURLConnection. Java: (851)
Org. Apache. Spark. Util. Utils $. FetchFile (Utils. Scala: 375)
Org. Apache. Spark. Executor. Executor $$$$$$executor spark apache org anonfun $executor $$updateDependencies $6. Apply (executor. Scala: 325)
Org. Apache. Spark. Executor. Executor $$$$$$executor spark apache org anonfun $executor $$updateDependencies $6. Apply (executor. Scala: 323)
Scala. Collection. TraversableLike $the WithFilter $$$foreach anonfun $1. Apply (TraversableLike. Scala: 772)
Scala. Collection. The mutable. HashMap $$$foreach anonfun $1. Apply (HashMap. Scala: 98)
Scala. Collection. The mutable. HashMap $$$foreach anonfun $1. Apply (HashMap. Scala: 98)
Scala. Collection. Mutable. $class HashTable. ForeachEntry (HashTable. Scala: 226)
Scala. Collection. Mutable. HashMap. ForeachEntry (HashMap. Scala: 39)
Scala. Collection. Mutable. HashMap. Foreach (HashMap. Scala: 98)
Scala. Collection. TraversableLike $the WithFilter. Foreach (TraversableLike. Scala: 771)
Org.apache.spark.executor.Executor.org $$$$$$updateDependencies executor executor spark apache (executor. Scala: 323)
Org. Apache. Spark. Executor. $TaskRunner executor. Run (executor. Scala: 158)
Java. Util. Concurrent. ThreadPoolExecutor. RunWorker (ThreadPoolExecutor. Java: 1145)
Java. Util. Concurrent. ThreadPoolExecutor $Worker. The run (ThreadPoolExecutor. Java: 615)
Java. Lang. Thread. The run (745) Thread. Java:
16/03/03 17:36:03 INFO TaskSetManager: Starting task in stage 0.1 0.0 (dar 1, localhost, PROCESS_LOCAL, 1240 bytes)
16/03/03 17:36:06 INFO TaskSetManager: Lost task in stage 0.1 0.0 (dar) on executor localhost: java.net.NoRouteToHostException (No route to host) [1] duplicate
16/03/03 17:36:06 INFO TaskSetManager: Starting task in stage 0.2 0.0 (TID 2, localhost, PROCESS_LOCAL, 1240 bytes)
16/03/03 17:36:09 INFO TaskSetManager: Lost task in stage 0.2 0.0 (dar) 2 on executor localhost: java.net.NoRouteToHostException (No route to host) [2] duplicate
16/03/03 17:36:09 INFO TaskSetManager: Starting task in stage 0.3 0.0 (dar 3, localhost, PROCESS_LOCAL, 1240 bytes)
16/03/03 17:36:12 INFO TaskSetManager: Lost task in stage 0.3 0.0 (dar) on executor localhost: java.net.NoRouteToHostException (No route to host) [3] duplicate
16/03/03 17:36:12 ERROR TaskSetManager: Task 0 in stage 0.0 failed 4 times; Aborting job
16/03/03 17:36:12 INFO TaskSchedulerImpl: Removed the TaskSet 0.0, whose tasks have all completed, the from the pool
16/03/03 17:36:12 INFO TaskSchedulerImpl: Cancelling stage 0
16/03/03 17:36:12 INFO DAGScheduler: Failed to run first at the test. The scala: 15
The Exception in the thread "main" org. Apache. Spark. SparkException: Job aborted due to stage a failure: Task 0 in stage 0.0 failed 4 times, most recent failure: Lost Task in stage 0.0 0.3 (dar 3, localhost) : java.net.NoRouteToHostException: No route to host
Java.net.PlainSocketImpl.socketConnect (Native Method)
Java.net.AbstractPlainSocketImpl.doConnect AbstractPlainSocketImpl. Java: (339)
Java.net.AbstractPlainSocketImpl.connectToAddress AbstractPlainSocketImpl. Java: (200)
Java.net.AbstractPlainSocketImpl.connect AbstractPlainSocketImpl. Java: (182)
Java.net.SocksSocketImpl.connect SocksSocketImpl. Java: (392)
Java.net.Socket.connect (579) Socket. Java:
Sun.net.NetworkClient.doConnect NetworkClient. Java: (175)
Sun.net.www.http.HttpClient.openServer (HttpClient. Java: 432)
Sun.net.www.http.HttpClient.openServer (HttpClient. Java: 527)
Sun.net.www.http.HttpClient. (HttpClient. Java: 211)
Sun.net.www.http.HttpClient.New (HttpClient. Java: 308)
Sun.net.www.http.HttpClient.New (HttpClient. Java: 326)
Sun.net.www.protocol.http.HttpURLConnection.getNewHttpClient HttpURLConnection. Java: (997)
Sun.net.www.protocol.http.HttpURLConnection.plainConnect HttpURLConnection. Java: (933)
nullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnull
  • Related