Home > other >  Yarn cluster running saprk homework, unable to open the spark UI address
Yarn cluster running saprk homework, unable to open the spark UI address

Time:10-11

In the spark - shell, spark UI can open, but to submit a job with yarn, yarn interface can open, but open the spark UI will be an error, and log in on the yarn show success again open 4040.

SparkUI: 54 - Bound SparkUI to 0.0.0.0, and started at http://Spark1:4040

The following times wrong tip
 
HTTP ERROR 500
Problem accessing/jobs/. Reason:

Server Error
Under Caused by:
Java. Util. NoSuchElementException
At Java. Util. Collections $EmptyIterator. Next (4189) Collections. Java:
The at org. Apache. Spark. Util. Kvstore. InMemoryStore $InMemoryIterator. Next (InMemoryStore. Java: 281)
The at org. Apache. Spark. Status. AppStatusStore. ApplicationInfo (AppStatusStore. Scala: 38)
The at org. Apache. Spark. UI. Jobs. AllJobsPage. Render (AllJobsPage. Scala: 273)
The at org. Apache. Spark. UI. WebUI $$anonfun $2. Apply (WebUI. Scala: 82)
The at org. Apache. Spark. UI. WebUI $$anonfun $2. Apply (WebUI. Scala: 82)
The at org. Apache. Spark. UI. JettyUtils $$$3. -anon doGet (JettyUtils. Scala: 90)
The at javax.mail. Servlet. HTTP. HttpServlet. Service (HttpServlet. Java: 687)
The at javax.mail. Servlet. HTTP. HttpServlet. Service (HttpServlet. Java: 790)
The at org. Spark_project. Jetty. Servlet. ServletHolder. Handle (ServletHolder. Java: 848)
The at org. Spark_project. Jetty. Servlet. ServletHandler. DoHandle (ServletHandler. Java: 584)
The at org. Spark_project. Jetty. Server. Handler. ContextHandler. DoHandle (ContextHandler. Java: 1180)
The at org. Spark_project. Jetty. Servlet. ServletHandler. DoScope (ServletHandler. Java: 512)
The at org. Spark_project. Jetty. Server. Handler. ContextHandler. DoScope (ContextHandler. Java: 1112)
The at org. Spark_project. Jetty. Server. Handler. ScopedHandler. Handle (ScopedHandler. Java: 141)
The at org. Spark_project. Jetty. Server. Handler. Gzip. GzipHandler. Handle (GzipHandler. Java: 493)
The at org. Spark_project. Jetty. Server. Handler. ContextHandlerCollection. Handle (ContextHandlerCollection. Java: 213)
The at org. Spark_project. Jetty. Server. Handler. HandlerWrapper. Handle (HandlerWrapper. Java: 134)
At org. Spark_project. Jetty. The server. The server handle (534) server. Java:
The at org. Spark_project. Jetty. Server. HttpChannel. Handle (HttpChannel. Java: 320)
The at org. Spark_project. Jetty. Server. HttpConnection. OnFillable (HttpConnection. Java: 251)
The at org. Spark_project. Jetty. IO. AbstractConnection $ReadCallback. Succeeded (AbstractConnection. Java: 283)
The at org. Spark_project. Jetty. IO. FillInterest. Fillable (FillInterest. Java: 108)
At org. Spark_project. Jetty. IO. SelectChannelEndPoint $2. The run (93) SelectChannelEndPoint. Java:
The at org. Spark_project. Jetty. Util. Thread. Strategy. ExecuteProduceConsume. ExecuteProduceConsume (ExecuteProduceConsume. Java: 303)
The at org. Spark_project. Jetty. Util. Thread. Strategy. ExecuteProduceConsume. ProduceConsume (ExecuteProduceConsume. Java: 148)
The at org. Spark_project. Jetty. Util. Thread. Strategy. ExecuteProduceConsume. Run (ExecuteProduceConsume. Java: 136)
The at org. Spark_project. Jetty. Util. Thread. QueuedThreadPool. RunJob (QueuedThreadPool. Java: 671)
At org. Spark_project. Jetty. Util. Thread. QueuedThreadPool $2. The run (589) QueuedThreadPool. Java:
The at Java. Lang. Thread. The run (Thread. Java: 748)
Powered by Jetty://9.3. Z - the SNAPSHOT

CodePudding user response:

Maven: javax.mail servlet: javax.mail servlet - API: 3.1.0

Delete this depend, maybe can solve your problem.

CodePudding user response:

reference 1st floor wenxinyu12 response:
Maven: javax.mail. Servlet: javax.mail. Servlet - API: 3.1.0

Delete this depend, maybe can solve your problem.

Now it works, thanks

CodePudding user response:

HTTP ERROR 500
Problem accessing/jobs/. Reason:

Server Error
Under Caused by:
Java. Util. NoSuchElementException
At Java. Util. Collections $EmptyIterator. Next (4189) Collections. Java:
The at org. Apache. Spark. Util. Kvstore. InMemoryStore $InMemoryIterator. Next (InMemoryStore. Java: 281)
The at org. Apache. Spark. Status. AppStatusStore. ApplicationInfo (AppStatusStore. Scala: 38)
The at org. Apache. Spark. UI. Jobs. AllJobsPage. Render (AllJobsPage. Scala: 275)
The at org. Apache. Spark. UI. WebUI $$anonfun $2. Apply (WebUI. Scala: 84)
The at org. Apache. Spark. UI. WebUI $$anonfun $2. Apply (WebUI. Scala: 84)
The at org. Apache. Spark. UI. JettyUtils $$$3. -anon doGet (JettyUtils. Scala: 90)
The at javax.mail. Servlet. HTTP. HttpServlet. Service (HttpServlet. Java: 687)
The at javax.mail. Servlet. HTTP. HttpServlet. Service (HttpServlet. Java: 790)
The at org. Spark_project. Jetty. Servlet. ServletHolder. Handle (ServletHolder. Java: 848)
The at org. Spark_project. Jetty. Servlet. ServletHandler. DoHandle (ServletHandler. Java: 584)
The at org. Spark_project. Jetty. Server. Handler. ContextHandler. DoHandle (ContextHandler. Java: 1180)
The at org. Spark_project. Jetty. Servlet. ServletHandler. DoScope (ServletHandler. Java: 512)
The at org. Spark_project. Jetty. Server. Handler. ContextHandler. DoScope (ContextHandler. Java: 1112)
The at org. Spark_project. Jetty. Server. Handler. ScopedHandler. Handle (ScopedHandler. Java: 141)
The at org. Spark_project. Jetty. Server. Handler. Gzip. GzipHandler. Handle (GzipHandler. Java: 493)
nullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnull
  • Related