Home > other >  Spark - streaming programs run out after a period of time
Spark - streaming programs run out after a period of time

Time:09-27

Excuse me, my spark - streaming application in the form of yarn - client run after a period of time, dropped out, but the driver is still there, yarn log is as follows:
15/09/19 14:32:34 ERROR util. Utils: Uncaught exception in the thread thread - 1
Org, apache hadoop. Security. Token. SecretManager $InvalidToken: Invalid AMRMToken from appattempt_1437371132890_10529_000002
At sun. Reflect. NativeConstructorAccessorImpl. NewInstance0 (Native Method)
At sun. Reflect. NativeConstructorAccessorImpl. NewInstance (NativeConstructorAccessorImpl. Java: 57)
At sun. Reflect. DelegatingConstructorAccessorImpl. NewInstance (DelegatingConstructorAccessorImpl. Java: 45)
The at Java. Lang. Reflect. Constructor. NewInstance (526) Constructor. Java:
At org, apache hadoop. Yarn. The ipc. RPCUtil. InstantiateException (53) RPCUtil. Java:
At org, apache hadoop. Yarn. The ipc. RPCUtil. UnwrapAndThrowException (RPCUtil. Java: 104)
At org, apache hadoop. Yarn. API. The impl. Pb. Client. ApplicationMasterProtocolPBClientImpl. FinishApplicationMaster (ApplicationMasterProtocolPBClientImpl. Java: 94)
At sun. Reflect. NativeMethodAccessorImpl. Invoke0 (Native Method)
At sun. Reflect. NativeMethodAccessorImpl. Invoke (NativeMethodAccessorImpl. Java: 57)
At sun. Reflect. DelegatingMethodAccessorImpl. Invoke (43) DelegatingMethodAccessorImpl. Java:
The at Java. Lang. Reflect. Method. Invoke (606) Method. The Java:
At org, apache hadoop. IO. Retry. RetryInvocationHandler. InvokeMethod (RetryInvocationHandler. Java: 187)
At org, apache hadoop. IO. Retry. RetryInvocationHandler. Invoke (RetryInvocationHandler. Java: 102)
At com. Sun. Proxy. $Proxy18. FinishApplicationMaster (Unknown Source)
At org, apache hadoop. Yarn. Client. API. Impl. AMRMClientImpl. UnregisterApplicationMaster (AMRMClientImpl. Java: 378)
The at org. Apache. Spark. Deploy. Yarn. YarnRMClient. Unregister (YarnRMClient. Scala: 86)
The at org. Apache. Spark. Deploy. Yarn. ApplicationMaster. Unregister (ApplicationMaster. Scala: 184)
The at org. Apache. Spark. Deploy. Yarn. The ApplicationMaster $$anonfun $run $1. Apply $MCV $sp (ApplicationMaster. Scala: 123)
The at org. Apache. Spark. Util. SparkShutdownHook. Run (Utils. Scala: 2308)
At org. Apache. Spark. Util. SparkShutdownHookManager $$$$1 $$anonfun runAll anonfun $apply $MCV $sp $1. Apply $MCV $sp (Utils. Scala: 2278)
The at org. Apache. Spark. Util. SparkShutdownHookManager $$$runAll anonfun $1 $$$apply anonfun $$sp MCV $1. Apply (Utils. Scala: 2278)
The at org. Apache. Spark. Util. SparkShutdownHookManager $$$runAll anonfun $1 $$$apply anonfun $$sp MCV $1. Apply (Utils. Scala: 2278)
The at org. Apache. Spark. Util. Utils $. LogUncaughtExceptions (Utils. Scala: 1772)
The at org. Apache. Spark. Util. SparkShutdownHookManager $$$runAll anonfun $1. Apply $MCV $sp (Utils. Scala: 2278)
The at org. Apache. Spark. Util. SparkShutdownHookManager $$$runAll anonfun $1. Apply (Utils. Scala: 2278)
The at org. Apache. Spark. Util. SparkShutdownHookManager $$$runAll anonfun $1. Apply (Utils. Scala: 2278)
At the scala. Util. Try $. Apply (161). The Try scala:
The at org. Apache. Spark. Util. SparkShutdownHookManager. RunAll (Utils. Scala: 2278)
The at org. Apache. Spark. Util. SparkShutdownHookManager $$$6. -anon run (Utils. Scala: 2260)
At org, apache hadoop. Util. ShutdownHookManager $1. The run (ShutdownHookManager. Java: 54)
Under Caused by: org, apache hadoop. Ipc. RemoteException (. Org. Apache hadoop. Security. Token. SecretManager $InvalidToken) : Invalid AMRMToken from appattempt_1437371132890_10529_000002
At org, apache hadoop. Ipc. Client. Call (1468). The Client Java:
At org, apache hadoop. Ipc. Client. Call (1399). The Client Java:
At org, apache hadoop. Ipc. ProtobufRpcEngine $Invoker. Invoke (ProtobufRpcEngine. Java: 232)
At com. Sun. Proxy. $Proxy17. FinishApplicationMaster (Unknown Source)
At org, apache hadoop. Yarn. API. The impl. Pb. Client. ApplicationMasterProtocolPBClientImpl. FinishApplicationMaster (ApplicationMasterProtocolPBClientImpl. Java: 91)
. 23 more
Is there anyone who met this kind of situation, know this is why

CodePudding user response:

To make this problem solved?
  • Related