Home > other >  Springboot submit spark task error
Springboot submit spark task error

Time:09-19

Novice just self-study spark, a thorny problems, submitted with command on Linux system will be a problem, but in springboot framework to submit spark task is always an error, adjust for a long time didn't solve, spark 1.6.2 scala 2.10.5, please the great god taught
18:09:11 2018-07-12. 12076-031 WARN [nio - 8080 - exec - 1] O.A.S.D eploy. Rest. RestSubmissionClient: Unable to connect to the server spark://192.168.1.229:7077.
18:09:11 2018-07-12. 12076-223 WARN [nio - 8080 - exec - 1]. Org. Apache hadoop. Util. NativeCodeLoader: Unable to load native - hadoop library for your platform... Using the builtin - Java classes where applicable
The 18:09:11 2018-07-12. 12076-267 the INFO [nio - 8080 - exec - 1] org. Apache. Spark. SecurityManager: Changing the view acls to: cp110
The 18:09:11 2018-07-12. 12076-268 the INFO [nio - 8080 - exec - 1] org. Apache. Spark. SecurityManager: Changing the modify acls to: cp110
18:09:11 2018-07-12. 12076-268 the INFO [nio - 8080 - exec - 1] org. Apache. Spark. The SecurityManager: SecurityManager: authentication disabled; The UI acls disabled; The users with the view permissions: Set (cp110); The users with the modify permissions: Set (cp110)
The 18:09:11 2018-07-12. 12076-931 the INFO [nio - 8080 - exec - 1] org. Apache. Spark. Util. Utils: Successfully started service 'driverClient on port 62815.
18:09:12 2018-07-12. 12076-015 ERROR [huffle - the client - 0] o.a.s.net work. The client. The TransportClient: Failed to send 7209509134568250263 to/RPC 192.168.1.229:7077: Java. Lang. AbstractMethodError: org.apache.spark.net work. Protocol. MessageWithHeader. Touch (Ljava/lang/Object) Compared/netty/util/ReferenceCounted;

Java. Lang. AbstractMethodError: org.apache.spark.net work. Protocol. MessageWithHeader. Touch (Ljava/lang/Object) Compared/netty/util/ReferenceCounted;
At io.net ty. Util. ReferenceCountUtil. Touch (ReferenceCountUtil. Java: 77) ~ [netty - all - 4.1.25. Final. Jar: 4.1.25. The Final]
At io.net ty. Channel. DefaultChannelPipeline. Touch (DefaultChannelPipeline. Java: 116) ~ [netty - all - 4.1.25. Final. Jar: 4.1.25. The Final]
At io.net ty. Channel. AbstractChannelHandlerContext. Write (AbstractChannelHandlerContext. Java: 810) [netty - all - 4.1.25. Final. Jar: 4.1.25. The Final]
At io.net ty. Channel. AbstractChannelHandlerContext. Write (AbstractChannelHandlerContext. Java: 723) [netty - all - 4.1.25. Final. Jar: 4.1.25. The Final]
Ty at io.net. The handler. Codec. MessageToMessageEncoder. Write (MessageToMessageEncoder. Java: 111) ~ [netty - all - 4.1.25. Final. Jar: 4.1.25. The Final]
At io.net ty. Channel. AbstractChannelHandlerContext. InvokeWrite0 (AbstractChannelHandlerContext. Java: 738) [netty - all - 4.1.25. Final. Jar: 4.1.25. The Final]
At io.net ty. Channel. AbstractChannelHandlerContext. InvokeWrite (AbstractChannelHandlerContext. Java: 730) [netty - all - 4.1.25. Final. Jar: 4.1.25. The Final]
At io.net ty. Channel. AbstractChannelHandlerContext. Write (AbstractChannelHandlerContext. Java: 816) [netty - all - 4.1.25. Final. Jar: 4.1.25. The Final]
At io.net ty. Channel. AbstractChannelHandlerContext. Write (AbstractChannelHandlerContext. Java: 723) [netty - all - 4.1.25. Final. Jar: 4.1.25. The Final]
Ty at io.net. A handler. A timeout. IdleStateHandler. Write (IdleStateHandler. Java: 302) [netty - all - 4.1.25. Final. Jar: 4.1.25. The Final]
At io.net ty. Channel. AbstractChannelHandlerContext. InvokeWrite0 (AbstractChannelHandlerContext. Java: 738) [netty - all - 4.1.25. Final. Jar: 4.1.25. The Final]
At io.net ty. Channel. AbstractChannelHandlerContext. InvokeWrite (AbstractChannelHandlerContext. Java: 730) [netty - all - 4.1.25. Final. Jar: 4.1.25. The Final]
At io.net ty. Channel. AbstractChannelHandlerContext. Access the $1900 (AbstractChannelHandlerContext. Java: 38) [netty - all - 4.1.25. Final. Jar: 4.1.25. The Final]
At io.net ty. Channel. AbstractChannelHandlerContext $AbstractWriteTask. Write (AbstractChannelHandlerContext. Java: 1081) [netty - all - 4.1.25. Final. Jar: 4.1.25. The Final]


  • Related