Home > other >  Spark remote connection to run the program error, which under the bosses can say how to solve?
Spark remote connection to run the program error, which under the bosses can say how to solve?

Time:10-19

Java. Lang. ClassCastException: always assign the instance of the Java. Lang, invoke the SerializedLambda to field org. Apache. Spark. API. Java JavaPairRDD $$$pairFunToScalaFun anonfun $1 x $334 of type org. Apache. Spark. API. Java function. PairFunction in the instance of org. Apache. Spark. API. Java. JavaPairRDD $$$pairFunToScalaFun anonfun $1
Local connection mode is normal, to connect to a remote spark cluster operation error, according to the website set up jars also error, are baidu rotten, bosses help!

CodePudding user response:

Your side of the path configuration is wrong!

CodePudding user response:

Add that the local file reference position, need file:///heading, otherwise the system will default to the HDFS
  • Related