Recently started to contact spark, in centos7 environment, for spark1.4.1 - SRC compile time encountered the following problem:
In the spark directory to perform the build/SBT package, there will be:

Is the spark directory to perform the build/SBT package, appear:
Error: Invalid or corrupt jarfile build/SBT - launch - 0.13.7. Jar
Such a mistake,
Tried a lot of kinds of solution are invalid, accidentally discovered under the ubuntu, JDK versions of the same, the same hadoop version, ubuntu can successfully compiled through, but will appear on the centos above mistakes, because the lab cluster is centos environment, and the rest of the project need to use SBT compilation, it may not be able to solve, help you master!!!!!! Thank you very much!!!!!!

Attached: I use the various tools version:
JKD: 1.7.0 _79
Hadoop: server
Scala: 2.11.7
The spark: the 1.4.1

CodePudding user response:

Words, basic about the same, you and me but I am using the compiler maven, and succeeded

CodePudding user response:

Can see help
http://stackoverflow.com/questions/31637752/building-apache-spark-using-sbt-invalid-or-corrupt-jarfile

CodePudding user response:

refer to the second floor FightForProgrammer response:

can see help
http://stackoverflow.com/questions/31637752/building-apache-spark-using-sbt-invalid-or-corrupt-jarfile

Thanks, the maven build and spark own make - distribution can be compiled through, mainly for follow-up project need to use SBT compilation, really don't understand why will this appearance, according to the link you provide I tried once, is still the same problem , I can only in the ubuntu or become SBT - launch - 0.13.7. Jars, on centos, can compile

CodePudding user response:

You can compile the spark with maven, then compile their own jar with SBT?

reference Mc_Jsy reply: 3/f

Quote: refer to the second floor FightForProgrammer response:

Can see help
http://stackoverflow.com/questions/31637752/building-apache-spark-using-sbt-invalid-or-corrupt-jarfile

Thanks, the maven build and spark own make - distribution can be compiled through, mainly for follow-up project need to use SBT compilation, really don't understand why will this appearance, according to the link you provide I tried once, is still the same problem , I can only in the ubuntu or become SBT - launch - 0.13.7. Jars, on centos, can be compiled by the

CodePudding user response:

Come on, now of scala version to 2.10

CodePudding user response:

Met the same problem, I do not know whether to solve the

CodePudding user response:

Use stackoverflow solves the above:

Download the SBT - launch. The jar: http://repo.typesafe.com/typesafe/ivy-releases/org.scala-sbt/sbt-launch/0.13.7/sbt-launch.jar
Copied to the build directory, modify the name of SBT - launch - 0.13.7. Jar

CodePudding user response:

Still not solved, do you exactly how to solve the problem of ah ~