Home > other >  Using SBT build system after packed into the jar, then run the spark submit appear a series of anoma
Using SBT build system after packed into the jar, then run the spark submit appear a series of anoma

Time:09-27

Test the combination of the spark and mongo, use SBT after building the system, in the debug mode is single state can run, but once the packaged into the jar by spark submit to distribute tasks will appear after the exception:
Invalid signature file digest for the Manifest the main attributes
According to the online method, remove the jar in the meta-inf folder. SF, files,. The RSA file. The DSA file after don't quote this exception, but quote:
NoSuchMethodError this error, which may be related to delete the above several files,

Now what should I do? Methods are tried on baidu, Google, looking forward to you reply,

CodePudding user response:

Why no IDEA? I use this, I found rather easy to use,

CodePudding user response:

Is through the Maven build packaging? Not just suggested the IDEA + Maven, the Spark program of Pom. The XML search
  • Related