Home > other >  Compile the spark source, an error
Compile the spark source, an error

Time:09-28

1. I downloaded the first spark - 1.3.0 - cdh5.4.4 - SRC. Tar. Gz source file and unzip to a directory spark - 1.3.0 - cdh5.4.4
2. According to the official website of the order, the spark in the directory - 1.3.0 - cdh5.4.4 run:
Export MAVEN_OPTS="- Xmx2g - XX: MaxPermSize=512 m - XX: ReservedCodeCacheSize=512 m"
MVN Pyarn - DskipTests clean package
3. However, the final build failure, the following is the standard output when error:
[the INFO] maven - source - the plugin: 2.2.1: the jar - no - fork (the create - source - jar) @ spark - mllib_2. 10 -
[the INFO] Building jar: D: \ workspaceIntellijIDEA \ spark - 1.3.0 - cdh5.4.4 \ mllib \ target \ spark - mllib_2. 10-1.3.0 - cdh5.4.4 - sources. Jar
[the INFO]
[the INFO] scalastyle - maven plugin: 0.4.0: check (the default) @ spark - mllib_2. 10 -
Error: the file=D \ workspaceIntellijIDEA \ spark - 1.3.0 - cdh5.4.4 \ mllib \ SRC \ main \ scala \ org \ apache \ spark \ mllib \ clustering \ LDAModel scala message=Input length=2
Saving to outputFile=D: \ workspaceIntellijIDEA \ spark - 1.3.0 - cdh5.4.4 \ mllib \ scalastyle - the output XML
Processed 143 file (s)
Errors Found 1
Warnings Found 0
Found 0 infos
Finished in 3302 ms
[the INFO] -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- --
[the INFO] Reactor Summary:
[the INFO]
[the INFO] Spark Project Parent POM... SUCCESS [s] 14.327
[the INFO] Spark Project Networking... SUCCESS [s] 33.203
[the INFO] Spark Project Shuffle Streaming Service... SUCCESS [s] 14.178
[the INFO] Spark Project Core... SUCCESS [06:45 min]
[the INFO] Spark Project Bagel... SUCCESS [s] 46.421
[the INFO] Spark Project GraphX... SUCCESS [01:20 min]
[the INFO] Spark Project Streaming... SUCCESS [02:19 min]
[the INFO] Spark Project Catalyst... SUCCESS [02:34 min]
[the INFO] Spark Project SQL... SUCCESS [03:08 min]
[the INFO] Spark Project ML Library... FAILURE [02:47 min]
[the INFO] Spark Project Tools... SKIPPED
[the INFO] Spark Project Hive... SKIPPED
[the INFO] Spark Project REPL... SKIPPED
[the INFO] Spark Project Assembly... SKIPPED
[the INFO] Spark Project External Twitter... SKIPPED
[the INFO] Spark Project External Flume Sink... SKIPPED
[the INFO] Spark Project External Flume... SKIPPED
[the INFO] Spark Project External MQTT... SKIPPED
[the INFO] Spark Project External ZeroMQ... SKIPPED
[the INFO] Spark Project External Kafka... SKIPPED
[the INFO] Spark Project Examples... SKIPPED
[the INFO] Spark Project External Kafka Assembly... SKIPPED
[the INFO] -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- --
[the INFO] BUILD FAILURE
[the INFO] -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- --
[the INFO] Total time: fell min
[the INFO] Finished at: 2015-08-08 T20:41:07 + 08:00
[the INFO] Final Memory: 82 m/614 m
[the INFO] -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- --
[ERROR] Failed to execute goal org. Scalastyle: scalastyle -- maven plugin: 0.4.0: check (default) on project spark - mllib_2. 10: Failed during scalastyle execution: You have 1 scalastyle violation (s). - & gt; [1] Help
[ERROR]
[ERROR] To see the full stack trace of the errors, re - run Maven have the -e switch.
[ERROR] Re - run Maven using the -x switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, both please read the following articles:
[ERROR] [1] Help http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR] MVN & lt; Goals> - rf: spark - mllib_2. 10

CodePudding user response:

If you don't have to change the pom. The XML file, that I doubt is a network problem, recompiling a ~

CodePudding user response:

Failure is also normal, to ensure the network,
  • Related