Use the idea to see the spark source code compiler through-CodePudding

Recently wanted to study under the spark source, under the Windows system with the idea of compiling the spark, in the debug examples always appear when
Val transactionTimeout: Int, val backOffInterval: Int) extends SparkFlumeProtocol with Logging {
Can't find SparkFlumeProtocol problem? There are other a bunch of mistakes,
Excuse me, how to solve to debug step by step according to the examples of the step?

CodePudding user response:

Another eventbatch this find, I look at the javadoc in the org. Apache. Spark. Streaming. The flume. The sink in the class, but down the source and no two traits and classes

CodePudding user response:

The building Lord, this problem solved? I also encountered this problem, thank you,

reference 1st floor gaoqida response:

and a eventbatch this find, I look at the javadoc in the org. Apache. Spark. Streaming. The flume. Under the class of sink, but down the source and no two traits and class

reference 1st floor gaoqida response:

and a eventbatch this find, I look at the javadoc in the org. Apache. Spark. Streaming. The flume. Under the class of sink, but down the source and no two traits and class

CodePudding user response:

The building Lord, this problem solved? I also encountered this problem, thank you,

refer to the second floor bit1010 response:

the building Lord, this problem solved? I also encountered this problem, thank you,

Quote: refer to 1st floor gaoqida response:

There is also a eventbatch this find, I look at the javadoc in the org. Apache. Spark. Streaming. The flume. Under the class of sink, but down the source and no two traits and class

reference 1st floor gaoqida response:
and a eventbatch this find, I look at the javadoc in the org. Apache. Spark. Streaming. The flume. Under the class of sink, but down the source and no two traits and class

CodePudding user response:

This question: how do you solve eventually I didn't find the SparkFlumeProtocol in http://spark.apache.org/docs/latest/api/scala/index.html#index.index-s and EventBatch these two classes according to the references should be in org. Apache. The flume. The Channel directory in the flume - I ng - core - 1.4.0. Jar flume - ng - SDK - 1.4.0. Did not find the jar inside these two classes lack other jars?

The

reference 3 floor SSFXZ response:

the building Lord, this problem solved? I also encountered this problem, thank you,

Quote: refer to the second floor bit1010 response:

The building Lord, this problem solved? I also encountered this problem, thank you,

Quote: refer to 1st floor gaoqida response:

There is also a eventbatch this find, I look at the javadoc in the org. Apache. Spark. Streaming. The flume. Under the class of sink, but down the source and no two traits and class

reference 1st floor gaoqida response:
and a eventbatch this find, I look at the javadoc in the org. Apache. Spark. Streaming. The flume. Under the class of sink, but down the source and no two traits and class

CodePudding user response:

Can see me to write this blog http://blog.csdn.net/zhaoyunxiang721/article/details/49126725

CodePudding user response:

Windows can be compiled unexpectedly? Using maven?
Here I use SBT under Windows was unable to complete, can only change to Linux, download rely on is still a very headache problem

CodePudding user response:

Windows can be compiled, I compiled using the SBT, only slowly