In the Eclipse in the scala version has written a spark program, the IDE statement syntax is no problem, but there are compilation errors
The following is the description of the error image, as if said in package org. Apache. Avro. Reflect. Stringable
have problems in
What reason is this excuse me?

CodePudding user response:

If version conflict

CodePudding user response:

By commenting out the code behind me, and then join method to test the line by line, found that the problem is mainly in the following statement
If it is
val lines=sc. HadoopFile [LongWritable, Text ("/data/algo cookie_mapping/201409/20140930. Lzo ",
ClassOf classOf [DeprecatedLzoTextInputFormat], [LongWritable], classOf [Text]);
Will the newspaper;
If it is val=lines=sc. HadoopFile ("/data/algo cookie_mapping/201409/20140930. Lzo ") , is compile