Home > other >  Spark written in Java program is running at akka errors
Spark written in Java program is running at akka errors

Time:10-03

Specific error is:
The Exception in the thread "main" com. Typesafe. Config. ConfigException $Missing: No configuration setting found for the key 'akka. Remote. The log - sent - the messages'
At com. Typesafe. Config. Impl. SimpleConfig. FindKey (SimpleConfig. Java: 126)
At com. Typesafe. Config. Impl. SimpleConfig. Find (SimpleConfig. Java: 146)
At com. Typesafe. Config. Impl. SimpleConfig. Find (SimpleConfig. Java: 151)
At com. Typesafe. Config. Impl. SimpleConfig. Find (SimpleConfig. Java: 151)
At com. Typesafe. Config. Impl. SimpleConfig. Find (SimpleConfig. Java: 119)
At com. Typesafe. Config. Impl. SimpleConfig. Find (SimpleConfig. Java: 157)
At com. Typesafe. Config. Impl. SimpleConfig. GetBoolean (SimpleConfig. Java: 167)
The at akka. Remote. RemoteSettings. & lt; init> (RemoteSettings. Scala: 19)
The at akka. Remote. RemoteActorRefProvider. & lt; init> (RemoteActorRefProvider. Scala: 32)
At sun. Reflect. NativeConstructorAccessorImpl. NewInstance0 (Native Method)
At sun. Reflect. NativeConstructorAccessorImpl. NewInstance (NativeConstructorAccessorImpl. Java: 39)
At sun. Reflect. DelegatingConstructorAccessorImpl. NewInstance (DelegatingConstructorAccessorImpl. Java: 27)
The at Java. Lang. Reflect. Constructor. NewInstance (513) Constructor. Java:
The at akka. Actor. ReflectiveDynamicAccess $$$createInstanceFor anonfun $3 $$$apply anonfun $1. Apply (DynamicAccess. Scala: 108)
The at akka. Actor. ReflectiveDynamicAccess $$$createInstanceFor anonfun $3 $$$apply anonfun $1. Apply (DynamicAccess. Scala: 105)
The at akka. Actor. DynamicAccess $class. WithErrorHandling (DynamicAccess. Scala: 72)
The at akka. Actor. ReflectiveDynamicAccess. WithErrorHandling (DynamicAccess. Scala: 90)
The at akka. Actor. ReflectiveDynamicAccess $$$createInstanceFor anonfun $3. Apply (DynamicAccess. Scala: 105)
The at akka. Actor. ReflectiveDynamicAccess $$$createInstanceFor anonfun $3. Apply (DynamicAccess. Scala: 102)
At the scala. Either. A fold (Either. Scala: 96)
The at akka. Actor. ReflectiveDynamicAccess. CreateInstanceFor (DynamicAccess. Scala: 102)
The at akka. Actor. ActorSystemImpl. & lt; init> (ActorSystem. Scala: 549)
The at akka. Actor. ActorSystem $. Apply (ActorSystem. Scala: 111)
At spark. Util. AkkaUtils $. CreateActorSystem (AkkaUtils. Scala: 51)
At spark. SparkEnv $. CreateFromSystemProperties (SparkEnv scala: 81)
At spark. SparkContext. & lt; init> (SparkContext. Scala: 79)
At spark. Streaming. StreamingContext $. CreateNewSparkContext (StreamingContext. Scala: 493)
At spark. Streaming. StreamingContext. & lt; init> (StreamingContext. Scala: 67)
At spark. Streaming. API. Java. JavaStreamingContext. & lt; init> (JavaStreamingContext. Scala: 56)




Written into the jar after operation, the program the following
Public static void main (String [] args) {
System. The out. Println (args [0]).
//System. SetProperty (" akka. Remote. Log -- received messages "and" off ");
If (args. Length & lt; 2) {
System. Err. Println (" the Usage: NetworkWordCount & lt; Master>
\ n"+ "In local mode, & lt; Master> Should be 'local [n]' with n & gt; 1 ");
System. The exit (1);
}


JavaStreamingContext SSC=new JavaStreamingContext (args [0], "ImageCut", the new Duration (1000),
System. The getenv (" SPARK_HOME "), "/data/realtime/imagecut/imagecutspark jar");

JavaDStream Lines=SSC. TextFileStream (args [1]).
Lines. The map (new Function () {

Private static final long serialVersionUID=1 l;

@ Override
Public Void call (String imagepath) throws the Exception {
Runtime. GetRuntime (). The exec (" sh/data/realtime/imagecut/imagecut. Sh "+ imagepath);
return null;
}
});

SSC. Start ();
}

CodePudding user response:

I also met this problem

CodePudding user response:

I also met this problem

CodePudding user response:

Then akka related to delete package, don't quote this wrong, very violent
  • Related