Home > other >  Scala programs to run under Windows 7 cannot connect to the Linux spark in the cluster
Scala programs to run under Windows 7 cannot connect to the Linux spark in the cluster

Time:09-26

Scala programs to run under Windows 7 cannot connect to the spark cluster in Linux, always quote this error:
16/01/06 10:59:32 INFO AbstractConnector: Started [email protected]:4040
16/01/06 10:59:32 INFO Utils: Successfully started service 'SparkUI on port 4040.
16/01/06 10:59:32 INFO SparkUI: Started SparkUI at http://Silence-PC:4040
16/01/06 10:59:32 INFO AppClient $ClientActor: Connecting to master akka. TCP://[email protected]:7077/user/master...
16/01/06 10:59:33 WARN ReliableDeliverySupervisor: Association with remote system [akka. TCP://[email protected]:7077] has failed, the address is now gated for [5000] ms. Reason is: [Disassociated].
16/01/06 10:59:52 INFO AppClient $ClientActor: Connecting to master akka. TCP://[email protected]:7077/user/master...
16/01/06 10:59:52 WARN ReliableDeliverySupervisor: Association with remote system [akka. TCP://[email protected]:7077] has failed, the address is now gated for [5000] ms. Reason is: [Disassociated].
16/01/06 11:00:12 INFO AppClient $ClientActor: Connecting to master akka. TCP://[email protected]:7077/user/master...
16/01/06 11:00:12 WARN ReliableDeliverySupervisor: Association with remote system [akka. TCP://[email protected]:7077] has failed, the address is now gated for [5000] ms. Reason is: [Disassociated].
16/01/06 11:00:32 ERROR SparkDeploySchedulerBackend: Application has had been killed. The Reason: All masters are unresponsive! Giving up.
16/01/06 11:00:32 WARN SparkDeploySchedulerBackend: Application ID is not initialized yet.
16/01/06 11:00:32 ERROR TaskSchedulerImpl: Exiting due to the ERROR from cluster scheduler: All masters are unresponsive! Giving up. The

CodePudding user response:

I also encountered this problem, how to solve? My IDEA connection cluster reported this error,

CodePudding user response:

Try $SPARK_HOME/conf/down, his configured XML is copied to the project of SRC/main/resources directory (if your project is based on the mave building),
  • Related