CodePudding user response:
Someone is anyone hereCodePudding user response:
After another wall bumps bumpsCodePudding user response:
Configuration files should beExport JAVA_HOME=/usr/local/jdk1.8.0 _73
Export SCALA_HOME=/home/hadoop/apps/scala
Export SPARK_MASTER_IP=hadoop01
Export SPARK_MASTER_PORT=7077 # # RPC communication port, similar to the HDFS port 9000, not 50070
Export SPARK_WORKER_CORES=2
Export SPARK_WORKER_INSTANCES=1
Export SPARK_WORKER_MEMORY=1 g
Export HADOOP_CONF_DIR=/home/hadoop/apps/hadoop - 2.7.6/etc/hadoop