Starting org. Apache. Spark. Deploy. The worker, the worker, logging to/opt/data01/spark - 1.3.0 - bin - server - cdh5.4.0/sbin/../logs/spark - Lin - org. Apache. Spark. Deploy. Worker. The worker - Lin - Wenxiang - E520. Out
Failed to launch org. Apache. Spark. Deploy. Worker. The worker:
- the properties - the file the file Path to a custom Spark the properties file.
The Default is the conf/spark - defaults. Conf.
Full log in/opt/data01/spark - 1.3.0 - bin - server - cdh5.4.0/sbin/../logs/spark - Lin - org. Apache. Spark. Deploy. Worker. The worker - Lin - Wenxiang - E520. Out
The inside of the log log content is:
16/04/13 16:40:17 INFO worker. The worker: Registered signal handlers for [TERM, HUP, INT]
16/04/13 16:40:17 WARN util. Utils: Your hostname, Lin - Wenxiang - E520 resolves to a loopback address: 127.0.1.1; Using 10.170.33.22 home (on interface eth0)
16/04/13 16:40:17 WARN util. Utils: Set SPARK_LOCAL_IP if you need to bind to another address
Usage: the Worker [options]
The Master must be a URL of the form spark://hostname: port
Options:
- c CORES - CORES CORES Number of CORES to use
- m MEM, -- the memory MEM Amount of memory to use (e.g., 1000 m, 2 g)
- d DIR - work - DIR DIR Directory to run apps in (default: SPARK_HOME/work)
-i HOST, IP - the IP Hostname to listen on (deprecated, do use - HOST the or - h)
-h HOST, the HOST HOST the Hostname to listen on
- p PORT - the PORT, the PORT PORT to listen on (default: the random)
- webui - port port port for web UI (default: 8081)
- the properties - the file the file Path to a custom Spark the properties file.
The Default is the conf/spark - defaults. Conf.
CodePudding user response:
If not start the Worker said, in general, perform sbin/start - all. Sh, the Master node automatically loaded Maste process, the Worker nodes automatically loading Worker processes