Home > other >  Start the spark - when the shell to the problem, solving. Thank god
Start the spark - when the shell to the problem, solving. Thank god

Time:09-18

Setting the default log level to "WARN".
To adjust logging level use sc. SetLogLevel (newLevel.)
18/05/10 14:00:48 ERROR spark. SparkContext: ERROR initializing SparkContext.
Java. Lang. IllegalArgumentException: java.net.UnknownHostException: namenode
At org, apache hadoop. Security. SecurityUtil. BuildTokenService (SecurityUtil. Java: 374)
At org, apache hadoop. HDFS. NameNodeProxies. CreateNonHAProxy (NameNodeProxies. Java: 310)
At org, apache hadoop. HDFS. NameNodeProxies. CreateProxy (NameNodeProxies. Java: 176)
At org, apache hadoop. HDFS. DFSClient. & lt; init> (DFSClient. Java: 668)
At org, apache hadoop. HDFS. DFSClient. & lt; init> (DFSClient. Java: 604)
At org, apache hadoop. HDFS. DistributedFileSystem. The initialize (DistributedFileSystem. Java: 148)
At org, apache hadoop. Fs. FileSystem. CreateFileSystem (2596) FileSystem. Java:
At org, apache hadoop. Fs. FileSystem. Access the $200 (91) FileSystem. Java:
At org, apache hadoop. Fs. $Cache FileSystem. GetInternal (2630) FileSystem. Java:
At org, apache hadoop. Fs. $Cache FileSystem. Get (2612) FileSystem. Java:
At org, apache hadoop. Fs. FileSystem. Get (370) FileSystem. Java:
The at org. Apache. Spark. Util. Utils $. GetHadoopFileSystem (Utils. Scala: 1746)
The at org. Apache. Spark. The scheduler. EventLoggingListener. & lt; init> (EventLoggingListener. Scala: 67)
The at org. Apache. Spark. SparkContext. & lt; init> (SparkContext. Scala: 514)
The at org. Apache. Spark. SparkContext $. GetOrCreate (SparkContext. Scala: 2275)
The at org. Apache. Spark. SQL. SparkSession $Builder $$anonfun $8. Apply (SparkSession. Scala: 831)
The at org. Apache. Spark. SQL. SparkSession $Builder $$anonfun $8. Apply (SparkSession. Scala: 823)
At the scala. Option. GetOrElse (121) Option. The scala:
The at org. Apache. Spark. SQL. SparkSession $Builder. GetOrCreate (SparkSession. Scala: 823)
The at org. Apache. Spark. Repl. Main $. CreateSparkSession (95). The Main scala:
At $line3. $read $$$$iw iw. & lt; init> (& lt; Console> :
15)The at $line3. $read $$iw. & lt; init> (& lt; Console> : 31)
The at $line3. $read. & lt; init> (& lt; Console> : 33)
The at $line3. $read $. & lt; init> (& lt; Console> 37) :
The at $line3. $read $. & lt; Clinit> (& lt; Console>)
The at $line3. $eval $. $print $lzycompute (& lt; Console> : 7)
The at $line3. $eval $. $print (& lt; Console> : 6)
The at $line3. $eval. $print (& lt; Console>)
At sun. Reflect. NativeMethodAccessorImpl. Invoke0 (Native Method)
At sun. Reflect. NativeMethodAccessorImpl. Invoke (NativeMethodAccessorImpl. Java: 62)
At sun. Reflect. DelegatingMethodAccessorImpl. Invoke (43) DelegatingMethodAccessorImpl. Java:
The at Java. Lang. Reflect. Method. Invoke (498) Method. The Java:
At the scala. Tools. NSC. Interpreter. IMain $ReadEvalPrint. Call (786). IMain scala:
At the scala. Tools. NSC. Interpreter. IMain $Request. LoadAndRun IMain. Scala: (1047)
At the scala. Tools. NSC. Interpreter. IMain $$$$loadAndRunReq anonfun WrappedRequest $1. Apply (IMain. Scala: 638)
At the scala. Tools. NSC. Interpreter. IMain $$$$loadAndRunReq anonfun WrappedRequest $1. Apply (IMain. Scala: 637)
At the scala. Reflect. Internal. Util. ScalaClassLoader $class. AsContext (31) ScalaClassLoader. Scala:
At the scala. Reflect. Internal. Util. AbstractFileClassLoader. AsContext (AbstractFileClassLoader. Scala: 19)
At the scala. Tools. NSC. Interpreter. IMain $WrappedRequest. LoadAndRunReq IMain. Scala: (637)
At the scala. Tools. NSC. Interpreter. IMain. Interpret (IMain. Scala: 569)
At the scala. Tools. NSC. Interpreter. IMain. Interpret (IMain. Scala: 565)
At the scala. Tools. NSC. Interpreter. ILoop. InterpretStartingWith (ILoop. Scala: 807)
Mand at scala.tools.nsc.interpreter.ILoop.com (ILoop. Scala: 681)
At the scala. Tools. NSC. Interpreter. ILoop. ProcessLine (ILoop. Scala: 395)
The at org. Apache. Spark. Repl. SparkILoop $$$initializeSpark anonfun $1. Apply $MCV $sp (SparkILoop. Scala: 38)
At org. Apache. Spark. Repl. SparkILoop $$$initializeSpark anonfun $1. Apply (37) SparkILoop. Scala:
At org. Apache. Spark. Repl. SparkILoop $$$initializeSpark anonfun $1. Apply (37) SparkILoop. Scala:
At the scala. Tools. NSC. Interpreter. IMain. BeQuietDuring IMain. Scala: (214)
The at org. Apache. Spark. Repl. SparkILoop. InitializeSpark (37) SparkILoop. Scala:
The at org. Apache. Spark. Repl. SparkILoop. LoadFiles (SparkILoop. Scala: 94)
At the scala. Tools. NSC. Interpreter. ILoop $$anonfun $process $1. Apply $MCZ $sp (ILoop. Scala: 920)
At the scala. Tools. NSC. Interpreter. ILoop $$anonfun $process $1. Apply (ILoop. Scala: 909)
At the scala. Tools. NSC. Interpreter. ILoop $$anonfun $process $1. Apply (ILoop. Scala: 909)
At the scala. Reflect. Internal. Util. ScalaClassLoader $. SavingContextLoader (ScalaClassLoader. Scala: 97)
At the scala. Tools. NSC. Interpreter. ILoop. Process (909) ILoop. Scala:
The at org. Apache. Spark. Repl. Main $. DoMain (68). The Main scala:
The at org. Apache. Spark. Repl. Main $. The Main (51). The Main scala:
The at org. Apache. Spark. Repl. Main. The Main (Main. Scala)
At sun. Reflect. NativeMethodAccessorImpl. Invoke0 (Native Method)
At sun. Reflect. NativeMethodAccessorImpl. Invoke (NativeMethodAccessorImpl. Java: 62)
At sun. Reflect. DelegatingMethodAccessorImpl. Invoke (43) DelegatingMethodAccessorImpl. Java:
nullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnull
  • Related