Home > other >  Error accessing hive metadata spark
Error accessing hive metadata spark

Time:09-22

My code is
Val spark=SparkSession
The builder ()
AppName (" Spark Hive Example ")
Web.config (sparkConf)
EnableHiveSupport ()
GetOrCreate ()
The import spark. Implicits. _
SQL
import spark.SQL (" show the databases "). The show ()
SQL (" show tables "). The show ()

Compiled after the operation to the error log is:
17/06/07 17:42:33 INFO util. Log: Logging the initialized @ 2826 ms
17/06/07 17:42:33 INFO server. Server: jetty - 9.2. Z - the SNAPSHOT
17/06/07 17:42:33 INFO handler. ContextHandler: Started O.S.J.S.S 36 d27f24 ervletContextHandler @ {/jobs, null, and the AVAILABLE}
17/06/07 17:42:33 INFO handler. ContextHandler: Started O.S.J.S.S ervletContextHandler @ 3599309 a {/jobs/json, null, the AVAILABLE}
17/06/07 17:42:33 INFO handler. ContextHandler: Started O.S.J.S.S ervletContextHandler @ 5 c45e9f3 {/jobs/job, null, the AVAILABLE}
17/06/07 17:42:33 INFO handler. ContextHandler: Started O.S.J.S.S ervletContextHandler @ 72027 fd8 {/jobs/job/json, null, the AVAILABLE}
17/06/07 17:42:33 INFO handler. ContextHandler: Started O.S.J.S.S ervletContextHandler @ 2177862 {/stages, null, and the AVAILABLE}
17/06/07 17:42:33 INFO handler. ContextHandler: Started O.S.J.S.S ervletContextHandler @ 52 e06b00 {/stages/json, null, the AVAILABLE}
17/06/07 17:42:33 INFO handler. ContextHandler: Started O.S.J.S.S ervletContextHandler @ b90f782 {/stages/stage, null, the AVAILABLE}
17/06/07 17:42:33 INFO handler. ContextHandler: Started O.S.J.S.S ervletContextHandler @ 5 a697dbc {/stages/stage/json, null, the AVAILABLE}
17/06/07 17:42:33 INFO handler. ContextHandler: Started O.S.J.S.S 43 bdf003 ervletContextHandler @ {/stages/pool, null, the AVAILABLE}
17/06/07 17:42:33 INFO handler. ContextHandler: Started O.S.J.S.S ervletContextHandler @ 6 ad877b3 {/stages/pool/json, null, the AVAILABLE}
17/06/07 17:42:33 INFO handler. ContextHandler: Started O.S.J.S.S ervletContextHandler @ 299 abf92 {/storage, null, and the AVAILABLE}
17/06/07 17:42:33 INFO handler. ContextHandler: Started O.S.J.S.S ervletContextHandler @ 6 e971f94 {/storage/json, null, the AVAILABLE}
17/06/07 17:42:33 INFO handler. ContextHandler: Started O.S.J.S.S 39 a6645 ervletContextHandler @ {/storage/RDD, null, the AVAILABLE}
17/06/07 17:42:33 INFO handler. ContextHandler: Started O.S.J.S.S ervletContextHandler @ db03ddc {/storage/RDD/json, null, the AVAILABLE}
17/06/07 17:42:33 INFO handler. ContextHandler: Started O.S.J.S.S ervletContextHandler @ 2 dad3d89 {/environment, null, and the AVAILABLE}
17/06/07 17:42:33 INFO handler. ContextHandler: Started O.S.J.S.S 48 a304cc ervletContextHandler @ {/environment/json, null, the AVAILABLE}
17/06/07 17:42:33 INFO handler. ContextHandler: Started O.S.J.S.S ervletContextHandler @ 46901255 {/executors, null, and the AVAILABLE}
17/06/07 17:42:33 INFO handler. ContextHandler: Started O.S.J.S.S ervletContextHandler @ 1 ca3aea4 {/executors/json, null, the AVAILABLE}
17/06/07 17:42:33 INFO handler. ContextHandler: Started O.S.J.S.S ervletContextHandler @ 3 e1e9fac {/executors/threadDump, null, the AVAILABLE}
17/06/07 17:42:33 INFO handler. ContextHandler: Started O.S.J.S.S ervletContextHandler @ 4 c84f510 {/executors/threadDump/json, null, the AVAILABLE}
17/06/07 17:42:33 INFO handler. ContextHandler: Started O.S.J.S.S ervletContextHandler @ 2 cf514af {/static, null, and the AVAILABLE}
17/06/07 17:42:33 INFO handler. ContextHandler: Started O.S.J.S.S ervletContextHandler @ e210438 {/, null, the AVAILABLE}
17/06/07 17:42:33 INFO handler. ContextHandler: Started O.S.J.S.S ervletContextHandler @ 199 bffc7 {/API, null, and the AVAILABLE}
17/06/07 17:42:33 INFO handler. ContextHandler: Started O.S.J.S.S 50 b56ef3 ervletContextHandler @ {/stages/stage/kill, null, the AVAILABLE}
17/06/07 17:42:33 INFO for server ServerConnector: Started ServerConnector @ 1 d6777eb HTTP/1.1} {4040} {0.0.0.0:
17/06/07 17:42:33 INFO server. Server: Started @ 2944 ms
17/06/07 17:42:33 INFO util. Utils: Successfully started service 'SparkUI on port 4040.
17/06/07 17:42:33 INFO UI. SparkUI: Bound SparkUI to 0.0.0.0, and started at http://192.168.109.2:4040
17/06/07 17:42:33 INFO executor. Executor: Starting executor ID driver on the host localhost
17/06/07 17:42:33 INFO util. Utils: Successfully started service 'org.apache.spark.network.netty.Net tyBlockTransferService' on port 55408.
17/06/07 17:42:33 INFO netty.Net tyBlockTransferService: Server created on 192.168.109.2:55408
17/06/07 17:42:33 INFO storage. BlockManager: external shuffle service port=7337
17/06/07 17:42:33 INFO storage. BlockManagerMaster: Registering BlockManager BlockManagerId (driver, 192.168.109.2, 55408)
17/06/07 17:42:33 INFO storage. BlockManagerMasterEndpoint: Registering block manager 192.168.109.2:55408 with 1993.8 MB of RAM, BlockManagerId (driver, 192.168.109.2, 55408)
17/06/07 17:42:33 INFO storage. BlockManagerMaster: Registered BlockManager BlockManagerId (driver, 192.168.109.2, 55408)
17/06/07 17:42:33 INFO handler. ContextHandler: Started O.S.J.S.S ervletContextHandler @ 573 d8208 {/metrics/json, null, the AVAILABLE}
17/06/07 17:42:33 WARN spark. SparkContext: Use an existing SparkContext, some configuration may not take effect.
nullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnullnull
  • Related