Spark receive the kafka data Streaming, output to the HBas-CodePudding

Home > other > Spark receive the kafka data Streaming, output to the HBas

Spark receive the kafka data Streaming, output to the HBas

Time：09-19

Demand Kafka + SparkStreaming + HBase

CodePudding user response:

Sparkstreaming - kakfa under the jars, and then the good related HBase jar package
Development of kafka can use KafkaUtils createDirectStream and createStream class loading data flow
And then through the data stream foreachRDD RDD, use of RDD mapPartitions class to kafka data to HBase, note mapPartitions need to collect will truly implemented

Page link：https//www.codepudding.com/other/13595.html

Prev:Those cloud computing (What)

Next:Spark source reading environment set up

Tags：

Spark

Links：
CodePudding