Home > other >  Excuse me each great god, and did sparkStreaming updateState such an approach similar to the reduce
Excuse me each great god, and did sparkStreaming updateState such an approach similar to the reduce

Time:09-20

Now has a set of data (K, V), I want to use sparkStream can realize the function of update accumulation, accumulation of K and V do
But found only updateStateBykey sparkStreaming (corresponding) and spark reduceByKey, but not with the spark in the reduce method for
Excuse me each great god what convenient solution, without having to map data,

CodePudding user response:

Remind: sparkStreaming is open source,
  • Related