Home > other >  The Spark streaming do real-time data processing
The Spark streaming do real-time data processing

Time:09-27

Now based on spark streaming online query, in accordance with the information, I have finished streaming context starts, can't again to add a new streaming calculation or operation, in this way, if I want to make many kinds of query, real-time means must restart streamingContext repeatedly to achieve?
Because the storm is not very understand, don't know whether there is a storm this aspect to realize the method?

Hope to have experience of friends can be solved,

CodePudding user response:

The query conditions do logic, according to your incoming query types, call different calculation

CodePudding user response:

reference 1st floor dlh13061201 response:
do logic of the query terms, according to your incoming query types, call different computing


Foreachrdd parse out in each of the data, then write in foreachrdd RDD logic, don't have to write Dstream logic
  • Related