Home > other >  Met a very sick
Met a very sick

Time:10-15

Before the company made a real-time analysis sparkStreaming, retrieve data from kafka, by calculating the data window, 5 minutes with mapwithstate storage state,

When start the program for the first time (that is, the first window), everything is normal, but after the data is the first window of data, for example, the time of the first batch of data

Is 12:00, a window, 5 minutes to 12:00 at 12:05 time was that a group of data, time and does not change, but there will be incremental data, check information, before the driver

The data is read only, can't change, then use the mapwithstate still won't do,

Pray god to solve!!!!!!!!!!!!!!!!!!!
  • Related