Home > database >  Writing in the same files using Spring Batch
Writing in the same files using Spring Batch

Time:09-01

I am trying to build the batch application in which I will pick the files from the some folders, filter them using name, pass them to the batch operation using MultiResourceItemReader. Then I will implement my own ItemProcessor to change few rows based on some condition.

My requirement is to write the updated data in the same files I am taking input from, I don't know if we can really do this with Spring Batch.

So basically I can't think of how to implement the ItemWriter here, because I need to write the data to the same file and at the same time to the multiple files.

I guess ClassifierCompositeItemWriter can be used here or MultiResourceItemWriter, I have tried to read about them in different stackoverflow answers, but couldn't find anything related to my requirement.

Can anyone help me to implement this.

Code example would be really helpful.

Thanks

CodePudding user response:

While this should be technically possible, I'm not sure it is a good idea for restartability. What would you do if something goes wrong? The input file would have been overridden with new data and you would lose the original items.

I'm probably missing something here, but I see no reason not to keep the original file, which could be deleted before the new one is renamed with the same name in a final step at the end of the job (after all the processing has been successfully done).

  • Related