Home > Software engineering >  Overwrite sql table with new data in Azure Dataflow
Overwrite sql table with new data in Azure Dataflow

Time:11-24

Here is my situation. Iam using Alteryx ETL tool where in basically we are appending new records to tableau by using option provided like 'Overwrite the file'.

What it does is any data incoming is captured to the target and delete the old data--> publish results in Tableau visualisation tool.

So whatever data coming in source must overwrite the existing data in Sink table.

How can we achieve this in Azure data Flow?

CodePudding user response:

If your requirement is just to copy data from your source to target and truncate the table data before the latest data is copied, then you can just use a copy activity in Azure Data factory. In copy activity you have an option called Pre-copy script, in which you can specify a query to truncate the table data and then proceed with copying the latest data.

enter image description here

Here is an article by a community volunteer where a similar requirement has been discussed with various approaches - enter image description here

  • Related