Home > Software design >  Azure Data Factory: Cannot save the output of Set Variable into file/Database
Azure Data Factory: Cannot save the output of Set Variable into file/Database

Time:04-24

I'm trying to store a list of file names within an Azure Blob container into a SQL db. The pipeline runs successfully, but after running the pipeline, it cannot output the values (file names) into the sink database, and the sink table doesn't get updated even after the pipeline completed. Followings are the steps I went through to implement the pipeline. I wonder which steps I made mistake.

I have followed the solutions given in the following links as well:

https://docs.microsoft.com/en-us/azure/data-factory/copy-activity-overview#add-additional-columns-during-copy

enter image description here

  1. You can skip using Set variable activity as you can use the Foreach current item directly in the Additional column dynamic expression.

enter image description here

  1. Add additional columns in the Mapping.

enter image description here

  1. Sink results in SQL database.

enter image description here

  • Related