Home > Blockchain >  How to Append Files with Azure Data Factory
How to Append Files with Azure Data Factory

Time:10-07

I have tried Flatten Hierarchy, Merge Files and Preserve Hierarchy in my attempts to Append or Merge files with Data Factory, but it will neither Append or Merge enter image description here

The Sink looks like the following:

enter image description here

Can someone let me know how to configure Data Factory to merge files please

CodePudding user response:

To merge the files, use the copy activity after the ForEach loop.

First copy the individual files from REST to ADLS folder using the above loop. Then use another copy activity with source (give the datasets folder path).

Use Wildcard path. Here I have used csv for sample.

enter image description here

Now in sink, use merge option.

enter image description here

files with same structure from REST API copied to ADLS folder.

enter image description here

Final csv file after merging.

enter image description here

  • Related