I have tried Flatten Hierarchy, Merge Files and Preserve Hierarchy in my attempts to Append or Merge files with Data Factory, but it will neither Append or Merge
The Sink looks like the following:
Can someone let me know how to configure Data Factory to merge files please
CodePudding user response:
To merge the files, use the copy activity after the ForEach loop.
First copy the individual files from REST to ADLS folder using the above loop. Then use another copy activity with source (give the datasets folder path).
Use Wildcard path. Here I have used csv for sample.
Now in sink, use merge option.
files with same structure from REST API copied to ADLS folder.
Final csv file after merging.