Merging files from two different containers or storage accounts.

Question

I have some files in two different containers or storage accounts and would like to make these files available in a single container or single storage account, can this be archieved using ADF?

Answer 1

One option is to have 2 copy activities which will copy these 2 files in a single folder called staging.

Then one more Copy activity, which will point to staging folder and merge 2 files and save it to some target folder. In Copy activity property, you need to set copy behavior to merge as shown in below -

https://stackoverflow.com/questions/56550727/azure-data-factory-how-to-merge-all-files-of-a-folder-into-one-file

---

Please don't forget to Accept Answer and Up-vote if the response helped -- Vaibhav

Answer 2

You can use dataflow to copy from multiple sources into a single storage account without staging the data.