question

AdeKunah-6680 avatar image
0 Votes"
AdeKunah-6680 asked KranthiPakala-MSFT commented

Merging files from two different containers or storage accounts.

I have some files in two different containers or storage accounts and would like to make these files available in a single container or single storage account, can this be archieved using ADF?

azure-data-factory
· 2
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

Hi @adekunah-6680,

Thank for reaching out here.

Just checking in to see if the below suggestion from @VaibhavChaudhari was helpful. If it answers your query, please do click “Accept Answer” and/or Up-Vote, as it might be beneficial to other community members reading this thread.

And, if you have any further query do let us know.

Thank you

0 Votes 0 ·

Hi @adekunah-6680,

We still have not heard back from you. Just wanted to check if the any of the below suggestions were helpful? If it answers your query, please do click “Accept Answer” and/or Up-Vote, as it might be beneficial to other community members reading this thread. And, if you have any further query do let us know.

Thanks

0 Votes 0 ·
VaibhavChaudhari avatar image
0 Votes"
VaibhavChaudhari answered

One option is to have 2 copy activities which will copy these 2 files in a single folder called staging.

Then one more Copy activity, which will point to staging folder and merge 2 files and save it to some target folder. In Copy activity property, you need to set copy behavior to merge as shown in below -

https://stackoverflow.com/questions/56550727/azure-data-factory-how-to-merge-all-files-of-a-folder-into-one-file


Please don't forget to Accept Answer and Up-vote if the response helped -- Vaibhav

5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

Kiran-MSFT avatar image
0 Votes"
Kiran-MSFT answered

You can use dataflow to copy from multiple sources into a single storage account without staging the data.

5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.