Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,661 questions
Map files in an Azure Blob Storage to Custom Activities
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(169.60000000000002, 54%, 26%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EHD%3C/text%3E%3C/svg%3E)
Henry Duval
1
Reputation point
Say I have a container with 100 binary files. How can I use Azure Data Factory to process each file in a separate instance of a custom activity?
Azure Data Factory
{count} votes
-
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(192, 26%, 28%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EHM%3C/text%3E%3C/svg%3E)
HimanshuSinha-msft 19,491 Reputation points Microsoft Employee Moderator2022-11-14T20:00:33.693+00:00 Hello @Henry Duval ,
Thanks for the question and using MS Q&A platform.
Is the ask here to process these 100 files using different Azure batch resource or you are planning to use the same Azure batch instance .
If you are planning to use the same Azure batch instance , the you can read all the 100 files using Metadata activity ( https://learn.microsoft.com/en-us/azure/data-factory/control-flow-get-metadata-activity) and then add a FE loop and inside the FE loop you can add the custom activity .
We will wait to hear from you . .
Thanks
Himanshu -
HimanshuSinha-msft 19,491 Reputation points Microsoft Employee Moderator
2022-11-17T05:40:08.55+00:00 Hello @Henry Duval ,
We haven’t heard from you on the last response and was just checking back to see if you have a resolution yet .In case if you have any resolution please do share that same with the community as it can be helpful to others . Otherwise, will respond back with the more details and we will try to help .
Thanks
Himanshu -
HimanshuSinha-msft 19,491 Reputation points Microsoft Employee Moderator
2022-11-17T20:05:38.053+00:00 Hello @Henry Duval ,
We haven’t heard from you on the last response and was just checking back to see if you have a resolution yet .In case if you have any resolution please do share that same with the community as it can be helpful to others .
If you have any question relating to the current thread, please do let us know and we will try out best to help you.
In case if you have any other question on a different issue, we request you to open a new thread .
Thanks
Himanshu
Sign in to comment
Sign in to answer