question

ArpitArpan-6509 avatar image
0 Votes"
ArpitArpan-6509 asked KranthiPakala-MSFT commented

Trigger Azure Datafactory pipeline when a file is dropped on File Share

I have a file share on which file is dropped .As soon as it is dropped on File Share ,It should trigger my first pipeline.Once that pipeline is complete ,i can trigger another pipeline and third when second pipeline is done.
If any pipeline fails ,we need to fail other pipelines.

Please come up with a solution

azure-data-factory
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

NandanHegde-7720 avatar image
0 Votes"
NandanHegde-7720 answered

Hey @ArpitArpan-6509 ,
Based on my knowledge it is not possible to have trigger in file Share.
Neither Azure function nor ADF nor Logic App supports triggers on Azure file share.

similar threads:
https://stackoverflow.com/questions/64710485/azure-trigger-function-for-file-share

https://docs.microsoft.com/en-us/answers/questions/114300/how-to-set-up-automatice-trigger-for-azure-file-sh.html

https://stackoverflow.com/questions/50311648/can-azure-event-grid-listen-to-changes-in-azure-file-shares

The only way would be to periodically search for the file based on scheduled trigger .

@nasreen-akter @HimanshuSinha-MSFT @KranthiPakala-MSFT : Any other ideas or thoughts or as to when ADF would enable File share trigger

5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

KranthiPakala-MSFT avatar image
0 Votes"
KranthiPakala-MSFT answered KranthiPakala-MSFT commented

Hi @ArpitArpan-6509 ,

As @NandanHegde-7720 suggested, the ADF Storage Event Trigger currently supports only Azure Data Lake Storage Gen2 and General-purpose version 2 storage accounts.

Other than schedule trigger I don't see any options.

Here are couple of existing user voice feedback threads on the same request, please feel free to upvote and comment on these ideas to increase the priority of the feature requests.

  1. https://feedback.azure.com/forums/270578-data-factory/suggestions/39633481-event-based-triggers-should-support-sftp-and-file

  2. https://feedback.azure.com/forums/270578-data-factory/suggestions/41901247-trigger-for-events-in-azure-file-share

Do let us know if you have any further query.

Thank you @NandanHegde-7720 , for sharing helpful links here.

Thanks





· 1
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

Hi @ArpitArpan-6509 ,

We still have not heard back from you. Just wanted to check if the above suggestions were helpful? If it answers your query, please do click “Accept Answer” and/or Up-Vote, as it might be beneficial to other community members reading this thread. And, if you have any further query do let us know.


Thanks

0 Votes 0 ·