Trigger Azure Datafactory pipeline when a file is dropped on File Share

Arpit Arpan 1 Reputation point
2021-04-02T10:27:48.953+00:00

I have a file share on which file is dropped .As soon as it is dropped on File Share ,It should trigger my first pipeline.Once that pipeline is complete ,i can trigger another pipeline and third when second pipeline is done.
If any pipeline fails ,we need to fail other pipelines.

Please come up with a solution

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
9,487 questions
0 comments No comments
{count} votes

2 answers

Sort by: Most helpful
  1. Nandan Hegde 29,886 Reputation points MVP
    2021-04-02T11:12:12.83+00:00

    Hey @Anonymous ,
    Based on my knowledge it is not possible to have trigger in file Share.
    Neither Azure function nor ADF nor Logic App supports triggers on Azure file share.

    similar threads:
    https://stackoverflow.com/questions/64710485/azure-trigger-function-for-file-share

    https://learn.microsoft.com/en-us/answers/questions/114300/how-to-set-up-automatice-trigger-for-azure-file-sh.html

    https://stackoverflow.com/questions/50311648/can-azure-event-grid-listen-to-changes-in-azure-file-shares

    The only way would be to periodically search for the file based on scheduled trigger .

    @Nasreen Akter @HimanshuSinha-msft @KranthiPakala-MSFT : Any other ideas or thoughts or as to when ADF would enable File share trigger

    0 comments No comments

  2. KranthiPakala-MSFT 46,422 Reputation points Microsoft Employee
    2021-04-05T22:02:09.757+00:00

    Hi @Anonymous ,

    As @Nandan Hegde suggested, the ADF Storage Event Trigger currently supports only Azure Data Lake Storage Gen2 and General-purpose version 2 storage accounts.

    Other than schedule trigger I don't see any options.

    Here are couple of existing user voice feedback threads on the same request, please feel free to upvote and comment on these ideas to increase the priority of the feature requests.

    1. https://feedback.azure.com/forums/270578-data-factory/suggestions/39633481-event-based-triggers-should-support-sftp-and-file
    2. https://feedback.azure.com/forums/270578-data-factory/suggestions/41901247-trigger-for-events-in-azure-file-share

    Do let us know if you have any further query.

    Thank you @Nandan Hegde , for sharing helpful links here.

    Thanks