Share via

How to check ADF to wait for sometime or to run pipline only after arrival of file

Sarvesh Pandey 71 Reputation points
2022-05-26T14:53:54.113+00:00

Hi Team, we have a ADF which check file in ADLS source location. daily 6 files uploaded in the source location but due to some issue, 6th file takes more time to load. This creates problem as pipeline has "Getmetadata" activity which runs on "Childtime" and provides the file name present in the location. At that time, it give 5 file name. Can we apply some condition if all 6 files arrives then only next activity get started.

Note - only 6 files arrives daily with same name with datetime format.

Can you please shoe or send some reference blog how to solve this issue?

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.

1 answer

Sort by: Most helpful
Most helpful Newest Oldest
  1. Nandan Hegde 36,716 Reputation points MVP Volunteer Moderator
    2022-05-26T15:12:06.897+00:00

    Hey,
    you can use event trigger to execute the pipeline whenever a file is uploaded in blob/data lake.
    Use Getmetadata activity to get the count of files and then leverage IF activity to proceed with further tasks if the count is 6 else ignore

    0 comments

Your answer

Answers can be marked as 'Accepted' by the question author and 'Recommended' by moderators, which helps users know the answer solved the author's problem.