Generate Email Alerts through logic apps to check if files have been placed in the blob storage.

Abdullah Zaheed 0 Reputation points
2023-02-22T10:43:27.8466667+00:00

Hi, I have been tasked every morning to check if the vendor has placed specific files in the blob storage account. The files are placed in the blob in accordance with the date. I have to manually check each morning if these files are correctly placed in the folder. My question is if I could generate emails which would check if files are present in today's folder and then execute our pipelines accordingly. I have generated emails to check if our pipelines have succesfully executed using the web alert activity in addition with azure logic apps, I was wondering if there is a similar work around for this.User's image

Azure Blob Storage
Azure Blob Storage
An Azure service that stores unstructured data in the cloud as blobs.
3,116 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,350 questions
{count} votes

1 answer

Sort by: Most helpful
  1. AnnuKumari-MSFT 34,351 Reputation points Microsoft Employee
    2023-02-23T09:29:08.7566667+00:00

    @Abdullah Zaheed ,

    Welcome to Microsoft Q&A platform and thanks for posting your query here.

    As I understand your issue, after performing the validation if the file is present in today's folder, then you want to execute the adf pipeline . Please let me know if that is not the ask here.

    • You can use getmetadata activity to check the presence of file in the folder , make sure to parameterize the foldername as you have to check for current date folder everyday.
    • Use If block to validate if getmetadata activity output is true that means if the file exists, then inside if block, use execute pipeline activity to call the pipeline that you have or else use web activity to send out an email with confirmation of file existence.

    This approach would be more relevant if you need to check every day at a certain time if the file exists then run a pipeline. If your requirement is to trigger the pipeline immediately when the file arrives, then go for storage event trigger.

    Helpful resources:

    How to Check if File Exists or Does not Exist in Blob Storage and Send Email in Azure Data Factory

    Create a trigger that runs a pipeline in response to a storage event

    Event based Triggers in Azure Data Factory


    Hope it helps. Kindly click on Accept answer if you found it helpful and hit yes for was the answer helpful survey. Thanks


Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.