Alert at a specified time when an Event Triggered Data Factory Pipeline has not fired

Gary Knowles 1 Reputation point
2022-05-12T15:10:39.627+00:00

I have created many alerts when something goes wrong in a Data Factory pipeline, but seem to be struggling to find a solution to having an alerting method when an event triggered pipeline has not fired by a particular time. For example pipeline A is triggered by a storage event trigger. At say 3pm I would like to have something alert me to the fact that the pipeline has not run today. Ideas? I was looking at Log Analytics and can easily generate a Kusto query that shows me the pipeline has not run, but have not quite figured out a good way to schedule the alert to only fire at 3pm.

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,203 questions
0 comments No comments
{count} votes

1 answer

Sort by: Most helpful
  1. ShaikMaheer-MSFT 38,506 Reputation points Microsoft Employee
    2022-05-16T12:17:26.29+00:00

    Hi @Gary Knowles ,

    Thank you for posting query in Microsoft Q&A Platform.

    You can consider using Logic app with timer trigger to run at 3PM which checks if your pipeline has ran or not and then send email alert to you accordingly.

    In logic app, you should consider making API call to Azure data factory service to see your pipeline execution details and then define workflow in logicapp to send email accordingly.

    Kindly check below REST API documentation to details related to API calls to made.
    https://learn.microsoft.com/en-us/rest/api/datafactory/pipelines

    Hope this helps. Please let us know if any further queries.

    --------------

    Please consider hitting accept answer button. Accepted answers help community as well.


Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.