Create a logic app for failure notification

Question

How can I create a logic app that sends failure notifications via email when an activity fails in a pipeline in Azure Synapse? Any guidance on the steps to follow or resources to refer to would be appreciated.

Answer 1

What do you need before ?

• An Azure subscription
• Azure Synapse Analytics workspace
• Azure Logic Apps
• An email service connection in Logic Apps (Office 365, Outlook.com, or Gmail...).

Step 1: Set Up Failure Alert in Azure Synapse Analytics

1. In Azure Synapse Analytics, navigate to the Monitoring section, and create an alert for your pipeline. The alert should be configured to trigger on pipeline failure.
2. Ensure that your Synapse Analytics workspace is configured to send events to Azure Event Grid. This setup allows Azure Event Grid to listen for the specific event of a pipeline failure.

Step 2: Create a Logic App

1. In the Azure portal, create a new Logic App in your resource group.
2. Choose to start with a blank template for your workflow.

Step 3: Set Up the Trigger

1. Configure the Logic App trigger to be "When an event is received from Azure Event Grid." This step requires you to specify the subscription and resource type (Azure Synapse Analytics) you're listening to for events.
2. In the trigger, specify the event type that corresponds to a pipeline failure. This will ensure the Logic App runs when a failure event is detected.

Step 4: Parse the Event Data

1. Use the "Parse JSON" action to extract relevant data from the event payload. This includes details like the pipeline name, failure status, and error message.
2. You might need to provide a schema for the JSON parsing action. You can obtain this by triggering a test failure and copying the event data structure.

Step 5: Configure Email Notification

1. Add an action to send an email. Choose the appropriate connector based on your email service
2. Use the parsed JSON data to configure the email. Include details like the failed pipeline name, error message, and any other relevant information in the email subject and body.

Check the following links for guidance :

https://learn.microsoft.com/en-us/azure/logic-apps/logic-apps-overview

https://learn.microsoft.com/en-us/azure/event-grid/overview

Answer 2

Hi @ADITYA SINGH

Thanks for the question and using MS Q&A platform.

In addition to the above answer, I recommend checking out the following link. It can help you understand how to create a logic app that sends email notifications when an activity fails in a pipeline. This video may be helpful for your needs: https://www.youtube.com/watch?v=nN_tkoh4Nps

Hope this helps. Do let us know if you any further queries.