Azure Synapse Analytics "on fail" workflow not working.

Question

I have setup basic email notifications for my Azure Synapse pipeline but the task on the "on fail" workflow path does not activate. It seems the task failing halts the execution of the pipeline, yet I thought the whole point of an "on fail" task was to continue the pipeline. I have looked but not found anything yet about a setting to allow the pipeline to continue, even after a step fails??

Answer 1

Hey,

In ADF, the task works in AND format.

So the web activity for email notification would run only if your copy activity and both your SP activities fail which is logically not possible.

Hence the pipeline halts.

Please refer to this blog to make up the necessary changes :

https://datasharkx.wordpress.com/2021/08/19/error-logging-and-the-art-of-avoiding-redundant-activities-in-azure-data-factory/