How to Cancel long Running Azure synapse pipeline programatically Via Pipeline it-self

Question

Hi

My Requirement is if Azure Synapse pipeline running more than 2.45 hrs. I need cancel that pipeline Automatically/Programmatically .How to achieve this

Via Pipeline it-self

Answer 1

Normally it will complete by 2 hrs. some times due to network issues it is keep on running. So we need to Cancel programmatically not manually in Monitor UI .Do we have any Abort() or Stop ()built-ins command like informatica in Azure Synapse.

Answer 2

Similar thread:

https://stackoverflow.com/questions/69630913/cancel-synapse-pipeline-from-the-pipeline-itself#:~:text=NOTE%3A%20the%20REST%20API%20is,pipelines%20and%20then%20trigger%20them.

you can use the REST API :

https://learn.microsoft.com/en-us/rest/api/synapse/data-plane/pipeline-run/cancel-pipeline-run?tabs=HTTP

Updated Answer :

You can follow the below flow to achieve the ask :

1. at the end of the normal flow, have a set variable activity to assign a value to a variable w.r.t Pipeline status
2. In parallel , have an until activity to validate whether the execution time has exceeded the timeout value or the pipeline has completed and accordingly, take the necessary actions.

below blog explains it in detail : https://datasharkx.wordpress.com/2023/09/21/auto-cancel-long-running-pipelines-within-synapse-azure-data-factory/