I have ADF pipeline which internally executes Azure Databricks notebook using Notebook activity. But this ADF pipeline is getting timed-out after 7 Days due to databricks notebook activity maximum run for 7 Days.
Are there any other ADF features/abilities to automatically restart sample ADF pipeline when its timed-out after 7 Days?
I tried to use retry Option from Azure Databricks notebook activity itself but that always retrying even though its the ADF failed/stopped/cancelled pipeline manually due to various reasons.
I am looking for way to restart to execute pipeline when its timed-out only or avoid time out limits.