Use of Yaml file to schedule the ADF pipeline dynamically

Question

Is it possible to use yaml file on scheduling ADF pipeline dynamically. We know that we have schedule triggers available inside our ADF where we can define the interval based on which pipeline will be triggered, but if I want to trigger dynamically, can we do that.
Ex: Currently my pipeline is scheduled to run at every 2 hours, but if I want to change the interval dynamically, so is it possible to change it to 3 hours dynamically via yaml file. If yes, please share the steps we can follow for the implementation.

Answer 1

Hello Harshita Vishwakarma,

Thanks for your question.

Dynamically changing the schedule using a YAML file isn't a feature of ADF. Try Github actions/Azure Devops or Azure services. You can consider:

• Store your schedule configuration in a YAML file: Create a YAML file that defines your schedule. Store this YAML file in Azure Blob Storage or Azure Data Lake Storage.
• Create an Azure Function that can read the YAML, parses the schedule information and updates the ADF trigger using the ADF REST API
• Set up an Azure Logic App or another Azure Function that calls the function and runs the schedule.

See: https://learn.microsoft.com/en-us/azure/devops/pipelines/process/scheduled-triggers?view=azure-devops&source=recommendations&tabs=yaml

https://learn.microsoft.com/en-us/azure/data-factory/how-to-create-schedule-trigger?source=recommendations&tabs=data-factory

You can mark it 'Accept Answer' and 'Upvote' if this helped you

Regards,

Abiola