How to Setup a Trigger in Azure Data Factory that runs daily every 2 hours from 6 AM to 10 PM

Question

How to Setup a Trigger in Azure Data Factory that runs daily every 2 hours from 6 AM to 10 PM

Parsa Bahrami 20

Hello Everyone!

How to Setup a Trigger in Azure Data Factory that runs daily every 2 hours from 6 AM to 10 PM?

Thanks.

Vahid Ghafarpour 23,385 Reputation points Volunteer Moderator

2023-06-05T23:52:34.9066667+00:00
You can follow these steps suggested by ChatGPT:

Open the Azure Data Factory (ADF) portal and navigate to your data factory.

Click the "Author & Monitor" button to open the ADF authoring and monitoring UI.

In the left-hand side menu, click on "Author" to switch to the authoring canvas.

Click the "Manage" tab at the bottom on the authoring canvas.

Click on the "Triggers" tab to manage triggers.

Click on the "+ New" button to create a new trigger.

In the "New Trigger" window, provide a name for your trigger and optionally add a description.

Under the "Trigger type" section, select "Schedule" as the trigger type.

In the "Start time" field, enter the desired start time for your trigger, which is 6 AM.

In the "End time" field, enter the desired end time for your trigger, which is 10 PM.

In the "Recurrence" section, set the frequency to "Hour" and the interval to "2". This will run the trigger every 2 hours.

Optionally, you can set other properties like time zone and concurrency.

Click on the "OK" button to create the trigger.

Click the "Publish all" button on the authoring canvas to publish your changes.
Parsa Bahrami 20 Reputation points

2023-06-06T00:14:54.3066667+00:00

This is what I am seeing. I can not set a "Start time" or an "End time" other than the general start and end time and setting the end time will stop that trigger from ever executing but I don't want that.
Marella, Lavanya 0 Reputation points

2023-09-12T16:01:53.48+00:00

Hi Parsa Bahrami,

you can create a trigger under week and mention the hours .

Accepted answer

0 additional answers

Your answer

Vahid Ghafarpour 23,385 Reputation points Volunteer Moderator

2023-06-05T23:52:34.9066667+00:00

You can follow these steps suggested by ChatGPT:

Open the Azure Data Factory (ADF) portal and navigate to your data factory.

Click the "Author & Monitor" button to open the ADF authoring and monitoring UI.

In the left-hand side menu, click on "Author" to switch to the authoring canvas.

Click the "Manage" tab at the bottom on the authoring canvas.

Click on the "Triggers" tab to manage triggers.

Click on the "+ New" button to create a new trigger.

In the "New Trigger" window, provide a name for your trigger and optionally add a description.

Under the "Trigger type" section, select "Schedule" as the trigger type.

In the "Start time" field, enter the desired start time for your trigger, which is 6 AM.

In the "End time" field, enter the desired end time for your trigger, which is 10 PM.

In the "Recurrence" section, set the frequency to "Hour" and the interval to "2". This will run the trigger every 2 hours.

Optionally, you can set other properties like time zone and concurrency.

Click on the "OK" button to create the trigger.

Click the "Publish all" button on the authoring canvas to publish your changes.
Parsa Bahrami 20 Reputation points

2023-06-06T00:14:54.3066667+00:00

This is what I am seeing. I can not set a "Start time" or an "End time" other than the general start and end time and setting the end time will stop that trigger from ever executing but I don't want that.
Marella, Lavanya 0 Reputation points

2023-09-12T16:01:53.48+00:00

Hi Parsa Bahrami,

you can create a trigger under week and mention the hours .

Answer 1

ShaikMaheer-MSFT 38,546 Microsoft Employee Moderator

Hi Parsa Bahrami,

Thank you for posting query in Microsoft Q&A Platform.

If I understand correctly, you mean to say trigger should run pipeline every 2 hours daily. But it should run pipeline only between 6AM to 10PM windows. After 10PM till next 6AM it should not run pipeline. Please correct me if my understanding is wrong.

There is no direct way of doing this within trigger. You need to handle this in your Pipeline. Follow below steps to achieve same.

Step1: Create a trigger which start time is 6AM and setup reoccurrence for every 2 hours. This will run your pipeline every day for every 2 hours.

Step2: Since we dont want to run pipeline from 10PM to 6AM. Inside, your pipeline have a if activity to check the trigger time. If trigger time or pipeline run time is >= 10PM OR <= 6AM. then for that executions don't run your logic. For all other windows run your logic by keeping activities inside else or if blocks.

This way technically, when if your trigger running pipeline, it will technically valid the run time and then exclude or include activities to run.

Please note, pipeline run time or trigger time you can get from system variables or from trigger variables. Check below videos to know more about them.

System Variables in Azure Data Factory

Schedule Trigger in Azure Data Factory

Hope this helps. Please let me know if any further queries.

Please consider hitting Accept Answer button. Accepted answers help community as well.

Parsa Bahrami 20 Reputation points

2023-06-07T14:11:57.46+00:00

Hi @ShaikMaheer-MSFT
I have used the below approach and I find it simpler than what you suggested. However, thank you for your help and response!

I set the trigger to run manually at the hours 10, 12, 14, 16, and 18 and every day.
ShaikMaheer-MSFT 38,546 Reputation points Microsoft Employee Moderator

2023-06-08T10:35:27.5666667+00:00

Hi Parsa Bahrami, Great multiple trigger with defined time also works fine. Great idea. Thank you for sharing this. This will help community as well.
Please consider hitting Accept Answer button. Accepted answers help community as well. Thank you.
ShaikMaheer-MSFT 38,546 Reputation points Microsoft Employee Moderator

2023-06-12T06:42:21.9866667+00:00

Hi Parsa Bahrami, Just following up to see if you get chance to hit Accept Answer button. Accepted answers help community as well. So please consider it. Thank you.
Parsa Bahrami 20 Reputation points

2023-06-12T12:24:29.14+00:00

Yes I did.

Share via

How to Setup a Trigger in Azure Data Factory that runs daily every 2 hours from 6 AM to 10 PM

0 additional answers

Your answer