How to schedule an azure datafactory pipeline to run on every 'n'th business day of a month

Question

How to schedule an azure datafactory pipeline to run on every 'n'th business day of a month

Prasenjit Patnaik 50

Hi,

I need an urgent help. I need to schedule an Azure data factory pipeline that runs every 10th business day of the month(Saturday & Sunday are not business day). for example, if we exclude Sat & Sun, then 10th Business day for Jun2023 falls on 14th June. The next 10th business day falls on 28th and so on. So the ADF pipeline should run on those dates. Can someone help me please.

Thanks,

Prasenjit

QuantumCache 20,366 Reputation points Moderator

2023-06-23T00:05:51.86+00:00

Hello @Prasenjit Patnaik,,
Just checking if we are still connected on this discussion? Please let us know if you need to add more info so that we better assist you!

If the response is helpful, please click "Accept Answer" and upvote it. So that we can close this thread.

Accepted answer

0 additional answers

Your answer

QuantumCache 20,366 Reputation points Moderator

2023-06-23T00:05:51.86+00:00

Hello @Prasenjit Patnaik,,
Just checking if we are still connected on this discussion? Please let us know if you need to add more info so that we better assist you!

If the response is helpful, please click "Accept Answer" and upvote it. So that we can close this thread.

Answer 1

QuantumCache 20,366 Moderator

Hello @Prasenjit Patnaik,, Did you try other trigger types such as Logic Apps? or any other triggers which give full flexibility on custom scheduling window?

I too see that there is no direct out of the box solution for such scenario, but we have many workarounds for this scenario!

One of the workarounds might be:

User's image

You can schedule an Azure Data Factory pipeline to run on the 10th business day of the month using a combination of the Schedule trigger and an Azure Function that calculates the date of the 10th business day! Your Pipeline's Copy Activity can be controlled in this way!!!

Prasenjit Patnaik 50 Reputation points

2023-06-23T05:52:25.1666667+00:00

Hi,

Your solution looks doable, however I took a naive approach. Below are the steps.

1: Extract all the dates of the month and put them in a SQL table such as Run_dates etc

2: Remove all Saturday and sunday.

3:Sort them and filter as Row_number%10 =0 to find all the 10th day

4: Create a trigger that runs everyday and reads a lookup from Run_dates table and if the current date exists in the lookup then its a 10th working day--> so run the pipeline, else ignore.

I understand this is not a very good approach as you have to maintain the dates in the table for future runs periodically.

I would sure try my hands on the solution that you have provided above.

Thanks.

Share via

How to schedule an azure datafactory pipeline to run on every 'n'th business day of a month

0 additional answers

Your answer