can scheduled job run in parallel or wait for complete of first job.

Question

can scheduled job run in parallel or wait for complete of first job.

Girish13 1

Hi ,

I have one scenario lets considered I have one jobs run which is run every 5 min and process the data and load into target table. sometime to load data in to target table it will take 10 min and sometime it will take 2 min.

so my question is when next job will start then it will wait for completion of previous job or it will execute as per scheduled.

Nasreen Akter 10,811 Reputation points Volunteer Moderator

2020-12-28T20:44:56.65+00:00

Hi @Girish13 , just following up to see if the below response was helpful. If it was, would you please "accept as answer" and "up-vote" it. Thank you!
HarithaMaddi-MSFT 10,146 Reputation points

2020-12-30T12:30:36.483+00:00

Hi @Girish13 ,

We have not received a response from you. Please suggest if below suggested approach is helpful. Otherwise, let us know and we will continue to engage with you on the query.

Please do consider to click on "Accept Answer" and "Up-vote" on the post that helps you, as it can be beneficial to other community members.
HarithaMaddi-MSFT 10,146 Reputation points

2020-12-31T12:16:05.46+00:00
Hi @Girish13 ,

We still have not heard back from you. Please suggest if below suggested approach is helpful. Otherwise, let us know and we will continue to engage with you on the query.

--

Please accept an answer if correct. Original posters help the community find answers faster by identifying the correct answer. Here is how.

Want a reminder to come back and check responses? Here is how to subscribe to a notification.

1 answer

Your answer

Nasreen Akter 10,811 Reputation points Volunteer Moderator

2020-12-28T20:44:56.65+00:00

Hi @Girish13 , just following up to see if the below response was helpful. If it was, would you please "accept as answer" and "up-vote" it. Thank you!
HarithaMaddi-MSFT 10,146 Reputation points

2020-12-30T12:30:36.483+00:00

Hi @Girish13 ,

We have not received a response from you. Please suggest if below suggested approach is helpful. Otherwise, let us know and we will continue to engage with you on the query.

Please do consider to click on "Accept Answer" and "Up-vote" on the post that helps you, as it can be beneficial to other community members.
HarithaMaddi-MSFT 10,146 Reputation points

2020-12-31T12:16:05.46+00:00

Hi @Girish13 ,

We still have not heard back from you. Please suggest if below suggested approach is helpful. Otherwise, let us know and we will continue to engage with you on the query.

--

Please accept an answer if correct. Original posters help the community find answers faster by identifying the correct answer. Here is how.

Want a reminder to come back and check responses? Here is how to subscribe to a notification.

Answer 1

Hi @Girish13 ,

In this scenario schedule trigger will not work, you need tumbling window trigger. Schedule trigger will only execute per schedule and the pipelines associated with the trigger could run in parallel.

Tumbling window trigger has a self-dependency property which means the trigger shouldn't proceed to the next window until the preceding window is successfully completed. Also tumbling window triggers can be configured to initiate past and future dated loads, whereas schedule trigger can only trigger future dated loads. For more details please see the links below.

Hope this helps. If it does, please don't forget to "accept the answer" and "up-vote"! Thank you!

Useful links:
https://www.mssqltips.com/sqlservertip/6061/create-tumbling-window-trigger-in-azure-data-factory-adf/
https://learn.microsoft.com/en-us/azure/data-factory/tumbling-window-trigger-dependency

Share via

can scheduled job run in parallel or wait for complete of first job.

1 answer

Your answer