Azure Data Factory Web Activity Duration Increased

Question

Azure Data Factory Web Activity Duration Increased

Joan Marc Capell 0

Hi,

We have two pipelines on Azure Data factory, each one starts with a web activity that starts the Integration Runtime, then we execute some SSIS package, and finally we have another web activity that turns off the Integration Runtime.

All this seems that runs correctly, but last 3 days it happens an increase of the duration only of the first web activity, the one that starts the process. Normally it's duration was between 2 and 3 minutes, but last days was between 30 and 35 minutes.

This is a post example of the web Activity:

{

"url": "https://management.azure.com/subscriptions/f7169006-806e-4b88-b7c5-130c45fe4b24/resourcegroups/datafactory-rg362/providers/Microsoft.DataFactory/factories/servetodf/integrationruntimes/integrationRuntimeSVT/start?api-version=2018-06-01",

"method": "POST",

"headers": {},

"body": {

    "message": "Start my IR"

},

"authentication": {

    "type": "MSI",

    "resource": "https://management.azure.com/"

}

}

Thanks

Smaran Thoomu 32,530 Reputation points Microsoft External Staff Moderator

2024-03-06T11:25:43.85+00:00

@Joan Marc Capell We haven’t heard from you on the last response and was just checking back to see if you have a resolution yet. In case if you have any resolution please do share that same with the community as it can be helpful to others. Otherwise, will respond with more details and we will try to help.

1 answer

Your answer

Smaran Thoomu 32,530 Reputation points Microsoft External Staff Moderator

2024-03-06T11:25:43.85+00:00

@Joan Marc Capell We haven’t heard from you on the last response and was just checking back to see if you have a resolution yet. In case if you have any resolution please do share that same with the community as it can be helpful to others. Otherwise, will respond with more details and we will try to help.

Answer 1

Hi @Joan Marc Capell

Thank you for posting query in Microsoft Q&A Platform.

As I understand that the duration of the first web activity in your Azure Data Factory pipeline has increased significantly in the last three days. The web activity is responsible for starting the Integration Runtime, and you have noticed that it now takes between 30 and 35 minutes to complete, whereas it used to take only 2 to 3 minutes.

One possible reason for this issue could be related to the performance of the Integration Runtime. You may want to check the status of the Integration Runtime and ensure that it is running correctly. You can do this by navigating to the Integration Runtimes section in your Azure Data Factory and checking the status of the Integration Runtime associated with your pipeline. You can also check the logs for the Integration Runtime to see if there are any errors or warnings that could be causing the issue. User's image

Also, check the pipeline metrics, performance and configuration to see if there are any spikes in activity that might be causing the delay.

I hope this helps! Let me know if you have any further questions.

Joan Marc Capell 0 Reputation points

2024-03-04T16:50:00.8033333+00:00

Hi,

Yes, the duration has increased, and there is no reason for that.

I show you one normal execution:

And this is the longer one:

Now, I'm trying to start the Integration Runtime manually, and it also seems the process was taking so long.

Thanks
Deleted

This comment has been deleted due to a violation of our Code of Conduct. The comment was manually reported or identified through automated detection before action was taken. Please refer to our Code of Conduct for more information.

Share via

Azure Data Factory Web Activity Duration Increased

1 answer

Your answer