Randomly occurring error while executing Web activity in ADF

Question

Randomly occurring error while executing Web activity in ADF

AS 20

Hi,

I use a web activity to call the SAP API and get the actual token. I use it in an ADF where I have one main pipe that executes multiple pipes, each starting with this web activity, and in 2 other ADFs where I call this API only once. Occasionally, in a random ADF, in a random pipe, an error occurs after about 45 seconds:

Operation on target Get_Access_Token failed: Error calling the endpoint '[ws addres]' Response status code: 'NA - Unknown'. More details: Exception message: 'NA - Unknown [ClientSideException] An error occurred while sending the request.'. Request didn't reach the server from the client. This could happen because of an underlying issue such as network connectivity, a DNS failure, a server certificate validation or a timeout.

We called it in Postman on 2 computers at the same time for about a minute and didn't receive any error. Each of the dozens of calls completes successfully after about 1 sec.

Below you can see my Web Activity settings in ADF:

User's image

Thank you in advance for any answers that can help solve this issue.

QuantumCache 20,371 Reputation points Moderator

2023-06-20T18:59:56.6966667+00:00

Hello AS,

Just checking if we are still connected on this discussion? Please let us know if you need to add more info so that we better assist you!

Accepted answer

0 additional answers

Your answer

QuantumCache 20,371 Reputation points Moderator

2023-06-20T18:59:56.6966667+00:00

Hello AS,

Just checking if we are still connected on this discussion? Please let us know if you need to add more info so that we better assist you!

Answer 1

QuantumCache 20,371 Moderator

Hello @AS,

Thanks for reaching out on this forum.

Did you try increasing the timeout in the Web Activity settings!
You can set a retry policy for the Web Activity in case it fails due to these intermittent issues.
Check the documentation of your API to see if there are any API Throttling limits.

If the issue is still effecting intermittently, please do let us know and we will help you troubleshoot the issue!
User's image

AS 20 Reputation points

2023-06-21T06:46:36.2666667+00:00

Hi Satish,

Thank you for your reply. I tested it for the past week and it seems to be working.

I would appreciate you telling a little more why it worked. I would like to understand for future projects :)

It takes 3 seconds to get an access token from SAP API if it succeeds and 47 seconds if it fails. I set the activity's TimeOut to 5 minutes, so that should be more than enough. Why did extending it to 12 hours (or even 1 hour - I'm testing this week ;) ) work? Are there any activities on the Azure side that take longer, but there is no trace of them shown in the pipeline run details?

Thank you once more for your help in this matter!

Share via

Randomly occurring error while executing Web activity in ADF

0 additional answers

Your answer