Web Activity - Push Method to ADLS failing with Unable to reach exception.

Question

Hi All,

I have a pipeline which gets the data from API and places in ADLS. These both activities are provisioned using Web Activity inside a foreach loop. Sometimes the pipeline runs successfully end-end but fails intermittently with an exception that the blob storage cannot be reached as shown in the screenshot. This happens only on one of many iterations in foreach loop. I am not sure if this is due to my oversight of any settings or anything to do with the connectivity / time out ?

Please advise.

Thank you!

Answer 1

Hi PS,

Thank you for posting query in Microsoft Q&A Platform.

From the error, it seems ADF client is not able to reach storage end point. It may happen due to reasons such as network issues or firewall or proxy error or DNS errors. But in your case, it seems its only failing sometimes and getting success in next run. So looks intermittent issue only. Kindly try below and see if that helps.

• If you are hitting same server in iterations, then try to use wait activity between API calls to push some delay between subsequent API calls and see if that helps.
• You can leverage retry option inside web activity that helps to re-run the activity if it fails.

If still issue persists, I would encourage you to have support case on this issue to investigate more deeply for root cause and resolution. Click here to create azure support ticket.

Hope this helps. Please let me know how it goes or if any further queries.

---

Please consider hitting Accept Answer button. Accepted answers help community as well.

Answer 2

Hi, Usually in such scenario, setting the retry option to incremental values until it satisfies the conditions. Usually, it happens due to network contention and any slight disruption could be the cause of it. But as you have already resolved it, hope this helps in future