How to download all my blobs using URLs using node js.

Question

We have a web app which is used to uplaod several iages against a project .

There are multiple subprojects and sub-sub -projects inside it,

While uploading we have used blob storage to store all the images/files.

Now to create the reports, we are trying to fetch all the images using promises in JS but after fetching few images, I can see a lot of ETIMEOutERR.

Once this error comes, a lot of fetch requests fails and then after 50-40 secs, the fetch requests start to work again.

Please help how to tackle this issue?

Answer 1

Hi @abhinovpankaj

Thanks for reaching Microsoft Q&A, and sorry for the delay.

It sounds like you are experiencing timeouts while fetching images from your blob storage, and this might be related to the number of simultaneous requests or the network conditions. Here are some suggestions to tackle this issue:

1. Batch your Requests: Instead of fetching all images in parallel, consider fetching them in smaller batches. This can help reduce the load on your server and mitigate potential timeouts. You can use a loop with a limited number of concurrent requests.
2. Retry Mechanism: Implement a retry mechanism for failed requests. When a request fails due to a timeout, wait for a short period and then retry the request.
3. Check the Storage performance: Implement proper monitoring and logging to gain insights into the behavior of your application. This can help identify patterns and potential bottlenecks. you can also make use of Storage metrics to validate the load on the storage account.

In addition to it, please check the network load between the Storage account and your application if a private peering is enabled.

Thanks!