CLI download-batch stops downloading

Brian Pedersen 31

We use the az storage blob download-batch on a regular basis, for downloading around 21k files from a StorageV2 blob container, using a pattern to match a specific folder, ie. --pattern "FOLDERNAME/*".

It has always been terribly slow, but now it has stopped working.
It downloads a few thousand files, and then stops. It does not terminate, it just stops.

I am running the azure-cli version 2.37.0 on a MacBook.

Brian Pedersen 31 Reputation points

2022-06-29T11:49:42.527+00:00

Same thing with an older BlobStorage container (not StorageV2) and same thing without the pattern.

It simply stops downloading after an arbitrary amount of time.
Sumarigo-MSFT 47,491 Reputation points Microsoft Employee

2022-07-05T06:43:43.51+00:00

@Brian Pedersen Apologies for the delay response! May I what's the download speed are you getting? Are you getting any error message? If so can you share the screenshot?
How many GB of data are you trying download?
You can use Azure Speed tool for testing https://www.azurespeed.com/Azure/Latency

For testing purpose can you use azcopy or azure storage explorer tool
Brian Pedersen 31 Reputation points

2022-07-05T07:59:29.417+00:00

I'm downloading around 21.000 files, with a total size of around 48GB.

The Azure Speed tool reveals a latency around 20-40ms, and a a download speed of around 5.5MB/sec (18 sec. for 100 MB).

Share via

CLI download-batch stops downloading

Your answer