How to extract list of all file names in a Azure blob storage irrespective of the hierarchy.

Question

How to extract list of all file names in a Azure blob storage irrespective of the hierarchy.

Mahima Sharma 0

I am trying to list all file names present in azure blob storage. There are multiple directories and subdirectories to traverse during this process. I have tried walk_blobs and list_blobs function. It is taking 46 minutes to list almost 180k file names.

Is there a better way of achieving it.

Ramya Harinarthini_MSFT 5,366 Reputation points Microsoft Employee Moderator

2023-10-17T14:23:27.5266667+00:00

@Mahima Sharma

Just checking in to see if the below answer helped. If this answers your query, do click "Accept the answer” for the same, which might be beneficial to other community members reading this thread. And, if you have any further query do let us know.
Ramya Harinarthini_MSFT 5,366 Reputation points Microsoft Employee Moderator

2023-10-18T13:42:52.8666667+00:00

@Mahima Sharma

Just checking in to see if the below answer helped. If this answers your query, do click "Accept the answer” for the same, which might be beneficial to other community members reading this thread. And, if you have any further query do let us know.
Ramya Harinarthini_MSFT 5,366 Reputation points Microsoft Employee Moderator

2023-10-20T11:43:55.3+00:00

@Mahima Sharma

Just checking in to see if the below answer helped. If this answers your query, do click "Accept the answer” for the same, which might be beneficial to other community members reading this thread. And, if you have any further query do let us know.

1 answer

Your answer

Ramya Harinarthini_MSFT 5,366 Reputation points Microsoft Employee Moderator

2023-10-17T14:23:27.5266667+00:00

@Mahima Sharma

Just checking in to see if the below answer helped. If this answers your query, do click "Accept the answer” for the same, which might be beneficial to other community members reading this thread. And, if you have any further query do let us know.
Ramya Harinarthini_MSFT 5,366 Reputation points Microsoft Employee Moderator

2023-10-18T13:42:52.8666667+00:00

@Mahima Sharma

Just checking in to see if the below answer helped. If this answers your query, do click "Accept the answer” for the same, which might be beneficial to other community members reading this thread. And, if you have any further query do let us know.
Ramya Harinarthini_MSFT 5,366 Reputation points Microsoft Employee Moderator

2023-10-20T11:43:55.3+00:00

@Mahima Sharma

Just checking in to see if the below answer helped. If this answers your query, do click "Accept the answer” for the same, which might be beneficial to other community members reading this thread. And, if you have any further query do let us know.

Answer 1

Ramya Harinarthini_MSFT 5,366 Microsoft Employee Moderator

@Mahima Sharma Welcome to Microsoft Q&A, thank you for posting your here!!

Please check this GitHub article for similar issue: https://github.com/Azure/azure-sdk-for-python/issues/11593

Hope this helps!
Kindly let us know if the above helps or you need further assistance on this issue.

Please do not forget to "Accept the answer” and “up-vote” wherever the information provided helps you, this can be beneficial to other community members.

Share via

How to extract list of all file names in a Azure blob storage irrespective of the hierarchy.

1 answer

Your answer