Get List of all files from all folder from Azure DataLake using C#

Question

HI All,

Can we have some example to get list of all files from all folder from Azure Data Lake using .NET(C#).

Answer 1

@manish verma You should be able to use FileSystemClient.GetPathsAsync to achieve this. On our GitHub page we have sample code which allows you to list all the directories. Combining that with sample that lists all the directory contents should get you the results you need.

Hope this helps! Let us know if you have further questions or issues and we will be happy to assist.

-------------------------------

Please don’t forget to "Accept the answer" and “up-vote” wherever the information provided helps you, this can be beneficial to other community members.

Answer 2

Thanks for replay ,

this is async method, how we call this method in Main class to run program.

public async Task ListFilesInDirectory(DataLakeFileSystemClient fileSystemClient)
{
IAsyncEnumerator<PathItem> enumerator =
fileSystemClient.GetPathsAsync("my-directory").GetAsyncEnumerator();

await enumerator.MoveNextAsync();  

PathItem item = enumerator.Current;  

while (item != null)  
{  
    Console.WriteLine(item.Name);  

    if (!await enumerator.MoveNextAsync())  
    {  
        break;  
    }  

    item = enumerator.Current;  
}  

}

if i call like -ListFilesInDirectory(fileSystemClient); like other method it is error out

i use a console application in .net in C#- to run this method in main program error out

i use reference from here-https://learn.microsoft.com/en-us/azure/storage/blobs/data-lake-storage-directory-file-acl-dotnet#list-directory-contents