how i can upload more then 1 gb file to azure datalake?

Question

Hello every one ,

i want to upload more then one gb file from my ui application .

Let me show you flow#

UI-->microservice->will use Data Lake path and upload file

I already tried with chunk update

https://stackoverflow.com/questions/53123243/uploading-large-files-to-controller-in-chunks-using-httpclient-iformfile-always

but chunk i not working for more the 1 GB file

how my ui application will be able to upload more then 1 gb file

any help on this ?

Answer 1

Hello @Maulik Dave ,
From the below documentation page, you can use DataLakeFileClient.UploadAsync method to upload large files

https://learn.microsoft.com/en-us/azure/storage/blobs/data-lake-storage-directory-file-acl-dotnet#upload-a-large-file-to-a-directory

public async Task UploadFileBulk(DataLakeFileSystemClient fileSystemClient)  
{  
    DataLakeDirectoryClient directoryClient =  
        fileSystemClient.GetDirectoryClient("my-directory");  
  
    DataLakeFileClient fileClient = directoryClient.GetFileClient("uploaded-file.txt");  
  
    FileStream fileStream =  
        File.OpenRead("C:\\Users\\contoso\\file-to-upload.txt");  
  
    await fileClient.UploadAsync(fileStream);  
  
}  

I hope this helps. Please let us know if you have any further questions.