Logic App Get File Content

clouddataquest 66 Reputation points


i want to move big files up to 1GB with a Logic App (Consumption only), i saw there are now new Chunking methods for some Actions but not for the Get file Content, its stillt limited to about 50mb i guess.

Can you please help me? I could also use the File System connector instead von sharepoint but its limited too :( to you have any ideas? thank you very much

My Logic App:

MUser's image

Azure Logic Apps
Azure Logic Apps
An Azure service that automates the access and use of data across clouds without writing code.
2,106 questions
{count} votes

Accepted answer
  1. RevelinoB 795 Reputation points

    Hi Clouddataquest,

    If you're trying to move large files up to 1GB using Logic Apps, there are a few options available to you.

    Firstly, some actions in Logic Apps now support chunking, which allows you to split a large file into smaller pieces and process them individually. However, the "Get file content" action doesn't currently support chunking. As a workaround, you could use the "Get file metadata" action to retrieve the file size, and then use a combination of the "Get file content" and "Append to blob" actions to upload the file in chunks.

    Alternatively, you could use the "FTP" connector in Logic Apps to transfer files using the FTP protocol. This approach doesn't support chunking, so you may need to manually split the file into smaller pieces before uploading.

    Another option is to use Azure Blob Storage, which is a cloud-based storage service designed for storing large amounts of unstructured data. You can use the "Create blob" action in the "Azure Blob Storage" connector to upload your large files to Blob Storage, and then use the "Get blob content" action to download them again if needed. Blob Storage supports chunking, so you can upload and download files of any size.

    In summary, while the "Get file content" action doesn't currently support chunking, you can work around this limitation by using other actions or connectors in Logic Apps, such as "Get file metadata," "Append to blob," "FTP," or "Azure Blob Storage."

    I hope this helps! Let me know if you have any more questions.

1 additional answer

Sort by: Most helpful
  1. RevelinoB 795 Reputation points

    Hi Clouddataquest,

    To download the file in chunks using the 'Get blob content' action, you can define the range using the 'Range' parameter in the action. The 'Range' parameter allows you to specify the byte range of the blob content you want to retrieve.

    To implement chunked downloading, you'll need to calculate the appropriate range for each chunk based on the desired chunk size and the total size of the blob. For example, if you want to download a 2 GB file in 500 MB chunks, for the first chunk you would set the 'Range' parameter to 'bytes=0-524288000' (0 to 500 MB), for the second chunk 'bytes=524288001-1048576000' (500 MB to 1 GB), and so on.

    Please note that the exact syntax and format of the 'Range' parameter may vary depending on the specific tools or programming languages you are using. I would recommend referring to the documentation or examples provided by the connector or library you are using for more specific instructions on how to set the range parameter correctly.

    I hope this helps with your query: "where to define the range?"