how to use azure logic app to upload files from azure blob storage to SharePoint?

anantha rengan kannan 0 Reputation points
2024-03-03T17:10:53.0866667+00:00

How to use azure logic app to upload large files to SharePoint whenever a large file is added in azure blob storage?. Can you please post some useful examples. It seems we will face issue whenever we upload any file > 50 MB from azure blob storage to SharePoint document library using azure logic app (added link below).

https://learn.microsoft.com/en-us/answers/questions/1405108/how-to-create-large-file-into-sharepoint-library-f?page=1&orderby=Helpful&comment=answer-1348443

Can anyone please help out?

Azure Blob Storage
Azure Blob Storage
An Azure service that stores unstructured data in the cloud as blobs.
Azure Logic Apps
Azure Logic Apps
An Azure service that automates the access and use of data across clouds without writing code.
Microsoft 365 and Office | SharePoint | For business | Windows
0 comments No comments
{count} votes

3 answers

Sort by: Most helpful
  1. Dillon Silzer 60,726 Reputation points Volunteer Moderator
    2024-03-03T18:01:19.67+00:00

    Hi Anantha,

    First, you will want to get the size:

    The 'correct' approach would be to use the Get file metadata Action which returns a blob with a Size attribute. This way, you do not have to retrieve the file to get the size.

    Cited from https://stackoverflow.com/questions/53675636/azure-logic-apps-check-for-file-size

    Then, based on the Size attribute (which you can store in a variable):

    From your Get Blob content (V2) action, you can move that blob to SharePoint as demonstrated here:

    https://stackoverflow.com/questions/75281059/how-do-i-set-a-logic-app-in-azure-to-transfer-files-from-blob-storage-to-sharepo

    If this is helpful please accept answer.

    0 comments No comments

  2. Anand Prakash Yadav 7,865 Reputation points Microsoft External Staff
    2024-03-04T14:20:21.45+00:00

    Hello anantha rengan kannan,

    Thank you for posting your query here!

    To transfer large files from Azure Blob Storage to SharePoint, there are several methods you can consider, as outlined in Microsoft's documentation:

    You can use Microsoft Power Automate: You can use Power Automate for copying files from a SharePoint folder to an Azure Blob folder, though this might have limitations. Power Automate has a maximum file size limit for individual files. This limit can vary based on the plan you are using, but typically, it's around 100 MB to 250 MB per file.

    Copy excel file from storage account and upload to sharepoint using logic apps - Microsoft Q&A

    https://stackoverflow.com/questions/58726104/copy-files-from-azure-blob-to-sharepoint-folder-using-microsoft-flow

    You can also use Azure Data Factory: Azure Data Factory can be used to copy data from an Azure Blob to SharePoint Online. You can use a Copy Data activity in a pipeline and configure the source and destination as Azure Blob and SharePoint Online respectively.

    This approach can preserve the folder structure while copying data to SharePoint Online. You can also use the AzCopy tool to copy data from an Azure Blob to SharePoint Online, but it may require some additional scripting to preserve the folder structure.

    Also check Azure Data Box: It is a physical device provided by Microsoft for offline data transfer. This method is suitable for large data sets and can significantly reduce the time it takes to transfer the data. https://learn.microsoft.com/en-us/azure/databox/data-box-overview

    You may also consider using third-party tools like Gs Richcopy 360, ShareGate, and GoodSync.

    Note: The third-party articles are recommended to help you find alternatives, Microsoft does not verify if the third-party workarounds work completely.

    Do let us know if you have any further queries. I’m happy to assist you further.

    Please do not forget to "Accept the answer” and “up-vote” wherever the information provided helps you, this can be beneficial to other community members.

    0 comments No comments

  3. Suresh Kumar Chermadurai 40 Reputation points
    2024-03-13T09:00:19.8833333+00:00

    Hi @anantha rengan kannan - Did you try copy or create file in SharePoint using "Create file" SharePoint connector with Allow chunking set to true? . You can use the content from "Get blob content using path (v2)" connector which copied the file content from Blob storage and create a new file in SharePoint through "Create file" connector. Click on Settings of the connector and make sure "Allow chunking" is enabled. I believe we tried copy big files even more than 1GB size.

    User's image

    0 comments No comments

Your answer

Answers can be marked as 'Accepted' by the question author and 'Recommended' by moderators, which helps users know the answer solved the author's problem.