Hello Shubham Taur,
Greetings! Welcome to Microsoft Q&A Platform.
Adding to above response, I would like to provide some more ways to move the data from SharePoint & OneDrive to Azure Blob storage by below following methods.
1.To transfer files from SharePoint to Azure Blob Storage, there are several methods you can consider, as outlined in Microsoft's documentation:
You can use Microsoft Power Automate: You can use Power Automate for copying files from a SharePoint folder to an Azure Blob folder, though this might have limitations. Power Automate has a maximum file size limit for individual files. This limit can vary based on the plan you are using, but typically, it's around 100 MB to 250 MB per file also you can create a automated process for transferring data at several intervals.
Other reference that might help you: https://sharepains.com/2022/11/15/copy-large-files-sharepoint-azure-blob/
Also, for automatically transfer data from SharePoint or OneDrive to Azure Blob Storage at specific time intervals.
You have to create an automated flow that moves files from a specific SharePoint folder to Azure Blob storage after a set period of time. To maintain the folder structure, consider the following approach:
- When users place a folder within a specific area in SharePoint, use a trigger (e.g., when a new folder is created) to initiate the flow.
- Inside the flow, use the Azure Blob Storage connector to create the corresponding folder structure in the Azure Blob container.
- Then, move all the files from the SharePoint folder to the corresponding Azure Blob folder using the Copy File action.
- This way, both the folder and its files will be maintained in Azure Blob storage1.
For transferring files from OneDrive to Blob Storage - Microsoft Power Automate
2.You can also use Azure Data Factory: It is a cloud-based data integration service that allows you to create data pipelines that move and transform data between various sources and destinations, including SharePoint and Azure Blob Storage. You can create a pipeline that retrieves files from SharePoint using the SharePoint connector and then uses the Azure Blob Storage connector to upload the files to Azure Blob Storage. This approach requires some configuration and coding but provides more flexibility and scalability than Logic Apps.
If there are extremely large files to be copied from that SharePoint library. SharePoint has a default limit of 100 MB buffer size, and the Get File Content action doesn’t natively support chunking.
You can refer this article to use a binary dataset if you just want to copy the full file rather than read the data. https://datasavvy.me/2021/12/07/copying-large-files-from-sharepoint-online/
Also check Azure Data Box: It is a physical device provided by Microsoft for offline data transfer. This method is suitable for large data sets and can significantly reduce the time it takes to transfer the data.
If your files are larger than 250 MB you might consider using other options, like Azure Storage Mover refer-https://learn.microsoft.com/en-us/azure/storage-mover/service-overview , or can use Date pipelines, or scripted transfer with Azure Automation Account, Maybe Data Box.
Once the data is moved to Blob storage you can configure the backup using Azure Backup - refer https://learn.microsoft.com/en-us/azure/backup/blob-backup-configure-manage?tabs=operational-backup for more information.
Hope this answer helps. Please let us know if you have any further queries. I’m happy to assist you further.