Want to migerate the data from one drive and share point to Azure blob storage

Question

Hello Team, Hello, I have 4 TB of data on both SharePoint and OneDrive, each with multiple subfolders. I want to migrate this data to Azure Blob Storage while maintaining the same folder structure. Can anyone advise on how to accomplish this?

Answer 1

Hi Anil,

Check out the Azure Storage Mover and this should assist you to achieve your requirements - https://learn.microsoft.com/en-us/azure/storage-mover/service-overview

Hope this helps. JS

== Please Accept the answer if the information helped you. This will help us and others in the community as well.

Answer 2

Hello Anil Kumar,

Greetings!  Welcome to Microsoft Q&A forum.

Adding to above information, I would like to provide some more ways to move the data from SharePoint & OneDrive to Azure Blob storage by below following methods.

1.To transfer files from SharePoint to Azure Blob Storage, there are several methods you can consider, as outlined in Microsoft's documentation:

You can use Microsoft Power Automate: You can use Power Automate for copying files from a SharePoint folder to an Azure Blob folder, though this might have limitations. Power Automate has a maximum file size limit for individual files. This limit can vary based on the plan you are using, but typically, it's around 100 MB to 250 MB per file.

refer - https://learn.microsoft.com/en-us/azure/logic-apps/logic-apps-limits-and-config?tabs=consumption#workflow-definition-limits

Other reference that might help you: https://sharepains.com/2022/11/15/copy-large-files-sharepoint-azure-blob/

For transferring files from OneDrive to Blob Storage refer - Microsoft Power Automate

2.You can also use Azure Data Factory: It is a cloud-based data integration service that allows you to create data pipelines that move and transform data between various sources and destinations, including SharePoint and Azure Blob Storage. You can create a pipeline that retrieves files from SharePoint using the SharePoint connector and then uses the Azure Blob Storage connector to upload the files to Azure Blob Storage. This approach requires some configuration and coding but provides more flexibility and scalability than Logic Apps.

If there are extremely large files to be copied from that SharePoint library. SharePoint has a default limit of 100 MB buffer size, and the Get File Content action doesn’t natively support chunking.

You can refer this article to use a binary dataset if you just want to copy the full file rather than read the data. https://datasavvy.me/2021/12/07/copying-large-files-from-sharepoint-online/

Also check Azure Data Box: It is a physical device provided by Microsoft for offline data transfer. This method is suitable for large data sets and can significantly reduce the time it takes to transfer the data.

If your files are larger than 250 MB you might consider using other options, like Azure Storage Mover, or can use Date pipelines, or scripted transfer with Azure Automation Account, Maybe Data Box.

Hope this answer helps. Please let us know if you have any further queries. I’m happy to assist you further.

Please do not forget to "Accept the answer” and “up-vote” wherever the information provided helps you, this can be beneficial to other community members.