Hello Etienne WAGNER,
Greetings! Welcome to Microsoft Q&A Platform.
I understand that you're facing challenges with throttling errors in the Azure Storage SDK and would like to find more efficient solutions with other Microsoft technologies. Where you might consider using Microsoft's SharePoint Migration Tool or SharePoint Online Management Shell in combination with AzCopy. Here's an alternative approach:
SharePoint Migration Tool:
Microsoft provides the SharePoint Migration Tool, which is designed to help migrate content from on-premises SharePoint sites and file shares to SharePoint Online and OneDrive for Business. It also supports migration from SharePoint Online to SharePoint Online.
You can use this tool to copy the content from your SPO library to an Azure Blob container. Here's a high-level outline of the process:
- Download and install the SharePoint Migration Tool.
- Set up a new migration project and configure the source (SPO library) and destination (Azure Blob container).
- Run the migration project to copy the files and folders from SPO to the Azure Blob container.
This tool handles not just files but also folder structures and metadata. You might need to adapt it slightly for your specific case, but it's generally designed for these types of tasks.
SharePoint Online Management Shell with AzCopy:
You can use the SharePoint Online Management Shell to connect to your SharePoint Online environment and retrieve the files' URLs. Then, use AzCopy to copy the files from SharePoint Online to the Azure Blob container.
Here's a rough outline of the steps:
- Use SharePoint Online Management Shell to connect to your SharePoint Online environment.
- Retrieve the URLs of the files you want to copy.
- Use AzCopy to copy the files from their URLs to the Azure Blob container.
This approach might require some scripting to automate the process, especially if you have a large number of files.
Be aware that the exact steps and scripts you need might depend on your specific environment, permissions, and other factors.
Similar thread for reference - https://learn.microsoft.com/en-us/answers/questions/1513111/how-to-copy-folders-and-files-from-a-sharepoint-si,https://stackoverflow.com/questions/64703982/most-efficient-way-to-upload-large-amounts-of-data-to-azure-blobstorage.
reference - https://learn.microsoft.com/en-us/azure/storage/common/storage-solution-large-dataset-moderate-high-network.Hope this information helps! Please let us know if you have any further queries. I’m happy to assist you further.
Please "Accept the answer” and “up-vote” wherever the information provided helps you, this can be beneficial to other community members.