How can I migrate data from SharePoint to Azure Storage using ADF and directly set the data to "Archive Tier"

Question

We are in the process of migrating approximately 800GB of data from SharePoint Online to an Azure Storage account using Azure Data Factory, our goal is to put all the files in Archive tier. We have encountered two questions that we hope you can assist us with:

1. After successfully migrating the data, we noticed that the files that was migrated is on "Cool" tier (default tier set in the Storage Account). Is it possible to automatically set the data to "Archive" tier during the migration process using the Azure Data Factory?
2. If it is not possible to set the data to "Archive" tier automatically, we are considering using the Lifecycle management feature in the blob storage account.
   Regarding the pricing for using Lifecycle management, we understand that it is free, but the user will be charged based on the standard operation processes such as moving the files from one tier to another. We are concerned about the early deletion charges in this scenario. If we move 800GB of files to the "Archive" tier one day after it was created in the storage account under the "Cool" tier, will we be charged for "early deletion"? Can I get a sample computation?

Answer 1

@Jim Milagrosa Is it possible to automatically set the data to "Archive" tier during the migration process using the Azure Data Factory?

Yes, this should be possible. This SO thread covers how to do this using various methods in Azure Data Factory.

The methods are a little complicated though and I don't see an advantage in doing this in ADF. There is no worry of early deletion fee. "If a blob's tier is inferred as cool based on the storage account's default access tier and the blob is moved to the archive tier, there's no early deletion charge." Based on this I think either explicitly changing the access tier or using Lifecycle Management are good options for you. More information on the costs of archiving data can be found here.

Hope this helps! let me know if you have any questions.

Please don’t forget to "Accept the answer" and “up-vote” wherever the information provided helps you, this can be beneficial to other community members.