Schedule file copy between storage accounts

Question

Schedule file copy between storage accounts

Matthews 21

I need some help please, I can run the azcopy and rclone commands manually, but we have to prepare a scheduler script to run it on the cloud. Locally, I can set up a scheduler but I am not sure how to make it work on the cloud. I am looking for any sample bash or PowerShell script that will run the Azcopy or rclone commands on a schedule? The main goal is to copy the files from one storage account to another on a schedule.
I have an idea to log in using the service principal in the script and run it as a cron job but I am not sure how to implement it.

Accepted answer

0 additional answers

Your answer

Answer 1

Hello @Matthews ,
Thanks for the query !
You can try to use Azure Functions to schedule a job which supports CRON expression
https://learn.microsoft.com/en-us/azure/azure-functions/functions-create-scheduled-function

Use the Timer Triggers of Azure functions
https://learn.microsoft.com/en-us/azure/azure-functions/functions-bindings-timer?tabs=csharp

Basics of how Azure Functions works and their cost
https://learn.microsoft.com/en-us/azure/azure-functions/functions-overview

Sample C#.net script to schedule a copy of blobs using Azure Functions:
https://cmatskas.com/copy-azure-blob-data-between-storage-accounts-using-functions/

Programmatic access which is alternative to azcopy using storage dotnet sdk
https://azure.microsoft.com/en-us/blog/introducing-azure-storage-data-movement-library-preview-2/

Another option is :-

Create a Windows Azure VM
Create a batch file - embed the AzCopy command
Schedule that batch file through Windows Scheduler.

Let us know if you need additional help on this .

Share via

Schedule file copy between storage accounts

0 additional answers

Your answer