How to delete older files in each folder

Question

Hello, I am trying to delete older files from each folder. for example --- I have Root directory /FOLDERA/NAMES/ names_1/1/2024.csv names_1/2/2024.csv names_1/3/2024.csv names_1/4/2024.csv

/FOLDERA/ADDRESS/ address_1/1/2024.csv address_1/2/2024.csv address_1/3/2024.csv address_1/4/2024.csv /FOLDERA/EMPLOYEE/ employee_1/1/2024.csv employee_1/2/2024.csv employee_1/3/2024.csv employee_1/4/2024.csv I need to delete two weeks older files in each folder, how can be achived. I saw the example mostly deleting files in one folder or directory, Please let me know if any example or screeshot or document to delete old files in each folder. Thank You, Zaeemul

Answer 1

Hey, You can use Delete activity:

wherein you can use wild card path and last modified combination to pick files less that specific date and delete the files recursively. You can also use life cycle management property in case if blob is the source : https://learn.microsoft.com/en-us/azure/storage/blobs/lifecycle-management-policy-configure?tabs=azure-portal

Answer 2

@Zaeemul Haque To delete older files from each folder in Azure Blob Storage, you have a couple of options:

#1. Blob Lifecycle Management (Recommended): Azure Storage provides a feature called Blob Lifecycle Management. With this, you can define policies to automatically delete blobs based on criteria such as their age (e.g., older than 30 days). Go to your Azure Storage Account.Navigate to Blob Service > Lifecycle Management. Define a policy to delete blobs older than your desired threshold (e.g., 14 days). Azure Storage will handle the deletion for you.

#2. Azure Functions: You can create an Azure Function that periodically checks each folder and deletes files older than a specified duration. Here’s a high-level approach: Create a Timer Trigger function. Fetch the list of blobs from the corresponding Blob Container. Check the LastModified property of each blob. Delete the blobs that don’t meet your criteria (e.g., older than 14 days).

Remember to test any deletion process on a test folder first to avoid accidental data loss. Adjust the path and days as needed for each folder.