How to create a lifecycle policy for specific folders?

I want to create a lifecycle rule that impacts only certain folders inside my containers.

I have these 6 folders and I want to move the 3 that don't have the suffix _DELTA in the name to the cool tier. Is that possible? Screenshot 2023-03-15 at 16.05.27

Sumarigo-MSFT 46,126 Reputation points Microsoft Employee

2023-03-31T02:47:23.5866667+00:00

@Bárbara Ferreira Liberato Benedito Just checking in to see if the below answer helped. If this answers your query, do click "Accept the answer” for the same, which might be beneficial to other community members reading this thread. And, if you have any further query do let us know.
Sumarigo-MSFT 46,126 Reputation points Microsoft Employee

2023-04-10T08:29:56.4733333+00:00

@Bárbara Ferreira Liberato Benedito We found that your recent engagement on this question was rated low for the initial answer. However, as we were able to share the appropriate answers to your follow up questions in the in the later answers, would you be so kind to re-evaluate your feedback, rate my answer by hitting Yes for "was this answer helpful" wherever the information provided helps you, this can be beneficial to other community members.

4 answers

Manu Philip 18,321 Reputation points MVP

2023-03-15T20:42:57.5033333+00:00

Azure Storage lifecycle management offers a rule-based policy that you can use to transition blob data to the appropriate access tiers or to expire data at the end of the data lifecycle.

There is no direct life cycle policy approach available to move folders within the file share. So, this need to be implemented with some other way like azure functions.

--please don't forget to upvote and Accept as answer if the reply is helpful--
Please sign in to rate this answer.

0 comments No comments
Sign in to comment

Use comments to ask for clarification, additional information, or improvements to the question.
Bárbara Ferreira Liberato Benedito 5 Reputation points

2023-03-16T15:06:40.04+00:00

Hello, Manu, thank you for your answer

My question is not about file share. These folders exists in storage containers. I want to move the blob files to another tier, but I need in some way to filter the paths, because I don't want to impact the others blobs inside the folder with the suffix _DELTA.

Is there a way to do it with Lifecycle management?
Please sign in to rate this answer.
SaiKishor-MSFT 17,231 Reputation points

2023-03-16T18:50:56.1+00:00

@Bárbara Ferreira Liberato Benedito Thanks for reaching out to Microsoft Q&A. We apologize for mis-understanding your question. If I understand you correctly you only want the policy/rule to effect certain folders i.e., ones without the _DELTA, is that right?

Yes, it is possible to create a lifecycle rule that impacts only certain folders inside your containers. You can use the prefixMatch field of a policy to match the folders you want the policy actions to apply to. The prefixMatch field is a full or partial blob path, which starts with the container name.

For example, if you want to match all blobs under https://myaccount.blob.core.windows.net/sample-container/folder1/... for a rule, the prefixMatch is sample-container/folder1. To match the folder name exactly, include the trailing forward slash ('/'), e.g., sample-container/folder1/. To match the folder name pattern, omit the trailing forward slash, e.g., sample-container/folder1.

You can use the following code to create a lifecycle policy that moves a block blob to the cool tier if it has been more than 30 days since the blob was modified:

You can replace folder1, folder2, and folder3 with the names of the folders you want to move to a different tier here as the folder names are all different and do not have a pattern.

Does this helps? Please let me know if you have any further questions and I will be happy to assist you further. Thank you!

Related docs- https://learn.microsoft.com/en-us/azure/storage/blobs/lifecycle-management-overview?tabs=azure-powershell#rule-filters

SaiKishor-MSFT 17,231 Reputation points

2023-03-17T18:17:34.59+00:00

@Bárbara Ferreira Liberato Benedito I just wanted to check in and see if you had any other questions or if you were able to resolve this issue? Please do let me know if you need further assistance.

If the information helped address your question, please feel free to take a re-survey on the relevant answer and help us further improve by leaving feedback verbatim as needed.

Bárbara Ferreira Liberato Benedito 5 Reputation points

2023-03-20T15:37:00.8333333+00:00

Hello, @SaiKishor-MSFT thank you for your answer.

Let me explain a little bit more what I want to do. In my example above, There are folder names that have nothing in common between them, the way you explained I would have to create a rule for each one, right?

Since I would not want to apply the rule to folders with end _DELTA, the policies would look like this:

dev-data-science/BANCO/

dev-data-science/TABELA/

Do you see another way for me to create a single rule for all paths, eliminating only the ones with _DELTA, I thought of something

prefix <> _DELTA

is that possible?

SaiKishor-MSFT 17,231 Reputation points

2023-03-20T21:17:34.7666667+00:00

Yes, you are correct. If the folder names have nothing in common, you would have to create a rule for each one. However, you can use the prefixMatch filter to limit the rule actions to a certain set of objects within a container or objects names. The prefixMatch filter is an array of strings for prefixes to be matched. Each rule can define up to 10 case-sensitive prefixes. A prefix string must start with a container name.

For example, you can create a rule with the prefixMatch filter set to dev-data-science/BANCO/ and dev-data-science/TABELA/ and exclude the folders with the suffix _DELTA by using the ! operator in the prefixMatch filter.

prefixMatch: [

"dev-data-science/BANCO/", "dev-data-science/TABELA/", "!dev-data-science/*_DELTA/"

]

This way, you can create a single rule for all paths, excluding only the ones with _DELTA. Does that help? Please let me know. Thanks!

SaiKishor-MSFT 17,231 Reputation points

2023-03-21T17:52:04.2+00:00

@Bárbara Ferreira Liberato Benedito Have you checked the above update, please let me know if that helps or if you need further assistance. Thank you!

Bárbara Ferreira Liberato Benedito 5 Reputation points

2023-03-21T18:14:26.6766667+00:00

Hello @SaiKishor-MSFT I will try your suggestion, I'll let you know if it works. Thank you very much for your answer!

Bárbara Ferreira Liberato Benedito 5 Reputation points

2023-03-24T14:37:53.96+00:00

Hi @SaiKishor-MSFT . I created the policy as your suggestion, but it didn't worked. The file remains as hot tier

SaiKishor-MSFT 17,231 Reputation points

2023-03-24T19:35:09.9033333+00:00

Bárbara Ferreira Liberato Benedito Have you tried specifying as follows instead of the negative filter? Please let me know if the below filters help. Thanks!

Sumarigo-MSFT 46,126 Reputation points Microsoft Employee

2023-04-11T01:27:38.06+00:00

@Bárbara Ferreira Liberato Benedito I wish to engage with you offline for a closer look and provide a quick and specialized assistance, please send an email with subject line “Attn:subm” to AzCommunity[at]Microsoft[dot]com referencing this thread and the Azure subscription ID, I will follow-up with you. Once again, apologies for any inconvenience with this issue.
Thanks for your patience and co-operation.
Sign in to comment

Use comments to ask for clarification, additional information, or improvements to the question.
Manu Philip 18,321 Reputation points MVP

2023-03-24T17:19:04.9+00:00

I found an easy way to change access tier of selected folders only through Azure Storage Explorer

Select the folders of interest and select 'Change Access Tier' from the right click menu

Select 'Cool' and apply

Monitor the 'Activities' section as below to the progress of the operation.

Now, all the blobs inside the selected folders should be moved to the Cool tier

--please don't forget to upvote and Accept as answer if the reply is helpful--
Please sign in to rate this answer.

0 comments No comments
Sign in to comment

Use comments to ask for clarification, additional information, or improvements to the question.
Bárbara Ferreira Liberato Benedito 5 Reputation points

2023-04-10T20:08:21.3133333+00:00

Hello, Guys I appreciate your suggestions, but any of them helped me to solve my problem, I have a lot of folders, so I need a way to do it programmatically. I opened a ticket on microsoft support and they are trying to find a way to help me!
Please sign in to rate this answer.

0 comments No comments
Sign in to comment

Use comments to ask for clarification, additional information, or improvements to the question.

Share via

How to create a lifecycle policy for specific folders?

4 answers

Your answer