Hi, I have deployed one storage account(adls gen2). Whenever any automated jobs run its output is stored in adls and these are stored in containers which are automatically created. Containers created are in this pattern "f4082jd-bdbjdbk-nkfk-nhkdk-5974bhsk". i have requirement like deleting this automated containers which are older than specified days. how i can i do this task using azure data factory. i dont want to use powershell script or python script and dont want to use batch account. Regards, Rohit.

Hi @Rohit Boddu , Welcome to Microsoft Q&A Platform. Thanks for posting the query. I used below approach to implement this requirement in azure data factory. Using "Get Metadata", "Foreach", "IF Condition" and "delete" activities this can be achieved. Below GIF shows the details, for testing, I deleted container less than 10days age by using delete activity in false activity of "IF Condition", the same can be used in true condition for greater than 10days containers. IF Condition Expression used: @greaterOrEquals(div(sub(int(ticks(utcnow())),int(ticks(activity('Get Metadata2').output.lastModified))),864000000000),10) Hope this helps! Please let us know for further queries and we will be glad to assist.

Deleting automatically created containers in storage account(adls gen2)

Accepted answer

HarithaMaddi-MSFT 10,136 Reputation points

2020-10-14T18:13:12.317+00:00
Hi @Rohit Boddu ,

Welcome to Microsoft Q&A Platform. Thanks for posting the query.

I used below approach to implement this requirement in azure data factory. Using "Get Metadata", "Foreach", "IF Condition" and "delete" activities this can be achieved. Below GIF shows the details, for testing, I deleted container less than 10days age by using delete activity in false activity of "IF Condition", the same can be used in true condition for greater than 10days containers.

IF Condition Expression used:

@greaterOrEquals(div(sub(int(ticks(utcnow())),int(ticks(activity('Get Metadata2').output.lastModified))),864000000000),10)

Hope this helps! Please let us know for further queries and we will be glad to assist.
Please sign in to rate this answer.
Rohit Boddu 466 Reputation points

2020-10-15T06:10:33.887+00:00

Hi @HarithaMaddi-MSFT using this approch i can delete the container by specified days but my ask is like how can i identify that the particular container is autromatically created by informatica ..

my requirement it should only delete those automatically created containers only .. all containers that are created have some specific pattern like
"(----------)/-(-----)/-(----)/-(-----------)" ..

Is there anyway to match container names and then deleting them.

Action item:
1)Finding the containers which are in that specific pattern
2)then filtering them out with modified date
3)deleting containers that we got after filtering.

Could u please help me on achieving this requirement.

Regards,
Rohit

HarithaMaddi-MSFT 10,136 Reputation points

2020-10-15T06:23:22.143+00:00

Hi @Rohit Boddu ,

Thanks for sharing more details. The above approach can be enhanced by using "Filter" activity as below that uses 'starts with' function to identify specific pattern in name and container names are filtered before passing to foreach to retrieve "last modified date" and delete accordingly.

Please let us know for further queries and we will be glad to assist.

HarithaMaddi-MSFT 10,136 Reputation points

2020-10-16T07:56:39.527+00:00

Hi @Rohit Boddu ,

We have not received a response from you. Please suggest if above details clarified your query and helped in implementing the requirement. Let us know for further queries and we will be glad to assist.

Please do consider to click on "Accept Answer" and "Up-vote" on the post that helps you, as it can be beneficial to other community members

Rohit Boddu 466 Reputation points

2020-10-16T09:45:36.69+00:00

Hi @HarithaMaddi-MSFT We are implementing the solution that you provided will update u once it is done ..

Thanks for Guidance provided.

Regards,
Rohit.

HarithaMaddi-MSFT 10,136 Reputation points

2020-10-19T08:11:46.66+00:00

Thanks @Rohit Boddu , Please let us know if there are any challenges in implementing the same and we will be happy to assist.

Please do consider to click on "Accept Answer" and "Up-vote" on the post that helps you, as it can be beneficial to other community members

AnjuSharma-7416 1 Reputation point

2022-10-06T17:53:34.683+00:00

Hi, I am having the same issue but wanted to know how can I filter if the names do not have any prefix or suffix in common? The only thing that is common about the names is the format: "(----------)/-(-----)/-(----)/-(-----------)."
Sign in to comment

Use comments to ask for clarification, additional information, or improvements to the question.

Share via

Deleting automatically created containers in storage account(adls gen2)

0 additional answers

Your answer