ADLS Gen2 lifecycle management policies and events logged to Log Analytics Workspace

Bhushan Gawale 316 Reputation points
2021-05-15T14:16:27.987+00:00

Hi,

There is an interesting observation with ADLS Gen 2 Storage Account.

When you have lifecycle management policies configured to delete blobs older than certain duration when these policies execute, it starts to clean up matching blobs and associated directories within a container and also rightly so, it starts to delete empty directories too.

Now the observation: When you have configured diagnostic settings to emit all logs to the log analytics workspace, you can see these logs of cleanup operations in the log analytics workspace, however you would notice that even while deleting different directories (note I am not referring blob files), the logs are being added as 'DeleteBlob' operation.

Shouldn't it be logged as Delete Directories event? This could become an issue specifically when you have event subscriptions associated to do specific task when a directory gets deleted, but because these lifecycle management policies do not emit the 'Delete Directory' event that will never trigger your event subscribers and I think is kind of misleading or certainly not right.

Anyone noticed it or if it's already on the roadmap of PG to look at?

Azure Data Lake Storage
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,426 questions
Azure Storage Accounts
Azure Storage Accounts
Globally unique resources that provide access to data management services and serve as the parent namespace for the services.
2,944 questions
{count} votes