Unable to Create Storage Container and Delete Storage Account in Azure Portal (Access Denied Error)

Gabriel25 545 Reputation points
2024-09-30T13:55:58.4233333+00:00

I'm encountering an issue in the Azure portal where I can't create a new storage container or delete an existing storage account.When attempting to create a storage container named "demo," I receive the following error: "Failed to create storage container 'demo'." I'm unable to delete the existing storage account. The error message mentions access being denied due to a deny assignment created by Azure Databricks. Here's the relevant portion:

Error: The client 'xxxxxxxxl.com' with object id 'f5de8f55-fcd8-8892-bdb1-b12e6d3b9acd' has permission to perform action 'Microsoft.Storage/storageAccounts/listKeys/action' on scope 'databricks-rgvvkr_databricks-jwdpyzabgtwbc/providers/Microsoft.Storage/storageAccounts/dbstorageuj5fe852q7urt'>dbstorageuj5ei365o6tgk'; however, the access is denied because of the deny assignment with name 'System deny assignment created by Azure Databricks /subscriptions/xxxxxxxxxxxxxxxxxxx/resourceGroups/rgvvkr/providers/Microsoft.Databricks/workspaces/vvkr_databricks' and Id '7xxxxxxxxxxxxxxxxxxx' at scope '/subscriptions/xxxxxxxxxxx/resourceGroups/databricks-rgvvkr_databricks-jwdpyzabgtwbc'."

How can I resolve this access denial issue and successfully create a storage container and delete the storage account (if necessary)?

Any insights into why Azure Databricks might be denying access would be greatly appreciated.

Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
2,534 questions
0 comments No comments
{count} votes

Accepted answer
  1. Smaran Thoomu 24,575 Reputation points Microsoft External Staff Moderator
    2024-09-30T14:31:55.7866667+00:00

    Hi @vikranth-0706

    Greetings & Welcome to Microsoft Q&A forum! 

    This is a known issue with Databricks storage account associated with the Managed resource group.

    What is Managed Resource Group?

    This resource group holds all the resources that are required by the managed application. For example, this resource group contains the virtual machines, storage accounts, and virtual networks for the solution. The customer has limited access to this resource group because the customer doesn't manage the individual resources for the managed application.

    Is it possible to modify or delete the Managed Resource Group?

    When we create an Azure Databricks workspace, by design it will automatically create Databricks Managed resource Group. The managed resource group must exist as this is where your cluster(s) will be created. To ensure that nothing breaks them, they are placed in a separate resource group (managed resource group) that has a super lock on it so you cannot modify anything in it.

    This deny assignment is preventing you from accessing the Azure Storage Account.

    Deny assignments are a type of Azure Policy assignment that explicitly denies access to a specific action in Azure. In your case, the deny assignment is blocking the action 'Microsoft.Storage/storageAccounts/listKeys/action' on the specified scope. Unfortunately, you can't override this deny assignment on the managed resource group created by Azure Databricks, even if you're the owner. This is because it's a resource managed by Databricks, and it prevents direct access to the data because it stores some system information inside the storage account. If you need to access data in the Databricks managed storage account, it's recommended to use DBFS for temporary data or mount a new storage account.

    For more details refer to below links:

    Azure Policy - Deny assignments: https://docs.microsoft.com/en-us/azure/role-based-access-control/deny-assignments

    SO thread addressing similar issue: https://stackoverflow.com/questions/73064767/how-to-override-deny-assignment-so-that-i-can-access-the-databricks-managed-stor

    Hope this helps. Do let us know if you any further queries.


    If this answers your query, do click Accept Answer and Yes for was this answer helpful. And, if you have any further query do let us know.

    1 person found this answer helpful.
    0 comments No comments

0 additional answers

Sort by: Most helpful

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.