Share via

Databricks-cluster-error code: OperationNotAllowed

Shokoufeh Abrishami 26 Reputation points
Dec 11, 2020, 8:41 AM

Hi,

I'm trying to lunch a cluster in data bricks but the cluster terminated with this error:

Cloud Provider Launch Failure:
A cloud provider error was encountered while setting up the cluster. See the Databricks guide for more information.

Azure error code: OperationNotAllowed

Azure error message: Operation could not be completed as it results in exceeding approved Total Regional Cores quota. Additional details - Deployment Model: Resource Manager, Location: westeurope, Current Limit: 10, Current Usage: 10, Additional Required: 4, (Minimum) New Limit Required: 14.

What is the solution?

Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
2,338 questions
0 comments No comments
{count} vote

Accepted answer
  1. PRADEEPCHEEKATLA 90,556 Reputation points
    Dec 11, 2020, 12:25 PM

    Hello @Shokoufeh Abrishami ,

    Welcome to the Microsoft Q&A platform.

    You will receive this error when you exceed the limit of cores for a region. You need to raise a support ticket to increase the limit of the number of cores for a West Europe region.

    Cause: Quotas are applied per resource group, subscriptions, accounts, and other scopes. For example, your subscription may be configured to limit the number of cores for a region. If you attempt to deploy a virtual machine with more cores than the permitted amount, you receive an error stating the quota has been exceeded.

    Solution: To request a quota increase, go to the portal and file a support issue. In the support issue, request an increase in your quota for the region into which you want to create the VMs.

    How to check Usage + Quotas for your subscription?

    Select your subscription => Under Settings => Usage + quotas => Use filter to select "Microsoft.Compute" & "West Europe" => Check usage of Total Regional vCPUs => If the usage is full, you need to click on Request Increase to increase the limit of cores in the region.

    47369-image.png

    Reference: Resolve errors for resource quotas

    Hope this helps. Do let us know if you any further queries.

    ------------

    • Please accept an answer if correct. Original posters help the community find answers faster by identifying the correct answer. Here is how.
    • Want a reminder to come back and check responses? Here is how to subscribe to a notification.
    2 people found this answer helpful.

1 additional answer

Sort by: Most helpful
  1. Yuanyue Liu 1 Reputation point
    Nov 3, 2021, 3:49 AM

    145950-azuredatabricks.jpg

    Hi, thanks for the answer, but it doesn't work for me. It seems strange, considering my usage is 0 but the error shows my usage is 4. However, I changed my max workers for clustering to 2, so that 4+2<=6(limit), but my cluster can not start, neither.
    I create a new cluster, disable autoscaling and set workers to 2 fixedly. However, I received the same error message.
    I have no idea how to proceed with it. May you give me some suggestions?

    Thanks


Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.