Databricks-cluster-error code: OperationNotAllowed

Question

Hi,

I'm trying to lunch a cluster in data bricks but the cluster terminated with this error:

Cloud Provider Launch Failure:
A cloud provider error was encountered while setting up the cluster. See the Databricks guide for more information.

Azure error code: OperationNotAllowed

Azure error message: Operation could not be completed as it results in exceeding approved Total Regional Cores quota. Additional details - Deployment Model: Resource Manager, Location: westeurope, Current Limit: 10, Current Usage: 10, Additional Required: 4, (Minimum) New Limit Required: 14.

What is the solution?

Answer 1

Hello @Shokoufeh Abrishami ,

Welcome to the Microsoft Q&A platform.

You will receive this error when you exceed the limit of cores for a region. You need to raise a support ticket to increase the limit of the number of cores for a West Europe region.

Cause: Quotas are applied per resource group, subscriptions, accounts, and other scopes. For example, your subscription may be configured to limit the number of cores for a region. If you attempt to deploy a virtual machine with more cores than the permitted amount, you receive an error stating the quota has been exceeded.

Solution: To request a quota increase, go to the portal and file a support issue. In the support issue, request an increase in your quota for the region into which you want to create the VMs.

How to check Usage + Quotas for your subscription?

Select your subscription => Under Settings => Usage + quotas => Use filter to select "Microsoft.Compute" & "West Europe" => Check usage of Total Regional vCPUs => If the usage is full, you need to click on Request Increase to increase the limit of cores in the region.

Reference: Resolve errors for resource quotas

Hope this helps. Do let us know if you any further queries.

------------

• Please accept an answer if correct. Original posters help the community find answers faster by identifying the correct answer. Here is how.
• Want a reminder to come back and check responses? Here is how to subscribe to a notification.

Answer 2

Hi, thanks for the answer, but it doesn't work for me. It seems strange, considering my usage is 0 but the error shows my usage is 4. However, I changed my max workers for clustering to 2, so that 4+2<=6(limit), but my cluster can not start, neither.
I create a new cluster, disable autoscaling and set workers to 2 fixedly. However, I received the same error message.
I have no idea how to proceed with it. May you give me some suggestions?

Thanks