question

ShokoufehAbrishami-8985 avatar image
1 Vote"
ShokoufehAbrishami-8985 asked YuanyueLiu-7073 commented

Databricks-cluster-error code: OperationNotAllowed

Hi,

I'm trying to lunch a cluster in data bricks but the cluster terminated with this error:

Cloud Provider Launch Failure:
A cloud provider error was encountered while setting up the cluster. See the Databricks guide for more information.

Azure error code: OperationNotAllowed

Azure error message: Operation could not be completed as it results in exceeding approved Total Regional Cores quota. Additional details - Deployment Model: Resource Manager, Location: westeurope, Current Limit: 10, Current Usage: 10, Additional Required: 4, (Minimum) New Limit Required: 14.

What is the solution?

azure-databricks
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

PRADEEPCHEEKATLA-MSFT avatar image
2 Votes"
PRADEEPCHEEKATLA-MSFT answered PRADEEPCHEEKATLA-MSFT converted comment to answer

Hello @ShokoufehAbrishami-8985,

Welcome to the Microsoft Q&A platform.

You will receive this error when you exceed the limit of cores for a region. You need to raise a support ticket to increase the limit of the number of cores for a West Europe region.

Cause: Quotas are applied per resource group, subscriptions, accounts, and other scopes. For example, your subscription may be configured to limit the number of cores for a region. If you attempt to deploy a virtual machine with more cores than the permitted amount, you receive an error stating the quota has been exceeded.

Solution: To request a quota increase, go to the portal and file a support issue. In the support issue, request an increase in your quota for the region into which you want to create the VMs.

How to check Usage + Quotas for your subscription?

Select your subscription => Under Settings => Usage + quotas => Use filter to select "Microsoft.Compute" & "West Europe" => Check usage of Total Regional vCPUs => If the usage is full, you need to click on Request Increase to increase the limit of cores in the region.


47369-image.png

Reference: Resolve errors for resource quotas

Hope this helps. Do let us know if you any further queries.


  • Please accept an answer if correct. Original posters help the community find answers faster by identifying the correct answer. Here is how.

  • Want a reminder to come back and check responses? Here is how to subscribe to a notification.


image.png (153.0 KiB)
· 1
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

Hello @ShokoufehAbrishami-8985,

Just checking in to see if the above answer helped. If this answers your query, do click “Accept Answer” and Up-Vote for the same. And, if you have any further query do let us know.

1 Vote 1 ·
YuanyueLiu-7073 avatar image
0 Votes"
YuanyueLiu-7073 answered YuanyueLiu-7073 commented

145950-azuredatabricks.jpg





Hi, thanks for the answer, but it doesn't work for me. It seems strange, considering my usage is 0 but the error shows my usage is 4. However, I changed my max workers for clustering to 2, so that 4+2<=6(limit), but my cluster can not start, neither.
I create a new cluster, disable autoscaling and set workers to 2 fixedly. However, I received the same error message.
I have no idea how to proceed with it. May you give me some suggestions?

Thanks


azuredatabricks.jpg (259.2 KiB)
· 1
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

Hello @YuanyueLiu-7073,

Find out the VM size which you are trying to deploy in Azure Databricks:

146124-image.png

You can checkout the usage quota based on the VM size of the Databricks cluster:

146163-image.png

To resolve this issue, you need to raise a support ticket to increase the limit of the number of cores for a ADB region.

Hope this helps.


0 Votes 0 ·
image.png (90.3 KiB)
image.png (61.7 KiB)