Cluster Terminated, Quota Exceeded Expectation while everything is new

Florencia, Laura 21 Reputation points
2021-11-01T21:19:31.88+00:00

Hi I am super newbie, just set this up less than 1 hour when I actually type this question.

So I am very new, and I got this:
Cluster terminated.Reason:Azure Quota Exceeded Exception
The operation couldn't be completed. Databricks quota estimation shows that you don't have sufficient CPU core for instance type Standard_F4 to launch the cluster. Consider increasing quota for the instance type, decreasing quota usage and trying again later

I am using student account, so I can't request for additional quota. So my question is, how this can be like this when this is my first cluster, and no other cluster listed? I am using Worker Type: Standard F4 (8 GB memory, 4 cores), Runtime Version 5.5, Python version 3.

And after some trials, now my "Event Log" become:
Cluster terminated.Reason:Azure Operation Not Allowed Exception
Error code: OperationNotAllowed, error message: Operation could not be completed as it results in exceeding approved Total Regional Cores quota. Additional details - Deployment Model: Resource Manager, Location: westeurope, Current Limit: 6, Current Usage: 4, Additional Required: 4, (Minimum) New Limit Required: 8. Submit a request for Quota increase at https://aka.ms/ProdportalCRP/#blade/Microsoft_Azure_Capacity/CapacityExperienceBlade/Parameters/%7B%22subscriptionId%22:%22825d44de-b448-4994-96bd-b21eebb6bb01%22,%22command%22:%22openQuotaApprovalBlade%22,%22quotas%22:[%7B%22location%22:%22westeurope%22,%22providerId%22:%22Microsoft.Compute%22,%22resourceName%22:%22cores%22,%22quotaRequest%22:%7B%22properties%22:%7B%22limit%22:8,%22unit%22:%22Count%22,%22name%22:%7B%22value%22:%22cores%22%7D%7D%7D%7D]%7D by specifying parameters listed in the ‘Details’ section for deployment to succeed. Please read more about quota limits at https://learn.microsoft.com/en-us/azure/azure-supportability/regional-quota-requests (Azure request Id: 9d2ffbe9-9b7f-483d-b1fd-d284e461cb9f)

So this is actually another problem. Check the current limit (6) and current usage (4). I didn't use any resource previously. I am sorry for this, cause I am actually confused. Thank you so much

Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
2,534 questions
{count} votes

1 answer

Sort by: Most helpful
  1. PRADEEPCHEEKATLA 90,651 Reputation points Moderator
    2021-11-02T06:30:51.3+00:00

    Hello anonymous user,

    Welcome to the Microsoft Q&A platform.

    You will receive this error when you exceed the limit of cores for a region. You need to raise a support ticket to increase the limit of the number of cores for a West Europe region.

    Cause: Quotas are applied per resource group, subscriptions, accounts, and other scopes. For example, your subscription may be configured to limit the number of cores for a region. If you attempt to deploy a virtual machine with more cores than the permitted amount, you receive an error stating the quota has been exceeded.

    Solution: To request a quota increase, go to the portal and file a support issue. In the support issue, request an increase in your quota for the region into which you want to create the VMs.

    How to check Usage + Quotas for your subscription?

    Select your subscription => Under Settings => Usage + quotas => Use filter to select "Standard F" & "West Europe" => Check usage of Total Regional vCPUs => If the usage is full, you need to click on Request Increase to increase the limit of cores in the region.

    145733-image.png

    To request a quota increase, go to the portal and file a support issue. In the support issue, request an increase in your quota for the region into which you want to deploy.

    145714-image.png

    Reference: Resolve errors for resource quotas

    Hope this will help. Please let us know if any further queries.

    ------------------------------

    • Please don't forget to click on 130616-image.png or upvote 130671-image.png button whenever the information provided helps you. Original posters help the community find answers faster by identifying the correct answer. Here is how
    • Want a reminder to come back and check responses? Here is how to subscribe to a notification
    • If you are interested in joining the VM program and help shape the future of Q&A: Here is how you can be part of Q&A Volunteer Moderators
    1 person found this answer helpful.

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.