Increase Resources to handle jobs on Azure Databricks

Tom Ashi 20 Reputation points
2024-03-11T16:39:24.7533333+00:00

Hi I am new to Azure. I wanted to schedule a job on Azure Databricks but got this error: I am new to Azure. I scheduled a databricks job but got this error: Cluster 0216-032148-zb1nfcaj was terminated while waiting on it to be ready: Cluster 0216-032148-zb1nfcaj is in unexpected state Terminated: AZURE_QUOTA_EXCEEDED_EXCEPTION(CLIENT_ERROR). Where and how do I increase resources on the portal and how do I set it to increase dynamically as I increase usage?

Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
1,910 questions
0 comments No comments
{count} votes

Accepted answer
  1. PRADEEPCHEEKATLA-MSFT 76,586 Reputation points Microsoft Employee
    2024-03-12T05:36:29.54+00:00

    @Tom Ashi - Welcome to the Microsoft Q&A platform.

    You will receive this error when you exceed the limit of cores for a region. You need to raise a support ticket to increase the limit of the number of cores for a specific region which you are using.

    Cause: Quotas are applied per resource group, subscriptions, accounts, and other scopes. For example, your subscription may be configured to limit the number of cores for a region. If you attempt to deploy a virtual machine with more cores than the permitted amount, you receive an error stating the quota has been exceeded.

    Solution: To request a quota increase, go to the portal and file a support issue. In the support issue, request an increase in your quota for the region into which you want to create the VMs.

    How to check Usage + Quotas for your subscription?

    Select your subscription => Under Settings => Usage + quotas => Use filter to select "SKU Size" & "Region" => Check usage of Total Regional vCPUs => If the usage is full, you need to click on Request Increase to increase the limit of cores in the region.

    145733-image.png

    To request a quota increase, go to the portal and file a support issue. In the support issue, request an increase in your quota for the region into which you want to deploy.

    145714-image.png

    Reference: Resolve errors for resource quotas

    Hope this helps. Do let us know if you any further queries.


    If this answers your query, do click Accept Answer and Yes for was this answer helpful. And, if you have any further query do let us know.

    1 person found this answer helpful.

0 additional answers

Sort by: Most helpful