Increase Resources to handle jobs on Azure Databricks

Question

Hi I am new to Azure. I wanted to schedule a job on Azure Databricks but got this error: I am new to Azure. I scheduled a databricks job but got this error: Cluster 0216-032148-zb1nfcaj was terminated while waiting on it to be ready: Cluster 0216-032148-zb1nfcaj is in unexpected state Terminated: AZURE_QUOTA_EXCEEDED_EXCEPTION(CLIENT_ERROR). Where and how do I increase resources on the portal and how do I set it to increase dynamically as I increase usage?

Answer 1

@Tom Ashi - Welcome to the Microsoft Q&A platform.

You will receive this error when you exceed the limit of cores for a region. You need to raise a support ticket to increase the limit of the number of cores for a specific region which you are using.

Cause: Quotas are applied per resource group, subscriptions, accounts, and other scopes. For example, your subscription may be configured to limit the number of cores for a region. If you attempt to deploy a virtual machine with more cores than the permitted amount, you receive an error stating the quota has been exceeded.

Solution: To request a quota increase, go to the portal and file a support issue. In the support issue, request an increase in your quota for the region into which you want to create the VMs.

How to check Usage + Quotas for your subscription?

Select your subscription => Under Settings => Usage + quotas => Use filter to select "SKU Size" & "Region" => Check usage of Total Regional vCPUs => If the usage is full, you need to click on Request Increase to increase the limit of cores in the region.

To request a quota increase, go to the portal and file a support issue. In the support issue, request an increase in your quota for the region into which you want to deploy.

Reference: Resolve errors for resource quotas

Hope this helps. Do let us know if you any further queries.

---

If this answers your query, do click Accept Answer and Yes for was this answer helpful. And, if you have any further query do let us know.