OperationNotAllowed - how to increase Total Regional Cores quota in azure student subscription

Question

I am trying Create a cluster in azure databricks. i am getting a error "OperationNotAllowed"

How to increase the Total Regional Cores quota in Azure Student Subscription

Answer 1

Hello there,

When the limit can be adjusted, the tables include Default limit and Maximum limit headers. The limit can be raised above the default limit but not above the maximum limit.

To request a quota increase, go to the portal and file a support issue. In the support issue, request an increase in your quota for the region into which you want to deploy.

Some quotas let you specify a quota limit that's submitted for review and either approved or rejected. If your limit is rejected, you'll see a link to open a support request.

More info here https://learn.microsoft.com/en-us/azure/azure-resource-manager/troubleshooting/error-resource-quota?tabs=azure-cli

Azure subscription and service limits, quotas, and constraints https://learn.microsoft.com/en-us/azure/azure-resource-manager/management/azure-subscription-service-limits

--------------------------------------------------------------------------------------------------------------------------------------------

--If the reply is helpful, please Upvote and Accept it as an answer–

Answer 2

Hello @Fernandes, Brian Joseph ,

Thanks for the question and using MS Q&A platform.

How to increase the Total Regional Cores quota in Azure Student Subscription

Note: Unfortunately, Azure Student subscriptions aren't eligible for limit or quota increases,

This is a known issue - when you create a cluster with multi node.

Azure Databricks Cluster - multi node is not available under the Azure free trial/Student/Pass subscription.

Reason: Azure free trial/Student/Pass subscription has a limit of 4 cores, and you cannot create Databricks cluster multi node using a Student Subscription because it requires more than 8 cores.

You need to upgrade to a Pay-As-You-Go subscription to create Azure Databricks clusters with multi mode.

Note: Azure Student subscriptions aren't eligible for limit or quota increases. If you have a Student subscription, you can upgrade to a Pay-As-You-Go subscription.

You can use Azure Student subscription to create a Single node cluster which will have one Driver node with 4 cores.

A Single Node cluster is a cluster consisting of a Spark driver and no Spark workers. Such clusters support Spark jobs and all Spark data sources, including Delta Lake. In contrast, Standard clusters require at least one Spark worker to run Spark jobs.

Single Node clusters are helpful in the following situations:

• Running single node machine learning workloads that need Spark to load and save data
• Lightweight exploratory data analysis (EDA)

Reference: Azure Databricks - Single Node clusters

Hope this helps. Do let us know if you any further queries.

------------------------------

• Please don't forget to click on or upvote button whenever the information provided helps you. Original posters help the community find answers faster by identifying the correct answer. Here is how
• Want a reminder to come back and check responses? Here is how to subscribe to a notification
• If you are interested in joining the VM program and help shape the future of Q&A: Here is jhow you can be part of Q&A Volunteer Moderators