Can't create a Databricks cluster even with a Pay-as-you-go subscription

Question

I can't create a Databricks cluster even with a Pay-as-you-go subscription. Much less with the Trial subscription. I created a new subscription plan, added my credit card info in there and naively thought I would finally be able to play with creating a simple cluster after repeating all the steps.

Why is this so hard? Why is MS boycotting people who are trying to learn their stupid cloud environment? Sorry I had to vent, they made this so ridiculous (you can't play with the trial version, which was such a negative surprise and now even when I'm willing to put my money on the line it's blocked?). Why?

Any help to troubleshoot this issue is highly appreciated.

PS-it seems my first question has been answered and I will try the solution suggested there first. Thanks.

Answer 1

Hello JR JR,

Welcome to the Microsoft Q&A and thank you for posting your questions here.

I understand that you can't create a Databricks cluster even with a Pay-as-you-go subscription.

This problem is common, and most time it stems from Azure’s default resource restrictions, especially for new or personal accounts. Even with a Pay-as-you-go plan, Azure enforces strict quotas on virtual CPUs (vCPUs) per region, which can silently block Databricks cluster creation if the required VM types are unavailable or if your quota is set to zero. To resolve this, you should visit the Azure Quotas page and request an increase in your vCPU limits for the region where your Databricks workspace is deployed.

Additionally, your Databricks workspace might be on the Standard tier, which lacks some advanced features and flexibility. To verify or upgrade, navigate to your Databricks workspace in the Azure portal and check the pricing tier. If needed, upgrade to the Premium tier for broader support. You can learn more about the tiers here: https://azure.microsoft.com/en-us/pricing/details/databricks/

Another common blocker is insufficient permissions. So, make sure your Azure account has the Contributor or Owner role on the subscription and resource group. Also, within Databricks, confirm that your user has the Can Manage Clusters permission. If you’re unsure, check the cluster policies or workspace admin settings.

If the cluster creation fails, Databricks usually logs detailed error messages. Go to your workspace, click on Clusters > Events, and review the logs for errors like QuotaExceeded or VM SKU not available in region. These messages can guide you to the exact root cause.

Finally, if none of these steps resolve the issue, it’s best to escalate the matter by opening a support ticket with Microsoft. You can do this via the Azure Support Portal - https://azure.microsoft.com/en-us/support/create-ticket/, selecting Technical > Databricks > Cluster Creation Issue, and providing your subscription ID, region, and any error messages you've encountered or contact Priority Customer Support - (PCS).

I hope this is helpful! Do not hesitate to let me know if you have any other questions or clarifications.

---

Please don't forget to close up the thread here by upvoting and accept it as an answer if it is helpful.