Need help in creating cluster

Question

Need help in creating cluster

Naveen Sequeira 0

Hi everyone,

I hope you’re doing well.

I’m currently facing an issue while trying to create a cluster in Azure Databricks. Despite trying various approaches, I keep encountering the following error message:

The VM size you are specifying is not available. SkuNotAvailable: The requested VM size for resource 'Following SKUs have failed for Capacity Restrictions: Standard_DS3_v2' is currently not available in location 'eastus'. Please try another size or deploy to a different location or different zone.

I have tried:

Requesting quota increases for the Standard_DS3_v2 VM family

Attempting cluster creation in different Azure regions

Selecting alternative VM sizes

Confirming all permissions are set correctly

However, the issue persists.

Has anyone else faced this problem? Are there any known workarounds or best practices to resolve VM SKU availability issues in East US, or recommended alternative VM sizes or regions that work well with Databricks clusters?

Any help or guidance would be greatly appreciated.

Thanks in advance!

Best regards, [Naveen Sequeira] [+91 9535269973]

0 comments

1 answer

Your answer

Answer 1

Pratyush Vashistha 5,135 Microsoft External Staff Moderator

Hello Naveen Sequeira,

Thanks for posting your Question to Microsoft QnA portal.

Could you please try using a smaller VM size such as Standard_DS2_v2, Standard_D2_v2, or Standard_B2ms for your Databricks cluster. These are more likely to be available under student quotas.

Use the following command to list VM sizes available in your region:

az vm list-skus --location eastus --output table

If Databricks doesn't allow smaller nodes for your workload, consider using Azure ML, Notebooks, or upgrading to a Pay-As-You-Go subscription for full quota control.

Yes this issue was faced by other users as well, You can refer to the following similar issues.

https://learn.microsoft.com/en-us/answers/questions/818143/unable-to-launch-single-node-databricks-cluster-in

https://learn.microsoft.com/en-us/answers/questions/5539133/unable-to-spin-up-azure-databricks-cluster-in-newl

https://learn.microsoft.com/en-us/answers/questions/5532814/cluster-on-databricks

https://learn.microsoft.com/en-us/answers/questions/5538739/unable-to-create-compute-in-databricks

Before you create any clusters in your subscription, you need to check the usage of the cores available in the region.

To find total cores available for a region:

Azure Portal: All services => Subscriptions => Select your subscription => Usage + Quotas

Hope this helps. If this answers your query, do click Accept Answer and Yes for was this answer helpful. And, if you have any further query do let us know.

Thanks

Pratyush

Naveen Sequeira 0 Reputation points

2025-09-02T08:06:45.0133333+00:00

I tried all the above still the error presist. trying this from last one week not working at all tried all the region and locations. please help I need this to be set up. I'm already in Pay as you go and trying to set up personal cluster. I ever created new microsoft account and upgradated it to pay as you go but still the issue is same with that too
Pratyush Vashistha 5,135 Reputation points Microsoft External Staff Moderator

2025-09-02T08:46:13.3866667+00:00
Hi Naveen Sequeira, Thanks for your prompt response. I am sorry to hear that all mentioned process not been able to eliminate your issue.

Also, I will also try to re-create your scenario at my end and get back to you with the results. Meanwhile my additional recommendations for you would be as follows:

Use Azure CLI command az vm list-skus --location eastus --output table or view via Azure Portal as described here: View and request quotas in the Azure portal This checks not only quota but also whether the SKU is in fact offered or depleted in your region.

Cross-check VM deprecation and regional support Many Dv2 and DSv2 SKUs are being phased out in some regions in favor of newer VM series (like Dasv5, Dsv3, or B-series). See: Azure products available by region If Standard_DS3_v2 and similar are not listed as available in your preferred region, they cannot be provisioned—regardless of quota.

Contact Azure support directly If you have tried all combinations available, the persistent SkuNotAvailable error likely means there is either a true supply issue (capacity exhausted) or a soft regional retirement of that SKU. Open a support ticket here and reference serial capacity exhaustion: Create an Azure support request The Support team can check internal capacity, inform you of current constraints, or offer feasible SKUs for your workload.

If you continue to experience this after these checks, please share the az vm list-skus output from your region or the exact VM sizes reported as available, and I can suggest a working configuration that matches your need or help draft a support escalation

If this answers your query, do click Accept Answer and Yes for was this answer helpful. Hope this works otherwise please sahre the list of SKUs output from your region.

Thanks

Pratyush
Pratyush Vashistha 5,135 Reputation points Microsoft External Staff Moderator

2025-09-04T01:15:07.9566667+00:00

Hi Naveen Sequeira,

Following up to see if you have a chance to check my previous response and helped, do let me know if you have any further questions on this. please share the az vm list-skus output from your region or the exact VM sizes reported as available, and I can suggest a working configuration that matches your need or help draft a support escalation.

In case if you have any resolution, please do share that same with the community as it can be helpful to others. Otherwise, will respond with more details and we will try to help.

Thanks

Pratyush
Pratyush Vashistha 5,135 Reputation points Microsoft External Staff Moderator

2025-09-05T01:58:53.7733333+00:00

Hi Naveen Sequeira,

We haven’t heard from you on the last response and was just checking back to see if you have a resolution yet. In case if you have any resolution please do share that same with the community as it can be helpful to others. Otherwise, will respond with more details and we will try to help.

Thanks

Pratyush

Share via

Need help in creating cluster

1 answer

Your answer