databricks compute cluster saying sku not available. how to fix?

Question

databricks compute cluster saying sku not available. how to fix?

deepti agrawal 0

I have created an azure trial account in useast and trying to create databricks cluster in same region. I tried to create a single node cluster with 15.x Lts runtime and tried several VM Sizes, but all says sku not available. how to fix?

phemanth 15,765 Reputation points Microsoft External Staff Moderator

2025-05-12T04:43:20.1333333+00:00
@deepti agrawal It sounds like you're encountering the "SKU not available" error while trying to create a Databricks cluster in Azure. This can happen for several reasons, primarily related to resource availability in your region. Here’s what you can do to troubleshoot and fix this:

Check SKU Availability: First, verify if the VM sizes you're attempting to use are available in the East US region. You can do this using the Azure CLI with the following command:

az vm list-skus --location eastus --size Standard_D --all --output table

Adjust the size parameter to fit the VM sizes you are trying to deploy.

Alternative VM Sizes: If your selected VM sizes are not available, you might want to try other VM series or sizes that offer similar performance.

Zone-Specific Availability: Sometimes, availability can differ across different availability zones within a region. Check if you can specify an availability zone that might have the resources available.

Use Azure Portal: You can also check the Azure Portal for available VM sizes while creating the cluster. It typically displays available configurations right in the UI.

Hopefully, one of these steps will help resolve the issue for you!
deepti agrawal 0 Reputation points

2025-05-12T05:51:54.96+00:00

Thanks for answering @phemanth how can I check the available sizes for my region in the UI?
phemanth 15,765 Reputation points Microsoft External Staff Moderator

2025-05-13T05:30:13.63+00:00

@deepti agrawal

You're welcome! To check the available VM sizes for your region in the Azure Portal, follow these steps:

Open the Azure Portal: Go to portal.azure.com and sign in with your Azure account.

Navigate to Virtual Machines: In the left-hand menu, select "Virtual Machines."

Create a New VM: Click on "Create" and then "Azure Virtual Machine."

Select Region and Size: During the VM creation process, you'll be prompted to select a region. Choose your desired region (e.g., East US). When you get to the "Size" section, click on "See all sizes."

View Available Sizes: A list of available VM sizes for the selected region will be displayed. You can filter and sort these sizes based on your requirements.
phemanth 15,765 Reputation points Microsoft External Staff Moderator

2025-05-14T05:33:17.0566667+00:00

@deepti agrawal We haven’t heard from you on the last response and was just checking back to see if you have a resolution yet. In case if you have any resolution please do share that same with the community as it can be helpful to others. Otherwise, will respond with more details and we will try to help.

1 answer

Your answer

phemanth 15,765 Reputation points Microsoft External Staff Moderator

2025-05-12T04:43:20.1333333+00:00

@deepti agrawal It sounds like you're encountering the "SKU not available" error while trying to create a Databricks cluster in Azure. This can happen for several reasons, primarily related to resource availability in your region. Here’s what you can do to troubleshoot and fix this:

Check SKU Availability: First, verify if the VM sizes you're attempting to use are available in the East US region. You can do this using the Azure CLI with the following command:

az vm list-skus --location eastus --size Standard_D --all --output table

Adjust the size parameter to fit the VM sizes you are trying to deploy.

Alternative VM Sizes: If your selected VM sizes are not available, you might want to try other VM series or sizes that offer similar performance.

Zone-Specific Availability: Sometimes, availability can differ across different availability zones within a region. Check if you can specify an availability zone that might have the resources available.

Use Azure Portal: You can also check the Azure Portal for available VM sizes while creating the cluster. It typically displays available configurations right in the UI.

Hopefully, one of these steps will help resolve the issue for you!
deepti agrawal 0 Reputation points

2025-05-12T05:51:54.96+00:00

Thanks for answering @phemanth how can I check the available sizes for my region in the UI?
phemanth 15,765 Reputation points Microsoft External Staff Moderator

2025-05-13T05:30:13.63+00:00

@deepti agrawal

You're welcome! To check the available VM sizes for your region in the Azure Portal, follow these steps:

Open the Azure Portal: Go to portal.azure.com and sign in with your Azure account.

Navigate to Virtual Machines: In the left-hand menu, select "Virtual Machines."

Create a New VM: Click on "Create" and then "Azure Virtual Machine."

Select Region and Size: During the VM creation process, you'll be prompted to select a region. Choose your desired region (e.g., East US). When you get to the "Size" section, click on "See all sizes."

View Available Sizes: A list of available VM sizes for the selected region will be displayed. You can filter and sort these sizes based on your requirements.
phemanth 15,765 Reputation points Microsoft External Staff Moderator

2025-05-14T05:33:17.0566667+00:00

@deepti agrawal We haven’t heard from you on the last response and was just checking back to see if you have a resolution yet. In case if you have any resolution please do share that same with the community as it can be helpful to others. Otherwise, will respond with more details and we will try to help.

Answer 1

deepti agrawal 0

Hi @phemanth firstly, thanks for helping. I really appreciate that.

I did try a lot of VM sizes and it was giving me sku error and sometimes quota error. Then, I starting monitoring the virtual machines here https://portal.azure.com/?quickstart=true#view/Microsoft_Azure_ComputeHub/ComputeHubMenuBlade/~/virtualMachinesBrowse and one of them just worked randomly. which was a 14gb 4 core general purpose VM. DSv4 series.

Share via

databricks compute cluster saying sku not available. how to fix?

1 answer

Your answer