How to create a VM with GPU

Question

How to create a VM with GPU

Varun Yadav 20

When I try to create a VM from azure portal. I do not see any of the available VM sizes having GPU's tried to switch regions but none of the regions have GPU.

Anonymous

Hi Varun Yadav,

Welcome to the Microsoft Q&A Platform! Thank you for asking your question here.

Set up a VM with a GPU using several account types, including Pay-as-you-go. There has been a recent surge in demand for GPU VMs (I know that simulations in particular have been popular) so finding hardware availability may take some effort, especially in light of recent supply chain challenges around the globe. I've noticed that some regions tend to have better availability than others so if you are flexible, I would check surrounding regions.

Finding a VM with a GPU GPU optimized virtual machine sizes are going to be the N series. To find what specific sizes are offered in each region, you can check the products available by region page (and depending on current availability, you may need to look at neighboring regions):

https://azure.microsoft.com/en-us/global-infrastructure/services/?products=virtual-machines

Azure NV Series GPU Memory Allocations:


Instance Type	GPU Memory	vCPUs	RAM	GPU Model
Standard_NC6	8 GB	6	56 GB	Tesla M60
Standard_NV6	8 GB	6	56 GB	Tesla M60
Standard_NC12	16 GB	12	112 GB	Tesla P40
Standard_NC24	24 GB	24	224 GB	Tesla V100
Standard_NC48	40 GB	48	448 GB	A100

Azure CLI Command to Provision NV VM

az vm create \
  --name MyNVVM \
  --resource-group MyResourceGroup \
  --image UbuntuLTS \
  --size Standard_NC6 \
  --admin-username azureuser \
  --generate-ssh-keys

PowerShell Commands for VM Setup

powershell

New-AzVM -ResourceGroupName "MyResourceGroup" -Name "MyNVVM" `
  -Location "East US" -VirtualNetworkName "MyVNet" `
  -SubnetName "MySubnet" -PublicIpAddressName "MyPublicIP" `
  -SecurityGroupName "MyNetworkSecurityGroup" `
  -Size "Standard_NC6" -ImageName "Canonical:UbuntuServer:18.04-LTS:latest" `
  -AdminUsername "azureuser" -SSHKeyPath "~/.ssh/id_rsa"

Setting up your GPU drivers For first time setup, you will likely want to consult the documentation to make sure your drivers are properly configured on a VM. We have instructions for both NVIDIA and AMD GPU drivers:

NVIDIA
AMD

Set up a VM? You can set up a VM using a variety of techniques including Azure CLI, the Azure Portal, Azure PowerShell, Bicep, and ARM templates. For first time setup I usually recommend using the portal:

https://learn.microsoft.com/en-us/azure/virtual-machines/windows/quick-create-portal

https://learn.microsoft.com/en-us/azure/virtual-machines/sizes/gpu-accelerated/nv-family

https://azure.microsoft.com/en-us/explore/global-infrastructure/products-by-region/?products=virtual-machines

If you found it helpful, could you kindly click the “Accept Answer and upvote” on the post.

If you have any further queries, please let us know we are glad to help you.

Anonymous

2025-03-11T12:14:14.5166667+00:00

Hi Varun Yadav,

I just wanted to check if you had a chance to review my comment. If you found it helpful, could you kindly click the "Accept Answer and Upvote" on my post. This will help increase its visibility of this question for other members of the Microsoft Q&A community.

Thank You
Varun Yadav 20 Reputation points

2025-03-19T17:14:45.9333333+00:00

I am trying to use this one, but this option is not available for the regions - Asia Pacific - Korea south, South India, West India

My subscription are "pay as you go: and "Microsoft Azure sponsorship"

let me know how can I use below series hardware.
Anonymous

2025-03-20T11:24:50.37+00:00

Hi Varun Yadav,

The unavailability of the NCas_t4_v3 VM size in specific regions like Asia Pacific - Korea South and West India may be due to capacity constraints or limited regional support for that VM type. Consider deploying in a different region where it is available.

The NCas_t4_v3 VM size may not be available in the specified regions due to high demand or limited resources and

It is available in Central India, Sweden Central, East Us, South India. If possible, try deploying the VM in a different region where the NCas_t4_v3 is available.

You can use this NCas_t4_v3 VM size, Either Pay-as-you-go or with Savings Plan for one or three years and you can choose to reserve the Instance with one or three years, therefore you can save the cost.

Please check the document for more information:

https://learn.microsoft.com/en-us/azure/virtual-machines/sizes/gpu-accelerated/ncast4v3-series?tabs=sizebasic

If you found it helpful, could you kindly click the “Accept Answer and upvote” on the post.

If you have any further queries, please let us know we are glad to help you.
Varun Yadav 20 Reputation points

2025-03-20T11:37:13.5366667+00:00

Hi Suresh,

I tried to create a VM with region selected as central India but when I tried to change size of VM, I don't see the N series Hardware and I have tried this for almost every region. so how can I get access to GPU based machine.
Anonymous

2025-03-20T13:33:45.7+00:00

Hi Varun Yadav,

In order to use the N series VMs, you need to submit a request to enable these series for your subscription (if your subscription supports). Request a quota submission here for the VM available region.

For Image, choose the base operating system that you want for your VM. Microsoft’s Data Science Virtual Machine (DSVM) and NVIDIA CUDA Suit Standard Plan - x64 Gen1, NVIDIA GPU-Optimized PyTorch - x64 Gen2 etc., is recommended and we have many more GPU based images are available, as it comes packaged with common tools and libraries such as Tensorflow, Pytorch, CUDA, Anaconda, and much more. Click on Browse all images and disks to search for the DSVM and GPU based Images.

For Size, select the type of VM you want. In Azure, the GPU-enabled VMs fall under the N-Series.

Here, you can see the required Images of GPU and DSVM and search to see all images of GPU based and select required one.

It's getting Insufficient quota-family limit. Family vCPUs are insufficient to deploy these sizes with GPU Images of NC-Series.

Here the N-series quota is not available for most of the regions, check for the availability, it's going to change from time to time based on selected regions status.

Here, most of the NC and NC_Promo series were retired on September 6, 2023. where currently none of the remaining N-series VM size are available in any of the Zones (Zones 1,2 and 3).

https://learn.microsoft.com/en-us/azure/virtual-machines/sizes/gpu-accelerated/nc-series?tabs=sizebasic

If you have any further queries, please let us know we are glad to help you

Venkat V 2,545 Microsoft External Staff Moderator

Hi @varun yadav

You can use the PowerShell script below to check if the SKU (e.g., "Standard_NC6") is available in the desired region. If the SKU is not available, a message will be displayed, and the VM creation will be skipped.


    $location = "East US"  # Change this to your target location

     $vmSize = "Standard_NC6"

    $skuAvailable = Get-AzComputeResourceSku | Where-Object { 

        ($_.Locations -match $location) -and ($_.Name -eq $vmSize)

    }

    # If SKU is available, proceed with VM creation

    if ($skuAvailable) {

        Write-Host "✅ The SKU '$vmSize' is available in '$location'. Proceeding with VM creation..."

       # Create VM

        New-AzVM -ResourceGroupName "MyResourceGroup" -Name "MyNVVM" `

            -Location $location -VirtualNetworkName "MyVNet" `

            -SubnetName "MySubnet" -PublicIpAddressName "MyPublicIP" `

            -SecurityGroupName "MyNetworkSecurityGroup" `

            -Size $vmSize -ImageName "Canonical:UbuntuServer:18.04-LTS:latest" `

            -AdminUsername "azureuser" -SSHKeyPath "~/.ssh/id_rsa"
    } else {

        Write-Host "❌ The SKU '$vmSize' is NOT available in '$location'. Skipping VM creation." -ForegroundColor Red

    }

Output:
User's image

Reference: https://learn.microsoft.com/en-gb/azure/virtual-machines/sizes/gpu-accelerated/nc-family

Varun Yadav 20 Reputation points

2025-03-21T17:04:40.89+00:00

Hi Suresh, I am not satisfied with your reply.

I don't see the option to select NC* series. so, I created a VM with NVidia image with size Standard D2ads v5 (2 vcpus, 8 GiB memory). I tried to request quota increase from "Quota" but I don't see option to increase.

Can you please elaborate the recommendation steps in detail - how can I raise request for setting up GPU instances?
Venkat V 2,545 Reputation points Microsoft External Staff Moderator

2025-03-21T18:20:05.97+00:00

Hi Varun

Have you had a chance to look at my response? If the NC series are not showing in your subscription, even with a Pay-as-you-go plan, kindly search for 'NC series' and check what it returns. If it's showing under 'Not Supported', kindly raise the request by selecting request quota
Nikhil Duserla 7,935 Reputation points Microsoft External Staff Moderator

2025-03-24T14:55:06.4266667+00:00

Hi @Varun Yadav,

Please continue the discussion on private message.

Accepted answer

1 additional answer

Your answer

Anonymous

2025-03-11T12:14:14.5166667+00:00

Hi Varun Yadav,

I just wanted to check if you had a chance to review my comment. If you found it helpful, could you kindly click the "Accept Answer and Upvote" on my post. This will help increase its visibility of this question for other members of the Microsoft Q&A community.

Thank You
Varun Yadav 20 Reputation points

2025-03-19T17:14:45.9333333+00:00

I am trying to use this one, but this option is not available for the regions - Asia Pacific - Korea south, South India, West India

My subscription are "pay as you go: and "Microsoft Azure sponsorship"

let me know how can I use below series hardware.
Anonymous

2025-03-20T11:24:50.37+00:00

Hi Varun Yadav,

The unavailability of the NCas_t4_v3 VM size in specific regions like Asia Pacific - Korea South and West India may be due to capacity constraints or limited regional support for that VM type. Consider deploying in a different region where it is available.

The NCas_t4_v3 VM size may not be available in the specified regions due to high demand or limited resources and

It is available in Central India, Sweden Central, East Us, South India. If possible, try deploying the VM in a different region where the NCas_t4_v3 is available.

You can use this NCas_t4_v3 VM size, Either Pay-as-you-go or with Savings Plan for one or three years and you can choose to reserve the Instance with one or three years, therefore you can save the cost.

Please check the document for more information:

https://learn.microsoft.com/en-us/azure/virtual-machines/sizes/gpu-accelerated/ncast4v3-series?tabs=sizebasic

If you found it helpful, could you kindly click the “Accept Answer and upvote” on the post.

If you have any further queries, please let us know we are glad to help you.
Varun Yadav 20 Reputation points

2025-03-20T11:37:13.5366667+00:00

Hi Suresh,

I tried to create a VM with region selected as central India but when I tried to change size of VM, I don't see the N series Hardware and I have tried this for almost every region. so how can I get access to GPU based machine.
Anonymous

2025-03-20T13:33:45.7+00:00

Hi Varun Yadav,

In order to use the N series VMs, you need to submit a request to enable these series for your subscription (if your subscription supports). Request a quota submission here for the VM available region.

For Image, choose the base operating system that you want for your VM. Microsoft’s Data Science Virtual Machine (DSVM) and NVIDIA CUDA Suit Standard Plan - x64 Gen1, NVIDIA GPU-Optimized PyTorch - x64 Gen2 etc., is recommended and we have many more GPU based images are available, as it comes packaged with common tools and libraries such as Tensorflow, Pytorch, CUDA, Anaconda, and much more. Click on Browse all images and disks to search for the DSVM and GPU based Images.

For Size, select the type of VM you want. In Azure, the GPU-enabled VMs fall under the N-Series.

Here, you can see the required Images of GPU and DSVM and search to see all images of GPU based and select required one.

It's getting Insufficient quota-family limit. Family vCPUs are insufficient to deploy these sizes with GPU Images of NC-Series.

Here the N-series quota is not available for most of the regions, check for the availability, it's going to change from time to time based on selected regions status.

Here, most of the NC and NC_Promo series were retired on September 6, 2023. where currently none of the remaining N-series VM size are available in any of the Zones (Zones 1,2 and 3).

https://learn.microsoft.com/en-us/azure/virtual-machines/sizes/gpu-accelerated/nc-series?tabs=sizebasic

If you have any further queries, please let us know we are glad to help you
Venkat V 2,545 Reputation points Microsoft External Staff Moderator

2025-03-21T11:13:24.58+00:00

Hi @varun yadav

You can use the PowerShell script below to check if the SKU (e.g., "Standard_NC6") is available in the desired region. If the SKU is not available, a message will be displayed, and the VM creation will be skipped.

$location = "East US" # Change this to your target location $vmSize = "Standard_NC6" $skuAvailable = Get-AzComputeResourceSku | Where-Object { ($_.Locations -match $location) -and ($_.Name -eq $vmSize) } # If SKU is available, proceed with VM creation if ($skuAvailable) { Write-Host "✅ The SKU '$vmSize' is available in '$location'. Proceeding with VM creation..." # Create VM New-AzVM -ResourceGroupName "MyResourceGroup" -Name "MyNVVM" ` -Location $location -VirtualNetworkName "MyVNet" ` -SubnetName "MySubnet" -PublicIpAddressName "MyPublicIP" ` -SecurityGroupName "MyNetworkSecurityGroup" ` -Size $vmSize -ImageName "Canonical:UbuntuServer:18.04-LTS:latest" ` -AdminUsername "azureuser" -SSHKeyPath "~/.ssh/id_rsa" } else { Write-Host "❌ The SKU '$vmSize' is NOT available in '$location'. Skipping VM creation." -ForegroundColor Red }

Output:

Reference: https://learn.microsoft.com/en-gb/azure/virtual-machines/sizes/gpu-accelerated/nc-family
Varun Yadav 20 Reputation points

2025-03-21T17:04:40.89+00:00

Hi Suresh, I am not satisfied with your reply.

I don't see the option to select NC* series. so, I created a VM with NVidia image with size Standard D2ads v5 (2 vcpus, 8 GiB memory). I tried to request quota increase from "Quota" but I don't see option to increase.

Can you please elaborate the recommendation steps in detail - how can I raise request for setting up GPU instances?
Venkat V 2,545 Reputation points Microsoft External Staff Moderator

2025-03-21T18:20:05.97+00:00

Hi Varun

Have you had a chance to look at my response? If the NC series are not showing in your subscription, even with a Pay-as-you-go plan, kindly search for 'NC series' and check what it returns. If it's showing under 'Not Supported', kindly raise the request by selecting request quota
Nikhil Duserla 7,935 Reputation points Microsoft External Staff Moderator

2025-03-24T14:55:06.4266667+00:00

Hi @Varun Yadav,

Please continue the discussion on private message.

Answer 1

Hi @Varun Yadav,Thank you for connecting with us. I have provided you with clear steps that will help resolve this issue.

Navigate to azure portal>>VM>>Create New VM>>VM Name>>Region: select Region>>Availability options: No infrastructure redundancy required>>Select Image>>Size: Click on See all sizes>>Insufficient quota family limit>>Select your required GPU and request quota.

User's image

If an answer has been helpful, please consider accepting the answer to help increase visibility of this question for other members of the Microsoft Q&A community. If not, please let us know what is still needed in the comments so the question can be answered. Thank you for helping to improve Microsoft Q&A! User's image

Answer 2

Deleted

This answer has been deleted due to a violation of our Code of Conduct. The answer was manually reported or identified through automated detection before action was taken. Please refer to our Code of Conduct for more information.

Comments have been turned off. Learn more

Share via

How to create a VM with GPU

1 additional answer

Your answer