NVIDIA GPU not installed in NVIDIA GPU-Optimized VMI?

Question

NVIDIA GPU not installed in NVIDIA GPU-Optimized VMI?

Gordon Long 40

I spun up a VM to do LLM processing using the "NVIDIA GPU-Optimized VMI" option - but when I run lspci there doesn't seem to be any NVIDIA hardware installed (only Mellanox network adapters), and I can't interface nor located nvidia-drivers. I need GPU to properly train and deploy my localized LLM solutions, how can I best do this with Azure?

Markapuram Sudheer Reddy 1,665 Reputation points Microsoft External Staff

2025-04-01T21:32:22.43+00:00

Hi Gordon Long,

For a NVIDIA GPU-Optimized VMI, ensure you select a VM size like N-series VM (e.g., NC, ND) that supports NVIDIA GPUs that is optimized for GPU workloads.

Try to install CUDA drivers from the NVIDIA CUDA Toolkit on N-series VMs. https://learn.microsoft.com/en-us/azure/virtual-machines/linux/n-series-driver-setup#install-cuda-drivers-on-n-series-vms

The NVIDIA GPU Driver Extension installs appropriate NVIDIA CUDA or GRID drivers on an N-series VM. https://learn.microsoft.com/en-us/azure/virtual-machines/extensions/hpccompute-gpu-linux

Could you please share the error screenshots and workaround followed with details during setup to further better assist on it.
Gordon Long 40 Reputation points

2025-04-01T23:44:18.6433333+00:00

Hi @Markapuram Sudheer Reddy , when I try to select N-Series I keep getting messages about it being unavailable in my current location. Are there specific locations you recommend for the N-Series?

Accepted answer

0 additional answers

Your answer

Markapuram Sudheer Reddy 1,665 Reputation points Microsoft External Staff

2025-04-01T21:32:22.43+00:00

Hi Gordon Long,

For a NVIDIA GPU-Optimized VMI, ensure you select a VM size like N-series VM (e.g., NC, ND) that supports NVIDIA GPUs that is optimized for GPU workloads.

Try to install CUDA drivers from the NVIDIA CUDA Toolkit on N-series VMs. https://learn.microsoft.com/en-us/azure/virtual-machines/linux/n-series-driver-setup#install-cuda-drivers-on-n-series-vms

The NVIDIA GPU Driver Extension installs appropriate NVIDIA CUDA or GRID drivers on an N-series VM. https://learn.microsoft.com/en-us/azure/virtual-machines/extensions/hpccompute-gpu-linux

Could you please share the error screenshots and workaround followed with details during setup to further better assist on it.
Gordon Long 40 Reputation points

2025-04-01T23:44:18.6433333+00:00

Hi @Markapuram Sudheer Reddy , when I try to select N-Series I keep getting messages about it being unavailable in my current location. Are there specific locations you recommend for the N-Series?

Answer 1

Hi Gordon Long,

The N series VMs may not be available in all regions. you can try deploying the VM to some other region where the VM size is available by checking the region wise availability. https://azure.microsoft.com/en-us/explore/global-infrastructure/products-by-region/?products=virtual-machines&regions=all

To check the availability of N-series VMs in a specific region:

Go to the Azure portal > Start the VM creation process > Select a region and then verify for N-series VM sizes under the "See all sizes" option.

Ensure that you are using an Azure pay-as-you-go subscription.

The initial quota for the N series VMs (N series VMs offers GPU in Azure) for all subscriptions is set to 0. You can raise a request by following the below reference. Once your request is approved, you can avail GPU based VMs. https://learn.microsoft.com/en-us/azure/quotas/regional-quota-requests.

If your quota increase requests are consistently denied, try upgrading your subscription.

If the information is helpful, please click on "Upvote"

If you have any queries, please do let us know, we will help you.

Share via

NVIDIA GPU not installed in NVIDIA GPU-Optimized VMI?

0 additional answers

Your answer