Nested Virtualization With GPU on Azure

The A Man 71 Reputation points
2022-03-06T20:45:25.06+00:00

Do the Nv-v4 series VMs on Azure support nested virtualization yet. I don't mind having to install Windows 11 (I read somewhere that the virtualization feature on AMD hardware would only be rolled out in Windows 11), as long as Microsoft supplies the GPU drivers for the same. For a long time, there was a driver issue with Nv-v4 series VMs; I hope that doesn't repeat with Windows 11.

I require Docker AND GPU; Docker requires Hyper V; Hyper V requires hardware-enabled nested virtualization. For almost a year I had been using a d-v3 VM (Standard D4s v3, to be specific) that supported virtualization pretty well. I was hoping they'd bring that support to the N class VMs too someday, but it has taken quite a while now. When might we expect it to happen? Or do they already? Microsoft Learn on the subject seem to imply that the N class doesn't support it yet.

Azure Virtual Machines
Azure Virtual Machines
An Azure service that is used to provision Windows and Linux virtual machines.
7,254 questions
0 comments No comments
{count} votes

Accepted answer
  1. GitaraniSharma-MSFT 48,011 Reputation points Microsoft Employee
    2022-03-10T09:32:49.367+00:00

    Hello @The A Man ,

    Welcome to Microsoft Q&A Platform. Thank you for reaching out & hope you are doing well.

    I understand that your requirement is to have Docker AND GPU in your Azure VM and would like to know if Nv-v4 series VMs on Azure support nested virtualization yet.

    I checked with the Azure VM Product group team and they have provided the below update:
    NVv4 or any other N series VMs do not support nested virtualization. Nested ParaV support is on the roadmap for future NV SKUs but not for NVv4.

    On the Nested virtualization side we have introduced GPU partitioning with NVv4. The smaller GPU VM sizes in NVv4 provide better benefit compared to nested virtualization for GPU sharing because GPU-P is done at the hardware level.
    Please refer : https://azure.microsoft.com/en-in/blog/power-your-azure-gpu-workstations-with-flexible-gpu-partitioning/

    Kindly let us know if the above helps or you need further assistance on this issue.

    ----------------------------------------------------------------------------------------------------------------

    Please "Accept the answer" if the information helped you. This will help us and others in the community as well.

    1 person found this answer helpful.

0 additional answers

Sort by: Most helpful