Edit

Deploy GPU VMs on your Azure Stack Edge Pro GPU device

  • Article

APPLIES TO: Yes for Pro - GPU SKUAzure Stack Edge Pro - GPUYes for Pro 2 SKUAzure Stack Edge Pro 2Yes for Pro R SKUAzure Stack Edge Pro R  

This article describes how to create a GPU VM in the Azure portal or by using the Azure Resource Manager templates.

Use the Azure portal to quickly deploy a single GPU VM. You can install the GPU extension during or after VM creation. Or use Azure Resource Manager templates to efficiently deploy and manage multiple GPU VMs.

Create GPU VMs

You can deploy a GPU VM via the portal or using Azure Resource Manager templates.

For a list of supported operating systems, drivers, and VM sizes for GPU VMs, see What are GPU virtual machines? For deployment considerations, see GPU VMs and Kubernetes.

Important

  • Gen2 VMs are not supported for GPU.
  • If your device will be running Kubernetes, do not configure Kubernetes before you deploy your GPU VMs. If you configure Kubernetes first, it claims all the available GPU resources, and GPU VM creation will fail. For Kubernetes deployment considerations on 1-GPU and 2-GPU devices, see GPU VMs and Kubernetes.
  • If you're running a Windows 2016 VHD, you must enable TLS 1.2 inside the VM before you install the GPU extension on 2205 and higher. For detailed steps, see Troubleshoot GPU extension issues for GPU VMs on Azure Stack Edge Pro GPU.

Follow these steps when deploying GPU VMs on your device via the Azure portal:

  1. To create GPU VMs, follow all the steps in Deploy VM on your Azure Stack Edge using Azure portal, with these configuration requirements:

    • On the Basics tab, select a VM size from N-series, optimized for GPUs. Based on the GPU model on your device, Nvidia T4 or Nvidia A2, the dropdown list will display the corresponding supported GPU VM sizes.

      Screenshot of Basics tab for "Add a virtual machine" in Azure Stack Edge. Size option, with a supported VM size for GPU VMs, is highlighted.

    • To install the GPU extension during deployment, on the Advanced tab, choose Select an extension to install. Then select a GPU extension to install. GPU extensions are only available for a virtual machine with a VM size from N-series.

      Note

      If you're using a Red Hat image, you'll need to install the GPU extension after VM deployment. Follow the steps in Install GPU extension.

      Illustration of steps to add a GPU extension on the Advanced tab of Add a Virtual Machine. Options to select and add an extension are highlighted.

      The Advanced tab shows the extension you selected.

      Screenshot of Advanced tab of Add a virtual machine. An installed GPU extension highlighted.

  2. Once the GPU VM is successfully created, you can view this VM in the list of virtual machines in your Azure Stack Edge resource in the Azure portal.

    Screenshot of "Virtual machines" view in Azure Stack Edge with a newly created GPU VM highlighted.

    Select the VM, and drill down to the details. Make sure the GPU extension has Succeeded status.

    Screenshot of the Details pane for an Azure Stack Edge VM. Installed extensions, with an installed GPU extension, is highlighted.

Note

When updating your device software version from 2012 to later, you will need to manually stop the GPU VMs.

Install GPU extension after deployment

To take advantage of the GPU capabilities of Azure N-series VMs, Nvidia GPU drivers must be installed. From the Azure portal, you can install the GPU extension during or after VM deployment. If you're using templates, you'll install the GPU extension after you create the VM.

If you didn't install the GPU extension when you created the VM, follow these steps to install it on the deployed VM:

  1. Go to the virtual machine you want to add the GPU extension to.

    Screenshot of "Virtual machines" view for an Azure Stack Edge device, with a virtual machine highlighted in the list of VMs.

  2. In Details, select + Add extension. Then select a GPU extension to install.

    GPU extensions are only available for a virtual machine with a VM size from N-series. If you prefer, you can install the GPU extension after deployment.

Illustration showing 2 steps to use the "Plus Add Extension" button on the virtual machine "Details" pane to add a GPU extension to a VM on an Azure Stack Edge device.

Note

You can't remove a GPU extension via the portal. Instead, use the Remove-AzureRmVMExtension cmdlet in Azure PowerShell. For instructions, see Remove GPU extension

Next steps