Deploy GPU VMs on your Azure Stack Edge Pro GPU device
APPLIES TO: Azure Stack Edge Pro - GPUAzure Stack Edge Pro 2Azure Stack Edge Pro R
This article describes how to create a GPU VM in the Azure portal or by using the Azure Resource Manager templates.
Use the Azure portal to quickly deploy a single GPU VM. You can install the GPU extension during or after VM creation. Or use Azure Resource Manager templates to efficiently deploy and manage multiple GPU VMs.
Create GPU VMs
You can deploy a GPU VM via the portal or using Azure Resource Manager templates.
For a list of supported operating systems, drivers, and VM sizes for GPU VMs, see What are GPU virtual machines? For deployment considerations, see GPU VMs and Kubernetes.
Important
- Gen2 VMs are not supported for GPU.
- If your device will be running Kubernetes, do not configure Kubernetes before you deploy your GPU VMs. If you configure Kubernetes first, it claims all the available GPU resources, and GPU VM creation will fail. For Kubernetes deployment considerations on 1-GPU and 2-GPU devices, see GPU VMs and Kubernetes.
- If you're running a Windows 2016 VHD, you must enable TLS 1.2 inside the VM before you install the GPU extension on 2205 and higher. For detailed steps, see Troubleshoot GPU extension issues for GPU VMs on Azure Stack Edge Pro GPU.
Follow these steps when deploying GPU VMs on your device via the Azure portal:
To create GPU VMs, follow all the steps in Deploy VM on your Azure Stack Edge using Azure portal, with these configuration requirements:
On the Basics tab, select a VM size from N-series, optimized for GPUs. Based on the GPU model on your device, Nvidia T4 or Nvidia A2, the dropdown list will display the corresponding supported GPU VM sizes.
To install the GPU extension during deployment, on the Advanced tab, choose Select an extension to install. Then select a GPU extension to install. GPU extensions are only available for a virtual machine with a VM size from N-series.
Note
If you're using a Red Hat image, you'll need to install the GPU extension after VM deployment. Follow the steps in Install GPU extension.
The Advanced tab shows the extension you selected.
Once the GPU VM is successfully created, you can view this VM in the list of virtual machines in your Azure Stack Edge resource in the Azure portal.
Select the VM, and drill down to the details. Make sure the GPU extension has Succeeded status.
Note
When updating your device software version from 2012 to later, you will need to manually stop the GPU VMs.
Install GPU extension after deployment
To take advantage of the GPU capabilities of Azure N-series VMs, Nvidia GPU drivers must be installed. From the Azure portal, you can install the GPU extension during or after VM deployment. If you're using templates, you'll install the GPU extension after you create the VM.
If you didn't install the GPU extension when you created the VM, follow these steps to install it on the deployed VM:
Go to the virtual machine you want to add the GPU extension to.
In Details, select + Add extension. Then select a GPU extension to install.
GPU extensions are only available for a virtual machine with a VM size from N-series. If you prefer, you can install the GPU extension after deployment.
Note
You can't remove a GPU extension via the portal. Instead, use the Remove-AzureRmVMExtension cmdlet in Azure PowerShell. For instructions, see Remove GPU extension