Note
Access to this page requires authorization. You can try signing in or changing directories.
Access to this page requires authorization. You can try changing directories.
Azure confidential GPUs are based on AMD 4th Gen EPYC processors with SEV-SNP technology and NVIDIA H100 Tensor Core GPUs. In this VM SKU Trusted Execution Environment (TEE) spans confidential VM on the CPU and attached GPU, enabling secure offload of data, models and computation to the GPU.
Sizes
We offer the following VM sizes:
| Size Family | TEE | Description |
|---|---|---|
| NCCadsH100v5-series | AMD SEV-SNP and NVIDIA H100 Tensor Core GPUs | CVM with Confidential GPU. |
Azure CLI
You can use the Azure CLI with your confidential GPU VMs.
To see a list of confidential VM sizes, run the following command. Replace <vm-series> with the series you want to use. The output shows information about available regions and availability zones.
vm_series='NCC'
az vm list-skus \
--size dc \
--query "[?family=='standard${vm_series}Family'].{name:name,locations:locationInfo[0].location,AZ_a:locationInfo[0].zones[0],AZ_b:locationInfo[0].zones[1],AZ_c:locationInfo[0].zones[2]}" \
--all \
--output table
For a more detailed list, run the following command instead:
vm_series='NCC'
az vm list-skus \
--size dc \
--query "[?family=='standard${vm_series}Family']"
Deployment considerations
Consider the following settings and choices before deploying confidential GPU VMs.
Azure subscription
To deploy a confidential GPU VM instance, consider a pay-as-you-go subscription or other purchase option. If you're using an Azure free account, the quota doesn't allow the appropriate number of Azure compute cores.
You might need to increase the cores quota in your Azure subscription from the default value. Default limits vary depending on your subscription category. Your subscription might also limit the number of cores you can deploy in certain VM size families, including the confidential VM sizes.
To request a quota increase, open an online customer support request.
If you have large-scale capacity needs, contact Azure Support. Azure quotas are credit limits, not capacity guarantees. You only incur charges for cores that you use.
Pricing
For pricing options, see the Linux Virtual Machines Pricing.
Regional availability
For availability information, see which VM products are available by Azure region.
Resizing
Confidential GPU VMs run on specialized hardware and resizing is currently not supported.
Guest OS support
OS images for confidential VMs have to meet certain security and compatibility requirements. Qualified images support the secure mounting, attestation, optional confidential OS disk encryption, and isolation from underlying cloud infrastructure. These images include:
- Ubuntu 22.04 LTS
For more information about supported and unsupported VM scenarios, see support for generation 2 VMs on Azure.
High availability and disaster recovery
You're responsible for creating high availability and disaster recovery solutions for your confidential GPU VMs. Planning for these scenarios helps minimize and avoid prolonged downtime.
Next steps
For more information see our Confidential VM FAQ.