Unable to use GPUs in container instances

Question

I tried to deploy an image on Azure container instance with 1 GPU instance. It fails with the following error.

Resource type 'Microsoft.ContainerInstance/containerGroups' container group quota 'V100Cores' exceeded in region 'eastus'. Limit: '0', Usage: '0' Requested: '1'

And as I refer to the docs, I see that the GPU limit is 0.
How to deploy the container instance with GPUs?

Answer 1

Hello, @CD !

How do I increase the GPU quota for Azure Container Instances?

It's important to note that not all limit increase requests are guaranteed to be approved. Using GPU resources with Azure Container Instances is still in preview and not fully supported yet. Any support is provided on a best-effort basis.

https://learn.microsoft.com/en-us/azure/container-instances/container-instances-resource-and-quota-limits#default-quota-limits

Make sure you meet the following requirements:

• Azure virtual network deployment not supported
• Only available on Linux container groups

If you meet the requirements you can request an increase by submitting an Azure support request (select "Quota" for Issue type). Remember that using GPU resources (preview) is not fully supported yet and any support is provided on a best-effort basis.

---

I hope this has been helpful! Your feedback is important so please take a moment to accept answers.

If you still have questions, please let us know what is needed in the comments so the question can be answered. Thank you for helping to improve Microsoft Q&A!