Azure Container instance - No GPU available

Question

Azure Container instance - No GPU available

Vignesh Kalaimani 20

I have created a python deep learning application which requires GPU. This application is going to run only 1 hour in a day. So creating a separate VM will not cost effective. Going serverless seemed to be the correct way. I saw that we can use GPU in Azure Container instance. When creating a container instance I am facing issues. No GPUs available in central India. How to resolve this?

User's image

Accepted answer

0 additional answers

Your answer

Answer 1

Andrei Barbu 2,596 Microsoft Employee

Hello Vignesh,

Azure Container Instances (ACI) supports GPU SKU V100 for Central India as per:
https://learn.microsoft.com/en-us/azure/container-instances/container-instances-region-availability#linux-container-groups
https://learn.microsoft.com/en-us/azure/container-instances/container-instances-gpu#region-availability

I can confirm that I just tried from my side to create one ACI in Central India with GPU and I get the same message. Taking in consideration the message and the fact that GPU usability is for the moment a preview feature for ACI (there is no guarantee about runtime or availability) , it is most probably the fact that there are no GPU resources available in Central India region. I tried in West Europe, and I have the ability to use GPU for ACI.

I would recommend you one or more of the following approaches:

1 - Create your ACI with GPU in another region. Please refer to the above links to understand the regions where ACI supports GPU

2 - Wait some time hopping some capacity will free-up in Central India

3 - Open a support request to report your issue and get more insights of why it doesn't work right now to create ACI with GPU in Central India.

I hope this is helpful. If any clarification needed, let me know and I will do my best to answer.

Please "Accept as Answer" and Upvote if it helped, so that it can help others in the community looking for help on similar topics.

Thank you!

Vignesh Kalaimani 20 Reputation points

2023-01-30T12:57:35.2666667+00:00

Since GPU usage is in Preview. What are the other options I can use if I can not use ACI.
Andrei Barbu 2,596 Reputation points Microsoft Employee

2023-01-30T13:02:14.08+00:00

I think a good alternative is to use GPU in Azure Kubernetes Service (AKS) if you have a containerized application.

You may also take in consideration using GPU optimized VMs.
Vignesh Kalaimani 20 Reputation points

2023-01-30T13:05:53.1366667+00:00

I do not want to RUN a VM all the time. My usage is going to me just 1 hour a day. Could you please let me know if I can do that with this services?.
Vignesh Kalaimani 20 Reputation points

2023-01-30T13:09:48.4366667+00:00

Since I am going to RUN this application only 1 hour a day. I do not this VM or AKS will be cost efficient since needed to be on all the time. Is there any other options?
Andrei Barbu 2,596 Reputation points Microsoft Employee

2023-01-30T13:16:56.6766667+00:00

If the cost is the concern, you can stop and start the AKS cluster as per your needs. You can try to automate the process with a script.

Additionally, Azure Batch also supports GPU instances.

I just tried to help on the scenario that it didn't work for you to create an ACI with GPU in Central India but I personally didn't use other Azure resources with GPU, so I may lack some expertise here. You can ask a new question here in Q&A to present your use case and other members may suggest you viable options or, depending on your use case and complexity, you may take in consideration a support plan that includes Azure Cloud Solution Architect that can work with you to setup your Azure environment as per your needs.

Share via

Azure Container instance - No GPU available

0 additional answers

Your answer