GPU VM that can pull docker image

Question

GPU VM that can pull docker image

Diksha, Diksha 20

Hello,

My name is Diksha. I'm looking for a GPU VM from AZURE that can let me pull 10gm docker Image and run my deep learning model. the configuration that i'm looking for is :

16gb RAM, 6 core cpu i7, 6 gb RAM GPU, 1tb disk space SSD.

the microsoft docs page suggests to use D series VM to pull the docker image but that doesnt have a GPU. my question is which GPU Virtual machine is ideal to use the docker?

Thank you.

Accepted answer

0 additional answers

Your answer

Answer 1

Patchfox 4,176

Hi Diksha, Diksha I hope I can help you with this question.

For GPU optimized VMs to do machine learning tasks I would recommend to use The NC-series.

e.g. Azure NC6 series (Standard_NC6) virtual machines with K80 GPUs

Maybe this articles are also interesting for you:

https://learn.microsoft.com/en-us/azure/virtual-machines/nc-series

https://azure.microsoft.com/de-de/blog/gpus-vs-cpus-for-deployment-of-deep-learning-models/

If the reply was helpful, please don’t forget to upvote or accept it as an answer, thank you.

Diksha, Diksha 20 Reputation points

2023-02-27T21:31:51.2066667+00:00

I did try the NC series that has the gpu but it didnt let me initialize the docker.
Patchfox 4,176 Reputation points

2023-02-27T21:40:45.9566667+00:00

Ok, I understand.

Maybe these solutions fit our need more:

https://azuremarketplace.microsoft.com/en-us/marketplace/apps/microsoft-dsvm.ubuntu-2004?tab=Overview&culture=en-us&country=us

https://learn.microsoft.com/en-us/azure/container-instances/container-instances-gpu
Diksha, Diksha 20 Reputation points

2023-02-27T21:48:02.98+00:00

Thank you for additional information. i checked out the link :

https://azuremarketplace.microsoft.com/en-us/marketplace/apps/microsoft-dsvm.ubuntu-2004?tab=Overview&culture=en-us&country=us

does this means if i select a GPU VM nc series and ubuntu instead of windows . i should be able to use docker? because i did get the NC series previously with windows 10 and i was abled to download the docker but it was throwing "desktop docker failed to start" error.
Patchfox 4,176 Reputation points

2023-02-27T21:53:16.5466667+00:00

Yes, both are possible. There is also a Windows server version and it supports docker:

Check out the features of each version: https://learn.microsoft.com/en-us/azure/machine-learning/data-science-virtual-machine/tools-included#build-deep-learning-and-machine-learning-solutions

But consider that the windows server version only supports windows images.
Diksha, Diksha 20 Reputation points

2023-02-27T22:06:01.01+00:00

This is very helpful i will try and test it . Thank you so much. can i keep this thread running in case i have additional questions or i run into any problems?
Patchfox 4,176 Reputation points

2023-02-27T22:09:00.07+00:00

You're welcome, I appreciate your feedback.

If the answer helped you feel free to confirm it as Accepted. Thank you.
Diksha, Diksha 20 Reputation points

2023-03-10T16:28:09.75+00:00

Hello @Patchfox so i tried using DSVM with GPU enabled NC series. its still not letting me use docker. when i looked at docker FAQs i learned that docker is only accessible when used natively however if you wanna use in on VM you must have nested virtualization. now my concern is none of the AZURE GPU machine has nested virtualization. what can i do in this case?
Patchfox 4,176 Reputation points

2023-03-11T00:43:20.99+00:00

Did you try Azure Container Instances with enabled GPU? I know it‘s not a VM solution but at the moment I see no other option for your case.

Share via

GPU VM that can pull docker image

0 additional answers

Your answer