What is the best way to deploy my machine learning model using GPUs, specifically as a web based API?

Amro Ghoneim 116 Reputation points

I am trying to find the best way to run my machine learning models on GPUs for inference as an http request. Do Azure functions support GPUs? if not, what are other options I can look into?

note: I also want to use packaged models, not necessarily ones of my own creation (such as easyOCR for python)

Azure Machine Learning
Azure Machine Learning
An Azure machine learning service for building and deploying models.
1,849 questions
Azure Functions
Azure Functions
An Azure service that provides an event-driven serverless compute platform.
2,997 questions
0 comments No comments
{count} votes

Accepted answer
  1. Roderick Bant 2,031 Reputation points


    If you need GPU support on ML inference the only supported option is the Azure Kubernetes Service as stated in this documentation

    For guidance on deploying an ML model to AKS, please refer to this documenation on deploying to AKS

    1 person found this answer helpful.

0 additional answers

Sort by: Most helpful