Sharing GPU between pods in AKS

Tanul 1,251 Reputation points
2020-09-06T12:52:34.58+00:00

Team,

I have hosted the aks with one node i.e. standard NC6 machine and it has 1 K80 GPU.

I’ve deployed rolling update with 2 replicas which spins 2 pods. By any chance, is it possible to share 1 gpu between these 2 pods. Does these pods shares gpu, if I remove this line from the yaml

limits:
           nvidia.com/gpu: 1

Currently, due to some constraints buying a new node is little difficult.

Kindly help. I would really appreciate.

Thank you

Azure Container Instances
Azure Container Instances
An Azure service that provides customers with a serverless container experience.
625 questions
Azure Virtual Machines
Azure Virtual Machines
An Azure service that is used to provision Windows and Linux virtual machines.
6,980 questions
Azure Kubernetes Service (AKS)
Azure Kubernetes Service (AKS)
An Azure service that provides serverless Kubernetes, an integrated continuous integration and continuous delivery experience, and enterprise-grade security and governance.
1,821 questions
{count} votes

Accepted answer
  1. prmanhas-MSFT 17,886 Reputation points Microsoft Employee
    2020-09-07T10:06:36.887+00:00

    @TanulBhasin-0866 Apologies for delay in response and all the inconvenience caused because of the issue.

    Graphical processing units (GPUs) are often used for compute-intensive workloads such as graphics and visualization workloads. AKS supports the creation of GPU-enabled node pools to run these compute-intensive workloads in Kubernetes

    Currently AKS does not allow pods to share GPUs, you can have only as many replicas of a GPU-enabled web service as there are GPUs in the cluster.

    You can find the same information here as well.

    You can refer to this article as well which might be helpful to understand the use of GPU in AKS.

    Hope it helps!!!

    Do let me know in case of any more queries.

    Please 'Accept as answer' if it helped, so that it can help others in the community looking for help on similar topics


0 additional answers

Sort by: Most helpful