Aks A node cannot be automatically allocated

Yongchao Liu (Neusoft America Inc) 186 Microsoft Vendor

I have a total of 16 Gpus pods deployed, each pod occupies a node, but I don't know why one node can't deploy pod, I have to add a redundant node.

If someone can give us some guidance.
Thanks

srbhatta-MSFT 8,551 Reputation points Microsoft Employee

2022-07-11T08:47:28.087+00:00

Hello @Yongchao Liu (Neusoft America Inc) ,
Thanks for posting your query on Microsoft QnA. Apologies for the delay in response.
May I know what is the error you are getting when you are scheduling a pod on this node?
Yongchao Liu (Neusoft America Inc) 186 Reputation points Microsoft Vendor

2022-07-11T08:54:42.227+00:00

No error found, this pod occupies a node, if I expand 17 to 16 and show that the pod occupies none nodes, it is simply insufficient gpu resources.
We're really going to scale from 8 nodes to 9 nodes, and then delete to see if we can fix this. But this leads to a bit of a risk in pod reallocation
srbhatta-MSFT 8,551 Reputation points Microsoft Employee

2022-07-11T09:14:17.663+00:00

I am sorry but I failed to understand by what you meant by - "if I expand 17 to 16 and show that the pod occupies none nodes, it is simply insufficient gpu resources." Could you please help me understand what you mean by this above line ?
Yongchao Liu (Neusoft America Inc) 186 Reputation points Microsoft Vendor

2022-07-12T02:39:37.213+00:00

like this,a pod cannot be allocated to wus1 05.

thanks

1 answer