VMSS Predictive Autoscale and AKS

Ivan Porta 0 Reputation points
2024-04-24T04:08:12.4666667+00:00

In 2022, several companies released services to autoscale Kubernetes clusters based on predictions. For example, Dysnix released PredictKube in integration with KEDA, and Alibaba launched AHPA. In the same year, Azure Monitor announced predictive autoscale for Azure Virtual Machine Scale Sets.

Since VMSS autoscale operates externally to AKS control, I'm wondering if this is Microsoft's response to the increasing demand for a predictive scaling for Kubernetes. If so, wouldn't the VMSS predictive autoscale potentially conflict with AKS autoscale if set to automatic instead of manual? Also, if that's the case, what are Microsoft's best practices for enabling predictive scaling of AKS nodes?

AKS AutoscaleUser's image

VMSS Predictive AutoscaleUser's image

Azure Monitor
Azure Monitor
An Azure service that is used to collect, analyze, and act on telemetry data from Azure and on-premises environments.
2,811 questions
Azure Kubernetes Service (AKS)
Azure Kubernetes Service (AKS)
An Azure service that provides serverless Kubernetes, an integrated continuous integration and continuous delivery experience, and enterprise-grade security and governance.
1,868 questions
0 comments No comments
{count} votes

1 answer

Sort by: Most helpful
  1. Andriy Bilous 10,976 Reputation points MVP
    2024-04-30T20:12:04.8966667+00:00

    Hello Ivan Porta

    The predictive autoscaling in VMSS can be seen as part of proactive approach to scaling. While AKS autoscaling operates based on real-time metrics at the Kubernetes layer, VMSS predictive autoscaling anticipates future demands by analysing historical data, scaling the underlying VM instances ahead of predicted load.

    Conflict between AKS and VMSS autoscaling mechanisms arises when both are set to automatic. AKS’s automatic scaling responds to immediate resource requirements within the cluster, while VMSS predictive autoscaling acts in advance of changes in load. If not correctly aligned, these two autoscaling approaches could lead to over-provisioning.

    Azure sync'sAKS autoscaling with VMSS predictive autoscaling by combining AKS’s real-time scaling with VMSS’s predictive capabilities. for further clarification refer below documents.

    https://stackoverflow.com/questions/78375956/vmss-predictive-autoscale-and-aks

    https://learn.microsoft.com/en-us/azure/cloud-adoption-framework/scenarios/app-platform/aks/scalability#design-recommendations

    0 comments No comments