Immidiate scale out for Azure Compute Service

Question

Immidiate scale out for Azure Compute Service

Mohsen Shaverdy Nasery 1

Does anyone know which Azure compute service can scale as fast as real time to respond to large volumes of requests?

The problem is that I have bumps in my CPU/Memory metrics. I tried the automatic scaling of the web app service, it takes at least 5 minutes to add a new instance which is too late for me (so many users are not getting a proper response). I need a server that scales out instantly e.g. when a CPU is more than 70 Percent just add another instance without waiting for the CPU avg/max of the last 5 mins. I am aiming for something that works similar to Azure Serverless Functions or Serverless Cosmos DB. My web application is written in Nodejs, and it cannot be static.

Does anyone have any ideas/experience in this regard? thanks in advance.

1 answer

Your answer

Answer 1

VenkateshDodda-MSFT 25,111 Microsoft Employee Moderator

@Mohsen Shaverdy Nasery , Thanks for reaching out If you are using the custom auto scale in your app service you change the auto scale rule duration to 1 minute but setting a duration less than 5 minutes may generate transient metric spikes that leads to unexpected scaling actions. It is recommended for the best results; the duration should be set at least 5 minutes.

As mentioned in the documentation, Azure virtual machine scale sets, service fabric, cloud service and Azure web app depends on the Azure monitor auto scale. Azure Functions differs from the previous compute services because you don't need to configure any auto scale rules. Instead, Azure Functions automatically allocates compute instances when your code is running, scaling out as necessary to handle load.

VenkateshDodda-MSFT 25,111 Reputation points Microsoft Employee Moderator

2022-06-14T12:56:38.683+00:00

Autoscaling isn't an instant solution. Simply adding resources to a system or running more instances of a process doesn't guarantee that the performance of the system will improve. You need to consider multiple [application design considerations] (https://learn.microsoft.com/en-us/azure/architecture/best-practices/auto-scaling#application-design-considerations) while designing the auto scale strategy. For more information you can refer to this documentation about the best practices of using Azure monitor Auto scale

Feel free to reach back to me if you have any further questions.
Shaverdy Nasery, Mohsen 6 Reputation points

2022-09-27T16:20:51.77+00:00

Thank you very much, Venkatesh, for your reply. I have also tested my application with Kubernetes. There I was able to get instant scaling capability, but as you mentioned, my application design was not compatible with running multiple instances on different nodes/instances in the first place.

Share via

Immidiate scale out for Azure Compute Service

1 answer

Your answer