Why number of node increases in Kusto cluster

Tapas Kumar Barik 1

if number of nodes are suddenly increase 34 to 41 , memory also shows increase 90%. CPU utilization nearly above 25% How all of sudden number node increases in kusto cluser, how to find the reasons

PRADEEPCHEEKATLA 90,506 Reputation points

2021-03-09T05:43:39.693+00:00

Hello @Tapas Kumar Barik ,

Thanks for the ask and also for using the Microsoft Q&A forum.

We are reaching out to the internal team to get more help on this, I will update you once we hear back from them.

1 answer

PRADEEPCHEEKATLA 90,506 Reputation points

2021-03-09T12:45:47.003+00:00
Hello @Tapas Kumar Barik ,

If the number of nodes changes dynamically it means either Optimized autoscale or Custom autoscale was configured on the cluster.

By using horizontal scaling, you can scale the instance count automatically, based on predefined rules and schedules. To specify the autoscale settings for your cluster:

In the Azure portal, go to your Azure Data Explorer cluster resource. Under Settings, select Scale out.

In the Scale out window, select the autoscale method that you want: Manual scale, Optimized autoscale, or Custom autoscale.

You can find more details on the logic for scale out here - Manage cluster horizontal scaling (scale out) in Azure Data Explorer to accommodate changing demand.

Hope this helps. Do let us know if you any further queries.

------------

Please don’t forget to Accept Answer and Up-Vote wherever the information provided helps you, this can be beneficial to other community members.
Please sign in to rate this answer.
PRADEEPCHEEKATLA 90,506 Reputation points

2021-03-10T11:56:17.557+00:00

Hello @Tapas Kumar Barik ,

Just checking in to see if the above answer helped. If this answers your query, do click Accept Answer and Up-Vote for the same. And, if you have any further query do let us know.

Tapas Kumar Barik 1 Reputation point

2021-03-10T14:39:49.447+00:00

I know auto scaling features is enabled in cluster.

My queries was , how to find out why number of nodes count increases where memory utlization more than 90% and CPU somewhere near to 25%

Are there any link/docs to find parameters for increase in node count ?

Tapas Kumar Barik 1 Reputation point

2021-03-10T14:42:42.477+00:00

Can we find through Kusto query reason for increase in numbers of node count ?

PRADEEPCHEEKATLA 90,506 Reputation points

2021-03-11T04:45:47.953+00:00

Hello @Tapas Kumar Barik ,

In order to investigate further, could you please share the screenshot of the Scale out settings? If you are using Custom autoscale, please do share the rule to scale out?

For immediate assistance with cluster-scaling issues, open a support request in the Azure portal.

PRADEEPCHEEKATLA 90,506 Reputation points

2021-03-15T09:57:17.617+00:00

Hello @Tapas Kumar Barik ,

Follow up to see if you have had a chance to see the previous response. We need the following information to understand/investigate this issue further.

Tapas Kumar Barik 1 Reputation point

2021-03-15T16:00:30.347+00:00

Attached here the screenshot .

It is mentioned here in screenshot that node count increases from 34-41 b/t 24 Feb-02 Mar 21. Where memory utilization was more than 90% and CPU utlization below 50% .

Want to know why there was increase in node & spike in memory ?

PRADEEPCHEEKATLA 90,506 Reputation points

2021-03-16T05:18:02.88+00:00

Hello @Tapas Kumar Barik ,

Could you confirm the scaling type which you have selected: Optimized autoscale, or Custom autoscale?

If it is autoscale, please do share the rule configured?
Sign in to comment

Use comments to ask for clarification, additional information, or improvements to the question.

Share via

Why number of node increases in Kusto cluster

1 answer

Your answer