HPC Pack 2019 AutoGrowShrink Parameters

Question

Hi,
our environment consists of about 30 on-prem compute nodes and about 30 ready set up (unapproved) Azure IaaS Nodes.
Those Azure nodes can easily be started by right-clicking on the resource -> Start and they start their work immediately.
All Azure nodes have 5 subscribed sockets and 10 cores. All jobs are submitted on socket basis.
But to automize it a bit, I'm struggling with the AutoGrowShrink parameters: shrinking is working, but not growing.
My current parameterization is:
PS C:\Users... [06/30/2022 08:38:17]> Get-HpcClusterProperty -scheduler:lsas... -autogrowshrink

Name Value
---- -----
EnableGrowShrink True
TasksPerResourceUnit 5
GrowThreshold 50
GrowInterval 2
GrowOnlyFullySatisfied False
IdleNodePool 0
GrowTimeout 10
ShrinkInterval 3
ShrinkIdleTimes 3
ExtraNodesGrowRatio 0
GrowByMin False
SoaJobGrowThreshold 50000
SoaRequestsPerCore 20000
SoaJobTimeToComplete 0
ExcludeNodeGroups GPUNodes

I understood to be able to auto grow one node at a time, if 50 tasks at minimum are in queued state along 20 minutes.
as said, somehow either misunderstanding or misconfiguration or bug :)...

Answer 1

Hello @Sven ,

Thank you for reaching out to the Microsoft Q&A platform. Happy to answer your question.

HPC auto grow shrink cannot auto add compute nodes to cluster, you need add the nodes to your HPC IaaS cluster first, then if you enable auto grow shrink, it can stop the nodes when no job, and start the nodes when new job is coming.

An explicit note added in the document about the workflow of autogrowshrink in HPC here hpcpack-auto-grow-shrink

Hope this helps!
--please don't forget to upvote and accept as answer if the reply is helpful--