Hello R, Nanda Kumar
Welcome to Microsoft Q&A Platform, thanks for posting your query here.
You are correct that Azure Diagnostic agent extension is unsupported on RHEL8.
However, you can use the Azure Monitor agent to collect memory metrics for RHEL8 VMs. You can then use these metrics to create autoscale rules for your VMSS. To collect memory metrics using the Azure Monitor agent, you need to install the agent on your VMs and configure it to collect the required metrics. You can then use these metrics to create autoscale rules for your VMSS.
Once you have collected the memory metrics, you can create autoscale rules based on these metrics. You can use the Azure portal, Azure PowerShell, Azure CLI, or Azure templates to create autoscale rules.
Alternatively, you can use Telegraf agent for collecting metrics and sending them to Azure Monitor. Once you have configured Telegraf on your RHEL8 VMs, you can use Azure Monitor to collect, analyze, and act on these metrics.
To configure VMSS scaling operations based on memory usage, you can create a custom Azure Monitor alert rule that triggers when the memory usage percentage exceeds a certain threshold. This alert can then trigger an Azure Automation runbook that adds or removes instances from the VMSS as required.
Hope that helps.