How can i fix "no Data" Information in VMInsights?

Markus Schädlich 20

Hi@All,

i use the azure Monitor agent with a Data Collection Rule. Under "Monitoring" "Insights" i found this:

Guest performance: Enabled

Processes and dependencies (Map): Enabled

Log Analytics workspace: log-wrksp-xxx

The Problem is that i get "no Data" from the Disks an the CPU Ulitization and Available Memory.

The Heartbeat from the vm to the log analytics workspace is present.

i uninstalled the monitor agent and the deattach the vm from the data collection rule but i think that is not the problem. the other monitoring data from the vms in the data collection rule are working.

is it a problem with the vm image? it is not from the azure marketplace.

are there any log files to check?

Sedat SALMAN 13,820 Reputation points

2024-03-02T07:01:21.15+00:00

here is the official troubleshooting guide for VM Insight

please check it

https://learn.microsoft.com/en-us/azure/azure-monitor/vm/vminsights-troubleshoot

and how to fix issues

https://learn.microsoft.com/en-us/azure/azure-monitor/agents/azure-monitor-agent-troubleshoot-windows-vm

and another troubleshooting guide for AMA agent

https://learn.microsoft.com/en-us/azure/azure-monitor/agents/azure-monitor-agent-troubleshoot-windows-vm
Markus Schädlich 20 Reputation points

2024-03-04T10:57:58.9533333+00:00
Hi,

thanks for the weblinks. i checked the links and i think everything is okay.

i think there was a problem with the Performance Counters of the VM:

i checked the InsightsMetrics Table in the LogAnalytics workspace with this statement and got the following result:

statement:

InsightsMetrics | where Origin == "vm.azm.ms"

Result:

In another working Log Analytics workspace, the namespaces are LogicalDisk, Memory, and Processor.

The countersets in the file "file:///C:/WindowsAzure/Resources/AMADataStore.VM-BAG-GDI/mcs/mcsconfig.lkg.xml" are okay:

do you have more ideas?

1 answer

AnuragSingh-MSFT 21,361 Reputation points

2024-03-05T09:48:35.6933333+00:00
Markus Schädlich, thank you for providing additional details.

As I understand, you have enabled VMInsights on this VM using one of the ways mentioned below or using API etc. (correct me if I am wrong)

Enable VM insights

Enable VM insights for Azure Monitor Agent

Based on the understanding above, can you please check and share the following details:

Screenshot of the view from VM --> Monitoring\Insights --> Performance tab (this is to check if the backend platform knows that the VM Insights has been enabled, in which case, it should look like something below - if data is not being collected, the graph/values might be empty):

Click on "Monitoring configuration" in the view above and ensure that you are querying the data from the correct LA workspace.

Check the msconfig.lkg.xml file for current configuration. Ensure that <CounterSets> tag has the counters listed correctly and also <TaggedData> tag with the DCR starting with "MSVMI-". Note that the DCR created for VMInsights has name starting with "MSVMI-"

On the VM from where the data needs to be collected, got to Start --> "Performance Monitor" --> click on Add button ("+" mark) and see if the counters are infact in there. There are chances that counters may not have been loaded on the machine causing issues with counter value collection.

Apart from the InsightsMetrics table, also check the perf table which also stores the perf counter values. Verify if you see similar behavior in this table as well. For more details, see Perf

The following article has extensive steps to troubleshoot scenarios that may arise in this case as pointed out earlier - Troubleshooting guidance for the Azure Monitor agent on Windows virtual machines and scale sets. Note that both "basic troubleshooting..." and "Issues collecting performance counters..." topic would apply to the current issue being investigated. Ensure that you have reviewed all the points and do share any errors/inconsistencies that you observe.

In case the steps and troubleshooting guide do not help, please file a ticket with Azure Support so that the issue can be investigated in detail from both machine as well as platform side, as required.

Hope this helps. Please let me know if you have any questions.
Please sign in to rate this answer.
Markus Schädlich 20 Reputation points

2024-03-06T07:39:07.5766667+00:00

Hi, thanks for your quick response :)

here are the screenshots:

1)

2)

3.) msconfig.lkg.xml:

yes. both of the needed values are present:

<CounterSets>

<CounterSet storeType="Local" duration="PT1M" eventName="c14193584549478375105_13495363288332591227" sampleRateInSeconds="60" format="Factored">

<Counter>\System\System Up Time</Counter>

<Counter>\Memory\Available MBytes</Counter>

<Counter>\Processor(_Total)% Processor Time</Counter>

<Counter>\LogicalDisk(*)\Free Megabytes</Counter>

<Counter>\LogicalDisk(*)% Free Space</Counter>

<Counter>\LogicalDisk(*)\Avg. Disk sec/Read</Counter>

<Counter>\LogicalDisk(*)\Avg. Disk sec/Transfer</Counter>

<Counter>\LogicalDisk(*)\Avg. Disk sec/Write</Counter>

<Counter>\LogicalDisk(*)\Disk Bytes/sec</Counter>

<Counter>\LogicalDisk(*)\Disk Read Bytes/sec</Counter>

<Counter>\LogicalDisk(*)\Disk Reads/sec</Counter>

<Counter>\LogicalDisk(*)\Disk Write Bytes/sec</Counter>

<Counter>\LogicalDisk(*)\Disk Writes/sec</Counter>

<Counter>\LogicalDisk(*)\Disk Transfers/sec</Counter>

<Counter>\Network Adapter(*)\Bytes Received/sec</Counter>

<Counter>\Network Adapter(*)\Bytes Sent/sec</Counter>

</CounterSet>

</CounterSets>

</Events>

<EventStreamingAnnotations>

<EventStreamingAnnotation name="^c14193584549478375105_13495363288332591227$">

<OMS>

<Content>

<![CDATA[ <Config channelProtocol="ods" workspaceName="aba2199b-e284-48f4-9b43-001d5825a0e3" workspaceId="aba2199b-e284-48f4-9b43-001d5825a0e3" solutionType="VMInsights" logType="INSIGHTS_METRICS_BLOB" globallyUniqueChannelId="dcr-dfdfb229c0564f4b950b87602a4a4d22.ods-aba2199b-e284-48f4-9b43-001d5825a0e3" endpoint="aba2199b-e284-48f4-9b43-001d5825a0e3.ods.opinsights.azure.com" tokenBased="true" /> ]]>

</Content>

</OMS>

</EventStreamingAnnotation>

<EventStreamingAnnotation name="^c14193584549478375105_5141049406938982864_925466384081832117$">

<OMS>

<Content>

<![CDATA[ <Config channelProtocol="ods" workspaceName="aba2199b-e284-48f4-9b43-001d5825a0e3" workspaceId="aba2199b-e284-48f4-9b43-001d5825a0e3" solutionType="ApplicationDependencyMonitor" logType="DEPENDENCY_MONITOR_BLOB" globallyUniqueChannelId="dcr-dfdfb229c0564f4b950b87602a4a4d22.ods-aba2199b-e284-48f4-9b43-001d5825a0e3" endpoint="aba2199b-e284-48f4-9b43-001d5825a0e3.ods.opinsights.azure.com" sourceExtension="DependencyAgent" tokenBased="true" /> ]]>

</Content>

</OMS>

</EventStreamingAnnotation>

<EventStreamingAnnotation name="^c14193584549478375105_hb$">

<OMS>

<Content>

<![CDATA[ <Config channelProtocol="ods" workspaceName="aba2199b-e284-48f4-9b43-001d5825a0e3" workspaceId="aba2199b-e284-48f4-9b43-001d5825a0e3" solutionType="LogManagement" logType="HEALTH_ASSESSMENT_BLOB" globallyUniqueChannelId="dcr-dfdfb229c0564f4b950b87602a4a4d22.ods-aba2199b-e284-48f4-9b43-001d5825a0e3" endpoint="aba2199b-e284-48f4-9b43-001d5825a0e3.ods.opinsights.azure.com" tokenBased="true" /> ]]>

</Content>

</OMS>

</EventStreamingAnnotation>

</EventStreamingAnnotations>

<TaggedData name="DependencyAgent">

<Data>

<![CDATA[ { "version":"2.0.0", "extensionName":"DependencyAgent", "extensionConfigurations": [ {"id":"dcr-dfdfb229c0564f4b950b87602a4a4d22:DependencyAgentDataSource","originIds":["/subscriptions/23d8ce59-9aa5-4ab4-aa1f-22e2aa7318be/resourceGroups/rg-bag-monitoring/providers/Microsoft.Insights/dataCollectionRules/MSVMI-log-collectionrule-bag-vm-vm-bag-gdi"],"extensionSettings":{},"outputStreams":{"DEPENDENCY_MONITOR_BLOB":"dcr-dfdfb229c0564f4b950b87602a4a4d22:DependencyAgentDataSource:DEPENDENCY_MONITOR_BLOB"}} ], "outputStreamDefinitions": { "dcr-dfdfb229c0564f4b950b87602a4a4d22:DependencyAgentDataSource:DEPENDENCY_MONITOR_BLOB": { "namedPipe": "CAgentStream_DependencyAgent_c14193584549478375105_5141049406938982864_AzureMonitorAgent"} } } ]]>

</Data>

</TaggedData>

</MonitoringManagement>

4.) i think the counters are present (Processor Time):

5.) when i check the perf table with the following command i got "no result". But i think there should be the performance counters from the other working machines present?

Perf | where ObjectName == "Processor" and CounterName == "% Processor Time" and InstanceName == "_Total" | summarize AVGCPU = avg(CounterValue) by Computer

AnuragSingh-MSFT 21,361 Reputation points

2024-03-11T05:16:00.5233333+00:00

Markus Schädlich, thank you very much for the detailed information. Things look fine so far based on the configuration downloaded to the machine. Based on the nature of the issue, I would suggest reaching out to Azure Support so that this issue can be investigated 1:1 by one of our support engineers and logs can be reviewed from the machine as well as the backend platform, as required.

Please let me know if you have any questions.
Sign in to comment

Use comments to ask for clarification, additional information, or improvements to the question.

Your answer