Troubleshoot performance issues on Azure virtual machines using Performance Diagnostics

Cikk
06/18/2024

Use the Performance Diagnostics tool to identify and troubleshoot performance issues on your Azure virtual machine (VM) in one of two modes:

Continuous diagnostics (preview) collects data at five-second intervals and reports actionable insights about high resource usage every five minutes.
On-demand diagnostics helps you troubleshoot an ongoing performance issue with more in-depth data, insights, and recommendations based on data collected at a single point in time.

Performance Diagnostics stores all insights and reports in a storage account, which you can configure for short data retention to minimize costs.

Run Performance Diagnostics directly from the Azure portal, where you can also review insights and a report on various logs, rich configuration, and diagnostics data. We recommend that you run Performance Diagnostics and review the insights and diagnostics data before you contact Microsoft Support.

This article explains how to use Performance Diagnostics and what the continuous and on-demand modes offer.

Note

Continuous diagnostics (preview) is being rolled out gradually and is currently supported only on Windows. If the preview feature is available for your machines, you'll see the option to enable both on-demand and continuous diagnostics, as described in Install and run Performance Diagnostics on your VM.

Prerequisites

To run continuous and on-demand diagnostics on Windows, you need .NET SDK version 4.5 or a later.

Note

To run Performance Diagnostics on classic VMs, see Azure Performance Diagnostics VM extension.

Permissions required

Action	Permissions required
View Performance Diagnostics insights and reports	`Microsoft.Storage/storageAccounts/listKeys/action` permissions to the storage account, as provided by the built-in Storage Account Contributor role, for example.

Supported operating systems

Windows

The following operating systems are currently supported for both on-demand and continuous diagnostics:

Windows Server 2022
Windows Server 2019
Windows Server 2016
Windows Server 2012 R2
Windows Server 2012
Windows 11
Windows 10

Linux

Note

CentOS referenced in this article is a Linux distribution and will reach End Of Life (EOL). Consider your use and plan accordingly. For more information, see CentOS End Of Life guidance.

The following distributions are currently supported for on-demand diagnostics:

Note

Microsoft has only tested the versions that are listed in the table. If a version isn't listed in the table, then it isn't explicitly tested by Microsoft, but the version might still work.

Distribution	Version
Oracle Linux Server	6.10 [`*`], 7.3, 7.5, 7.6, 7.7, 7.8, 7.9
CentOS	6.5 [`*`], 7.6, 7.7, 7.8, 7.9
RHEL	7.2, 7.5, 8.0 [`*`], 8.1, 8.2, 8.6, 8.8
Ubuntu	14.04, 16.04, 18.04, 20.04, 22.04
Debian	8, 9, 10, 11 [`*`]
SLES	12 SP4 [``], 12 SP5 [``], 15 [``], 15 SP1 [``], 15 SP2 [``], 15 SP4 [``]
AlmaLinux	8.4, 8.5
Azure Linux	2.0

Note

[*] See Known issues

Install and run Performance Diagnostics on your VM

Performance Diagnostics installs a VM extension that runs a diagnostics tool, called PerfInsights. PerfInsights is available for both Windows and Linux.

To install and run Performance Diagnostics:

In the Azure portal, select Virtual machines.
From the list of VM names, select the VM that you want to run diagnostics on.
In the Help section, select Performance Diagnostics.
Select Enable Performance Diagnostics

Select the options to install and run for the tool.

This table describes the available options:

Option	Description
Enable continuous diagnostics	Get continuous, actionable insights into high resource usage with data collected every 5 seconds and updates uploaded every 5 minutes to address performance issues promptly. Store insights in your preferred storage account. The storage account retains insights based on the account retention policies, which you can configure to manage the data lifecycle effectively. You can disable continuous diagnostics at any time.
Run on-demand diagnostics	Get on-demand, actionable insights into high resource usage and various system configurations. Receive a downloadable report with comprehensive diagnostics data to address performance issues. Store insights and reports in your preferred storage account. The storage account retains insights based on the account retention policies, which you can configure to manage the data lifecycle effectively. You can initiate on-demand diagnostics at any time using the specific analysis type you need: Performance analysis Includes all checks in the Quick analysis scenario, and monitors high resource consumption. Use this version to troubleshoot general performance issues, such as high CPU, memory, and disk usage. This analysis takes 30 seconds to 15 minutes, depending on the selected duration. Learn more Windows or Linux Quick analysis Checks for known issues, analyzes best practices, and collects diagnostics data. This analysis takes several minutes to run. Learn more Windows or Linux Advanced performance analysis [``] Includes all checks in the Performance analysis* scenario, and collects one or more of the traces, as listed in the following sections. Use this scenario to troubleshoot complex issues that require more traces. Running this scenario for longer periods increases the overall size of diagnostics output, depending on the size of the VM and the trace options that are selected. This analysis takes 30 seconds to 15 minutes to run, depending on the selected duration. Learn more Azure file analysis [``] Includes all checks in the Performance analysis* scenario, and captures a network trace and SMB counters. Use this scenario to troubleshoot the performance of Azure files. This analysis takes 30 seconds to 15 minutes to run, depending on the selected duration. Learn more
Storage account	Optionally, if you want to use a single storage account to store the Performance Diagnostics results for multiple VMs, you can select a storage account from the dropdown. If you don't specify a storage account, Performance Diagnostics uses the default diagnostics storage account or creates a new storage account.

Note

[*] These analysis scenarios are only supported on Windows.

Review the legal terms and privacy policy, and select the corresponding checkbox to acknowledge (required).

To install and run Performance Diagnostics, you must agree to the legal terms and accept the privacy policy.
Select Apply to apply the selected options and install the tool.

A notification is displayed as Performance Diagnostics starts to install. After the installation is completed, you see a notification that indicates that the installation is successful. If the Run on-demand diagnostics option is selected, the selected performance analysis scenario is then run for the specified duration.

View insights and reports

This table compares the data provided by Continuous and On-demand Performance Diagnostics. For a complete list of all the collected diagnostics data, see What kind of information is collected by PerfInsights? on Windows or Linux.

	Continuous Performance Diagnostics	On-demand Performance Diagnostics
Availability	Currently supported only for Windows VMs	Supported for both Windows and Linux VMs
Insights generated	Continuous actionable insights into high resource usage, such as high CPU, high memory, and high disk usage	On-demand actionable insights into high resource usage and various system configurations
Data collection frequency	Collects data every 5 seconds, updates uploaded every 5 minutes	Collect data on demand for the selected duration of the on-demand run
Reports generated	Doesn't generate a report	Generates a report with comprehensive diagnostics data

View Performance Diagnostics insights

The Performance Diagnostics insights tab lists insights for the selected time period. Each row presents an insight, its impact level, category, and related recommendations. Select Refresh to view newly generated continuous diagnostics insights.

Use filters to retrieve insights by timestamp, impact, category, or diagnostic type.

Select a row to view more details.

View or download the Performance Diagnostics report for an on-demand insight in the list by selecting View or Download, respectively. For more information, see Download and review the full Performance Diagnostics report.

Use the grouping dropdown to group or ungroup insights. You can group on-demand and continuous insights by category, insight, or recommendation.

View Performance Diagnostics reports

The Performance Diagnostics reports tab list all of the on-demand diagnostics reports that were run. The list indicates the type of analysis that was run, insights that were found, and their impact levels.

Select a row to view more details.

Each Performance Diagnostics report might contain several insights, and each insight includes recommendations.

The Impact column indicates an impact level of High, Medium, or Low, which shows the potential for performance issues, based on factors such as misconfiguration, known problems, or issues that are reported by other users. You might not yet be experiencing one or more of the listed issues. For example, you might have SQL log files and database files on the same data disk. This condition has a high potential for bottlenecks and other performance issues if the database usage is high, whereas you might not notice an issue if the usage is low.

Select the Download report button to download an HTML report that contains richer diagnostics information, such as storage and network configuration, performance counters, traces, list of processes, and logs. The content depends on the selected analysis. For advanced troubleshooting, the report might contain additional information and interactive charts related to high CPU usage, high disk usage, and processes that consume excessive memory. For more information about the Performance Diagnostics report, see Windows or Linux.

Note

You can download Performance Diagnostics reports from the Performance Diagnostics screen within 30 days after you generate them. After 30 days, you might get an error when you download a report from the Performance Diagnostics screen. To get a report after 30 days, go to the storage account and download it from a binary large object (BLOB) container that's named azdiagextnresults. You can view the storage account information by using the Settings button on the toolbar.

View and manage storage account and stored data

Performance Diagnostics stores all insights and reports in a storage account, which you can configure for short data retention to minimize costs.

You can use the same storage account for multiple VMs that use Performance Diagnostics. When you change the storage account, the old reports and insights aren't deleted. However, they'll no longer be displayed in the list of diagnostics reports.

Note

Performance Diagnostics stores insights in Azure tables and stores reports in a binary large object (BLOB) container.

If your storage account uses private endpoints, to make sure that Performance Diagnostics can store insights and reports in the storage account:

Create separate private endpoints for Table and BLOB.
Add DNS configuration to each separate private endpoint.

View diagnostics data stored in your account

To view these files:

Navigate to your storage account.
Select Storage browser.

Performance Diagnostics stores reports in a binary large object (BLOB) container, named azdiagextnresults, and insights in tables.

Insights include:
- All the insights and related information about the run.
- An output compressed (.zip) file (named PerformanceDiagnostics_yyyy-MM-dd_hh-mm-ss-fff.zip) on Windows and a tar file (named PerformanceDiagnostics_yyyy-MM-dd_hh-mm-ss-fff.tar.gz) on Linux that contains log files.
- An HTML report.
To download a report, select Blob containers > azdiagextnresults > <report name> > Download.

Change storage accounts

To change storage accounts:

Select the Settings toolbar button to change the storage account where the diagnostics insights and output are stored.

This opens the Performance diagnostic settings screen.
Select Change storage account to select a different storage account.

Uninstall Performance Diagnostics

Uninstalling Performance Diagnostics from a VM removes the VM extension but doesn't affect any diagnostics data in the storage account.

To uninstall Performance Diagnostics, select the Uninstall button on the toolbar.

Frequently asked questions

When you open a support ticket with Microsoft, it's important to share the Performance Diagnostics report from an on-demand Performance Diagnostics run. The Microsoft CSS contact will provide you with the option to upload the on-demand Performance Diagnostics report to a workspace. There are two ways to download the on-demand Performance Diagnostics report to share with Microsoft CSS:

Option 1: Download the report from Performance Diagnostics blade, as described in View Performance Diagnostics reports.

Option 2: Download the report from the storage account, as described in View and manage storage account and stored data.

How do I capture diagnostics data at the correct time?

We recommend you run Continuous Performance Diagnostics, which captures VM diagnostics data on an ongoing basis.

The On-demand Performance Diagnostics run has two stages:

Install or update the Performance Diagnostics VM extension.
Run the diagnostics for the specified duration.

Currently, there's no easy way to know exactly when the VM extension installation is complete. It takes about 45 seconds to 1 minute to install the VM extension. After the VM extension is installed, you can run your repro steps to have the On-deman Performance Diagnostics capture the correct set of data for troubleshooting.

Will Performance Diagnostics continue to work when I move my Azure VM across regions?

Azure VMs, and related network and storage resources, can be moved across regions by using Azure Resource Mover. However, moving VM extensions across regions, including the Azure Performance Diagnostics VM extension, isn't supported. You have to install the extension manually on the VM in the target region after you move the VM. For more information, see Support matrix for moving Azure VMs between Azure regions.

What is the performance impact of enabling Continuous Performance Diagnostics?

We ran 12-hour tests of Continuous Performance Diagnostics on a range of Windows OS versions, Azure VMs of sizes, and CPU loads.

The test results, presented in this table, show that Continuous Performance Diagnostics provides valuable insights with minimal impact on system resources:

OS version	VM size	CPU load	Avgerage CPU usage	90 percentile CPU usage	99 percentile CPU usage	Memory usage
Windows Server 2019	B2s, A4V2, D5v2	20%, 50%, 80%	<0.5%	2%	3%	42-43 MB
Windows Server 2016 SQL	B2s, A4V2, D5v2	20%, 50%, 80%	<0.5%	2%	3%	42-43 MB
Windows Server 2019	B2s, A4V2, D5v2	20%, 50%, 80%	<0.5%	2%	3%	42-43 MB
Windows Server 2022	B2s, A4V2, D5v2	20%, 50%, 80%	<0.5%	<0.5%	3%	42-43 MB

Back of the napkin calculations of storage costs

Continuous Performance Diagnostics stores insights in a table and a JSON file in a blob container. Given that each row is approximately 0.5 KB (kilobyte) and the report is approximately 9 KB before compression, two rows every five minutes plus the corresponding report upload comes out to 10 KB, or 0.00001 GB.

Now, let’s calculate the storage cost:

Rows per month: 17,280
Size per row: 0.00001 GB

Total data size: 17,280 x 0.000001 = 0.1728 GB

Data storage cost: $0.1728 x $0.045 = $0.007776

Therefore, assuming steady stress on the VM, the storage cost is estimated to be less than one cent per month, assuming you use locally redundant storage.

Contact us for help

If you have questions or need help, create a support request, or ask Azure community support. You can also submit product feedback to Azure feedback community.

Megosztás a következőn keresztül:

Troubleshoot performance issues on Azure virtual machines using Performance Diagnostics

Prerequisites

Permissions required