Specifying the Counter Sets for Computers in a Load Test
Load tests provide named counter sets that are useful when you analyze performance counter data. The counter sets are organized by technology and include Application, ASP.NET, .NET Application, IIS, and SQL. When you create a load test by using the New Load Test Wizard, you add an initial set of counters. These offer you a set of predefined and important counter sets for your load test. You manage your counters in the Load Test Editor.
Note
If your load tests are distributed across remote machines, controller and agent counters are mapped to the controller and agent counter sets. For more information about how to use remote machines in your load test, see Distributing Load Tests Across Multiple Test Machines Using Test Controllers and Test Agents.
Counter sets are gathered on computers that you specify. The association between a counter set and a computer that is used during a load test is a counter set map. For example, the Web server that you are testing might have ASP.NET, IIS, and .NET application counter set mappings.
By default, performance counters are collected on the controller and agents. For more information, see Distributing Load Tests Across Multiple Test Machines Using Test Controllers and Test Agents.
It is important that you add the servers under test to the list of computers on which to collect counters. Then, any important system data is collected and monitored during the load test.
Load Test Counter Sets
.png "Load Test Counter Sets")
Using Counter Sets
The load test tools collect and graph performance data by using counters over time. Counter data is collected at user-specified intervals during a load test run. For more information, see How to: Specify the Sample Rate for a Load Test Run Setting. You can view the counters at run time or you can view them after a load test run by using the Load Test Analyzer. For more information, see Load Test Analyzer Overview.
Counter data is gathered on the server and on any computer where a test is run. If you have set up a set of agent computers on which to run your tests, counters are gathered on those computers also.
There are three counter categories: percentages, counts, and averages. Some examples are % CPU usage, SQL Server lock counts, and IIS requests per second.
Performance data for individual HTTP requests is reported by the computer that runs a test. such as an agent computer. For requests, you might monitor data such as Average Time to First Byte, Response Time, and Requests per Second.
To ease collection of performance data on a Web server, Visual Studio Ultimate also provides predefined, named counter sets, based on technology for use in load tests. These sets are useful when you are analyzing a server that is running IIS, ASP.NET, or SQL Server. Counters not provided in the default set of counter can be added by using the Load Test Editor. It is important that you add the computers or servers under test to your load test to make sure that you can monitor resource use on these computers. For more information, see How to: Manage Counter Sets Using the Load Test Editor.
Results analysis of load runs frequently requires domain-specific knowledge of a particular area in order to know what data to gather, where to set threshold rules, and how to tell when a measurement reflects a specific problem in the application. For more information, see About Threshold Rules in Load Tests.
Performance Counter Sampling Interval Considerations
Select an appropriate value for the Sample Rate property in the load test run settings based on the length of your load test. A smaller sample rate, such as the default value of five seconds, requires more space in the load test results database. For longer load tests, increasing the sample rate reduces the amount of data collected. For more information, see How to: Specify the Sample Rate for a Load Test Run Setting.
The following are some guidelines for sample rates.
Load test duration |
Recommended sample rate |
|---|---|
< 1 Hour |
5 seconds |
1−8 Hours |
15 seconds |
8−24 Hours |
30 seconds |
> 24 Hours |
60 seconds |
Storing Performance Data
During a load test run, the performance counter data is collected and stored in the Load Test Results Repository. For more information, see Managing Load Test Results in the Load Test Results Repository.
Tasks
Tasks |
Associated Topics |
|---|---|
Specify initial counter sets for your load test: When you create a load test, you add counter sets that you want to monitor in the New Load Test Wizard. For more information, see. How to: Create a New Load Test Using the New Load Test Wizard. |
|
Manage counter sets for your load test: After you create your load test, you can edit the Counter Set in the Load Test Editor. Managing counter sets involves choosing the set of computers from which you want to collect performance data and assigning a set of counter sets to collect from each individual computer. You manage your counters in the Load Test Editor. |
|
Add counter sets to your load test: When you create a load test with the New Load Test Wizard, you add an initial set of counters. These offer you a set of predefined counter sets for your load test. After you create a load test, you can add new counters to existing counter sets using the Load Test Editor. |
|
Specify a threshold rule using counters for your load test: A threshold rule is a rule that is set on an individual performance counter to monitor system resource usage during a load test. Counter set definitions contain predefined threshold rules for many key performance counters. Threshold rules in load tests compare a performance counter value with either a constant value or another performance counter value. |
|
Assign friendly names to the computers to which counter sets are mapped: You can add computer tags that enable you to apply an easily recognized name to a computer. The tags are displayed in the Counter Set Mappings node for the tree in the Load Test Editor. More important, the tags are displayed in Excel reports that help stakeholders identify what role the computer has in the load test, for example, "Web Server1 in lab2" or "SQL Server2 in Phoenix office". For more information, see Reporting Load Tests Results for Test Comparisons or Trend Analysis. |
Related Tasks
See Also
Tasks
Walkthrough: Creating and Running a Load Test Containing Web Performance Tests
Concepts
About Threshold Rules in Load Tests
Other Resources
Distributing Load Tests Across Multiple Test Machines Using Test Controllers and Test Agents