Test Rig Requirements for Team System
Several test types including unit, Web, load, and manual tests, as well as the measurement of code coverage, are integrated into Visual Studio. Visual Studio Team System Test Edition enables Visual Studio Team System users to run tests on remote computers, called rigs. A test rig consists of a test controller and one or more agents.
Hardware and Software Requirements
Test Edition rigs have specific hardware and software requirements. When you plan to deploy test rigs, it is important to understand requirements specific to your business needs.
The test controller and agent can be installed on one computer or on two different computers. One test controller can coordinate the execution of several test runs on computers that have the test agent installed. Both the test controller and test agent computers have specific hardware and software requirements. In addition, if you want to deploy a test rig across multiple languages, you must plan how to support those languages.
Hardware Requirements
The following table shows the recommended hardware requirements for deploying Test Edition test rigs.
Configuration |
Component |
CPU |
HD |
Memory |
|---|---|---|---|---|
< 1000 virtual users |
Test agent |
2.6 GHz |
10 GB |
2 GB |
< 2000 virtual users |
Test agent |
Dual proc 2.6 GHz |
10 GB |
2 GB |
N x 2000 virtual users |
Test agent |
Scale out to N agents each with Dual 2.6 Ghz |
10GB |
2GB |
< 30 computers in the test environment. This includes agents and servers under test. |
Test Controller |
2.6 GHz |
|
|
N x 30 computers in the test environment. This includes agents and servers under test. |
Test Controller |
N 2.6 GHz processors |
|
|
Note
The number of virtual users will vary widely from test to test. A key cause of this variance is variance in think times, or user delays, in the scripts. In a load test, Web tests are generally more efficient and generate more load than unit tests. The numbers in the preceding table are valid for running Web tests with 3-5 second think times on a typical Web application.
The guidelines presented here are provided as general guidance for hardware planning. Test performance will vary greatly based on the amount of test data and the number of test agents. For test agents, the CPU speed and memory available will limit the test load. Test controllers need greater resources, depending on the number of test agents and the amount of data involved in the tests.
The server that is running Test Edition should have a reliable network connection with a minimum bandwidth of 1 Mbps and a latency maximum of 350ms. There should be no firewall between the test agents and the test controller. If your test performance does not meet your expectations, consider upgrading your hardware configuration.
Additional Hardware Considerations
Test rigs generate a large amount of data on the test controllers, depending on the duration of the test and the size of the test. Generally, you should plan for an additional 10 GB of hard disk storage for every 24 hours of test data.
In addition to the hardware recommended here, you should consider additional hardware for critical servers, such as redundant power supplies and redundant fans.
Software Requirements
The following table shows the required software for test agents.
Software |
Version |
|---|---|
Windows Server 2003 with Service Pack 1 (SP1), Windows XP Professional with Service Pack 2, or Windows 2000 with Service Pack 4 |
All editions and versions |
SQL Server 2005 Express Edition |
2005 |
.NET Framework |
2.0 |
The following table shows the required software for test controllers.
Software |
Version |
|---|---|
Windows Server 2003 with Service Pack 1 (SP1) |
All editions and versions |
SQL Server 2005 Express Edition |
2005 |
.NET Framework |
2.0 |
In addition to the required software listed here, you should consider whether you want to install additional management or security software, such as backup software or firewalls.
Using a Test Rig with the Team System Testing Tools
The product version of the controller and agent, which you obtain by installing Visual Studio Team System Test Load Agent, must match the product version of Visual Studio Team System Test Edition that you have installed. The following table describes the compatibility requirements:
To run this version of the rig |
You need this version of the testing tools |
|---|---|
Test Load Agent for Visual Studio 2005 Team Edition for Testers |
Visual Studio 2005 Team Edition for Testers |
Visual Studio Team System 2008 Test Load Agent |
Microsoft Visual Studio Team System 2008 Test Edition |
Language Requirements
To avoid confusion and simplify operation, a test rig should be configured to use the same language as the computer's operating system and that of Team Foundation Server. If the test agent and test controller are installed on different computers, they must be configured to use the same language. You can, however, install another language version of Test Edition on an English-language operating system, as long as that language matches that of the Team Foundation Server deployment.
See Also
Concepts
Team Foundation Server Requirements
Team Build Requirements for Team Foundation
Clients for Team Foundation Server