Basic Test Results
Running a test produces a result and displays it in the Test Results window. Some test results are common to every test type. Other results occur only for specific test types, or have specific meanings depending on the type of test that produced them.
Running tests also produces more in-depth results than the simple ones listed here. For more information, see Test Results Reported.
Test Results
These are the test results produced by the test types that are available in Team Edition for Testers:
Aborted. The tester stopped the test run. The test that was running at the time obtains the Aborted status. The rest of the tests in the test run obtain the status of Not Executed.
Not Executed. The tester stopped the test run. The test that was running at the time obtains the Aborted status. The rest of the tests in the test run obtain the status of Not Executed.
PassedButRunAborted. The individual test ran and passed. After the execution of that test completed, the tester stopped the test run.
NotRunnable. The test could not be run because of errors in the test definition. For example, a unit test is NotRunnable if it returns an integer; unit test methods must return void.
Disconnected. This is a remote run that you disconnect and then later connect. It reports this outcome when the remote run is disconnected. When the tester connects to that remote run, the tester can see the outcome of the tests.
Timeout. The test or the test run timed out.
Pending. The test run has started and is in progress, but execution of the individual test has not completed.
In Progress. The test is currently running.
Completed. The test run has completed; this result applies only to load tests.
Inconclusive. When the test ran, no Assert statement produced a Failed result, but at least one Assert.Inconclusive statement was satisfied. This result applies only to unit tests.
Failed. The exact meaning depends on the test type:
Test Type |
Meaning |
unit |
When the test ran, at least one Assert statement produced a result of Failed, or the test threw an unexpected exception. |
generic |
The test returned a value other than 0. |
manual |
The tester set the result to Fail. |
Web |
At least one of the requests was unsuccessful. |
load |
At least one of the contained tests failed. |
ordered |
At least one of the contained tests failed. |
- Passed. The exact meaning depends on the test type:
Test Type |
Meaning |
unit |
When the test ran, no Assert statements produced a result of Inconclusive or Failed, and the test did not throw an unexpected exception, and the test did not time out. |
generic |
The test returned a value of 0, and the test did not time out. |
manual |
The tester set the result to Pass, and the test run that contains this test did not time out. |
Web |
All the requests were successful, and the test did not time out. |
load |
All the contained tests passed. |
ordered |
All the contained tests passed, and the test did not time out. |
See Also
Tasks
How to: Adjust Test Results Views
Concepts
Test Results Reported
Using the Assert Classes