Unit testing native code with Test Explorer

Articolo
12/08/2014

In Visual Studio, you can create unit tests for unmanaged code written in C++. Unmanaged code is sometimes referred to as native code.

The following procedure contains the essential information that will get you started. The later sections provide a walkthrough that describes the steps in more detail.

To write unit tests for an unmanaged code DLL

Use the Native Test Project template to create a separate Visual Studio project for your tests.

The project contains some sample test code.
Make the DLL accessible to the test project:
- #include a .h file that contains declarations of the DLL’s externally-accessible functions.
  
  The .h file should contain function declarations marked with _declspec(dllimport). Alternatively, you can export the methods using a DEF file. For more information, see Importing and Exporting.
  
  Your unit tests can access only functions that are exported from the DLL under test.
- Add the DLL project to the References of the test project:
  
  In the Properties of the test project, expand Common Properties, Framework and References, and choose Add Reference.
In the test project, create test classes and test methods by using the TEST macros and Assert class in the following way:
```
#include "stdafx.h"
#include <CppUnitTest.h>
#include "..\MyProjectUnderTest\MyCodeUnderTest.h"
using namespace Microsoft::VisualStudio::CppUnitTestFramework;
TEST_CLASS(TestClassName)
{
public:
  TEST_METHOD(TestMethodName)
  {
    // Run a function under test here.
    Assert::AreEqual(expectedValue, actualValue, L"message", LINE_INFO());
  }
}
```
- Assert contains several static functions that you can use to verify the result of a test.
- The LINE_INFO() parameter is optional. In cases where there is no PDB file, it allows the test runner to identify the location of a failure.
- You can also write test setup and cleanup methods. For more information, open the definition of the TEST_METHOD macro, and read the comments in CppUnitTest.h
- You cannot nest test classes.
Use Test Explorer to run the tests:
1. On the View menu, choose Other Windows, Test Explorer.
2. Build the Visual Studio solution.
3. In Test Explorer, choose Run All.
4. To investigate any test in more detail in Test Explorer:
  1. Select the test name to see more details such as a failure message and stack trace.
  2. Open the test name (for example by double-clicking) to go to the failure location or to the test code.
  3. On the shortcut menu for a test, choose Debug Selected Test to run the test in the debugger.

Walkthrough: Developing an unmanaged DLL with Test Explorer

You can adapt this walkthrough to develop your own DLL. The principal steps are as follows:

Create a Native Test Project. The tests are created in a separate project from the DLL that you are developing.
Create a DLL Project. This walkthrough creates a new DLL, but the procedure for testing an existing DLL is similar.
Make the DLL functions visible to the tests.
Iteratively augment the tests. We recommend a "red-green-refactor" cycle, in which development of the code is led by the tests.
Debug failing tests. You can run tests in debug mode.
Refactor while keeping the tests unchanged. Refactoring means improving the structure of the code without changing its external behavior. You can do it to improve the performance, extensibility, or readability of the code. Because the intention is not to change the behavior, you do not change the tests while making a refactoring change to the code. The tests help make sure that you do not introduce bugs while you are refactoring. You can therefore make such changes with much more confidence than if you did not have the tests.
Check coverage. Unit tests are more useful when they exercise more of your code. You can discover which parts of your code have been used by the tests.
Isolate units from external resources. Typically, a DLL is dependent on other components of the system that you are developing, such as other DLLs, databases, or remote subsystems. It is useful to test each unit in isolation from its dependencies. External components can make tests run slowly. During development, the other components might not be complete.

Create a native unit test project

On the File menu, choose New, Project.

In the dialog box, expand Installed, Templates, Visual C++, Test.

Choose the Native Test Project template.

In this walkthrough, the test project is named NativeRooterTest.
In the new project, inspect unittest1.cpp

Notice that:
- Each test is defined by using TEST_METHOD(YourTestName){...}.
  
  You do not have to write a conventional function signature. The signature is created by the macro TEST_METHOD. The macro generates an instance function that returns void. It also generates a static function that returns information about the test method. This information allows the test explorer to find the method.
- Test methods are grouped into classes by using TEST_CLASS(YourClassName){...}.
  
  When the tests are run, an instance of each test class is created. The test methods are called in an unspecified order. You can define special methods that are invoked before and after each module, class, or method. For more information, see Organizing C++ Tests.
Verify that the tests run in Test Explorer:
1. Insert some test code:
```
TEST_METHOD(TestMethod1)
{
Assert::AreEqual(1,1);
}
```
  Notice that the Assert class provides several static methods that you can use to verify results in test methods.
2. On the Test menu, choose Run , All Tests.
  
  The test builds and runs.
  
  Test Explorer appears.
  
  The test appears under Passed Tests.

Create an Unmanaged DLL project

Create a Visual C++ project by using the Win32 Project template.

In this walkthrough, the project is named RootFinder.
Select DLL and Export Symbols in the Win32 Application Wizard.

The Export Symbols option generates a convenient macro that you can use to declare exported methods.
Declare an exported function in the principal .h file:

The declarator __declspec(dllexport) causes the public and protected members of the class to be visible outside the DLL. For more information, see Using dllimport and dllexport in C++ Classes.

In the principal .cpp file, add a minimal body for the function:

// Find the square root of a number.
double CRootFinder::SquareRoot(double v)
{
  return 0.0;
}

Couple the test project to the DLL project

Add the DLL project to the project references of the test project:
1. Open the properties of the test project and choose Common Properties, Framework and References.
2. Choose Add New Reference.
  
  In the Add Reference dialog box, select the DLL project and choose Add.
In the principal unit test .cpp file, include the .h file of the DLL code:
```
#include "..\RootFinder\RootFinder.h"
```

Add a basic test that uses the exported function:

TEST_METHOD(BasicTest)
{
CRootFinder rooter;
Assert::AreEqual(
// Expected value:
0.0, 
// Actual value:
rooter.SquareRoot(0.0), 
// Tolerance:
0.01,
// Message:
L"Basic test failed",
// Line number - used if there is no PDB file:
LINE_INFO());
}

Build the solution.

The new test appears in Test Explorer.
In Test Explorer, choose Run All.

You have set up the test and the code projects, and verified that you can run tests that run functions in the code project. Now you can begin to write real tests and code.

Iteratively augment the tests and make them pass

Add a new test:
```
TEST_METHOD(RangeTest)
{
  CRootFinder rooter;
  for (double v = 1e-6; v < 1e6; v = v * 3.2)
  {
    double actual = rooter.SquareRoot(v*v);
    Assert::AreEqual(v, actual, v/1000);
  }
}
```
Tip

We recommend that you do not change tests that have passed. Instead, add a new test, update the code so that the test passes, and then add another test, and so on.

When your users change their requirements, disable the tests that are no longer correct. Write new tests and make them work one at a time, in the same incremental manner.
Build the solution, and then in Test Explorer, choose Run All.

The new test fails.

Tip

Verify that each test fails immediately after you have written it. This helps you avoid the easy mistake of writing a test that never fails.

Enhance the code under test so that the new test passes:

#include <math.h>
...
double CRootFinder::SquareRoot(double v)
{
  double result = v;
  double diff = v;
  while (diff > result/1000)
  {
    double oldResult = result;
    result = result - (result*result - v)/(2*result);
    diff = abs (oldResult - result);
  }
  return result;
}

Build the solution and then in Test Explorer, choose Run All.

Both tests pass.

Tip

Develop code by adding tests one at a time. Make sure that all the tests pass after each iteration.

Debug a failing test

Add another test:

#include <stdexcept>
...
// Verify that negative inputs throw an exception.
TEST_METHOD(NegativeRangeTest)
{
  wchar_t message[200];
  CRootFinder rooter;
  for (double v = -0.1; v > -3.0; v = v - 0.5)
  {
    try 
    {
      // Should raise an exception:
      double result = rooter.SquareRoot(v);

      _swprintf(message, L"No exception for input %g", v);
      Assert::Fail(message, LINE_INFO());
    }
    catch (std::out_of_range ex)
    {
      continue; // Correct exception.
    }
    catch (...)
    {
      _swprintf(message, L"Incorrect exception for %g", v);
      Assert::Fail(message, LINE_INFO());
    }
  }
}

Build the solution and choose Run All.
Open (or double-click) the failed test.

The failed assertion is highlighted. The failure message is visible in the detail pane of Test Explorer.
To see why the test fails, step through the function:
1. Set a breakpoint at the start of the SquareRoot function.
2. On the shortcut menu of the failed test, choose Debug Selected Tests.
  
  When the run stops at the breakpoint, step through the code.

Insert code in the function that you are developing:

#include <stdexcept>
...
double CRootFinder::SquareRoot(double v)
{
    // Validate parameter:
    if (v < 0.0) 
    {
      throw std::out_of_range("Can't do square roots of negatives");
    }

All tests now pass.

Refactor the code without changing tests

Simplify the central calculation in the SquareRoot function:

// old code:
//   result = result - (result*result - v)/(2*result);
// new code:
     result = (result + v/result)/2.0;

Build the solution and choose Run All, to make sure that you have not introduced an error.

Tip

A good set of unit tests gives confidence that you have not introduced bugs when you change the code.

Keep refactoring separate from other changes.

Next steps

Isolation. Most DLLs are dependent on other subsystems such as databases and other DLLs. These other components are often developed in parallel. To allow unit testing to be performed while the other components are not yet available, you have to substitute mock or
Build Verification Tests. You can have tests performed on your team’s build server at set intervals. This ensures that bugs are not introduced when the work of several team members is integrated.
Checkin tests. You can mandate that some tests are performed before each team member checks code into source control. Typically this is a subset of the complete set of build verification tests.

You can also mandate a minimum level of code coverage.

Condividi tramite

Unit testing native code with Test Explorer

To write unit tests for an unmanaged code DLL

Walkthrough: Developing an unmanaged DLL with Test Explorer

Create a native unit test project

Create an Unmanaged DLL project

Couple the test project to the DLL project

Iteratively augment the tests and make them pass

Debug a failing test

Refactor the code without changing tests

Next steps

See Also

Tasks

Concepts

Other Resources

Risorse aggiuntive