Options for regression testing

When Microsoft updates Dynamics 365, you need to make sure that your solution still works as expected. You don't want to introduce any bugs or errors that could affect your users or customers. Microsoft does regression testing, but the data composition, specific customer configurations, and unique extensions mean customers must perform their own regression testing in their own environment.

But regression testing can take a lot of time and effort if you do it manually. You can save time and resources by automating your regression testing with a tool. Many tools are available for regression testing, both from Microsoft and other providers. How do you choose the best one for your needs?

Compare different tools for regression testing

The following table shows some of the tools that you can use for regression testing. It also shows whether they're free or paid, and whether they support different types of testing, such as web, desktop, or mobile.

Matrix table of solutions from Microsoft and other providers to help with regression testing.

Learn more about each tool:

Consider the costs and benefits of each tool

Before you decide on a tool, you should evaluate how well it meets your business needs. You should consider the following factors:

  • The installation and setup of the tool
  • The ease and speed of creating and updating test cases
  • The product support and documentation available
  • The ongoing maintenance and updates of the tool

Some tools are free, but they might require more technical skills or manual work. Some tools are paid, but they might offer more features or support. You should compare the total cost of ownership (TCO) and the return on investment (ROI) of each tool for your scenario. The best tool for you might not be the cheapest one—or the most expensive.

Make your own choice based on your situation

Every organization has a unique environment and profile. That's why Microsoft doesn't recommend one tool over another. You should choose the tool that works best for your solution, your budget, and your goals. You can use the information and links in this article as a starting point for your research.

Give us your feedback

If you have any suggestions or corrections for this article or the list of tools, let us know at RTChartFeedback@microsoft.com.

We can't reply to all messages, but we appreciate your feedback and we'll try to review it as soon as possible.

Next steps

  • Review the Success by Design checklist of the key steps and tasks for your testing process
  • Read a case study of how an organization implemented a testing strategy for its Dynamics 365 solution