Add, run, and update inline tests

Azure DevOps Services | Azure DevOps Server 2022 - Azure DevOps Server 2019

Similar to task checklists, you can quickly define inline tests, or a set of manual tests cases, for a backlog item from your board. Not only can you add tests, you can run them and update their status. If you're new to working with the board, see Kanban board overview. If you're new to testing, see Exploratory and manual testing scenarios and capabilities.

Screenshot showing Web portal, board with several inline tests defined.

Tests that you create from the board automatically get linked to the user story or backlog item.

Prerequisites

  • Project and team access:

  • Access levels:

    • Ensure you have Basic access or higher to add work items and use all board features.
    • Verify you have Basic access or higher to view or run tests. Users with Stakeholder access can't view or run tests.
  • Permissions:

    • Set View work items in this node and Edit work items in this node permissions to Allow to view or modify work items. By default, the Contributors group has these permissions. For more information, see Set permissions and access for work tracking.
  • Project and team access:

  • Access levels:

    • Ensure you have Basic access or higher to add work items and use all board features.
    • Verify you have Basic access or higher to view or run tests. Users with Stakeholder access can't view or run tests.
  • Permissions:

    • Set View work items in this node and Edit work items in this node permissions to Allow to view or modify work items. By default, the Contributors group has these permissions. For more information, see Set permissions and access for work tracking.

Open your board from the web portal

  1. To view your board, open your project from a web browser and choose (1) Work, (2) Boards, and then (3) select the team's board from the selector.

    Screenshot showing Opening your board action.

    To choose another team's board, open the selector and select a different team or choose the Browse all team boards option. Or, you can enter a keyword in the search box to filter the list of team backlogs for the project.

    Screenshot showing selecting another team's board.

    Tip

    Choose the star icon to favorite a team board. Favorited artifacts ( favorited icon) appear at the top of the team selector list.

Add inline tests

  1. To start adding tests, open the menu for the work item.

    Screenshot showing Open context menu of a backlog item to add inline test case.

    Adding inline tests is the same as adding test cases to a test suite. A default test plan and test suite automatically get created under which the manual test cases are grouped.

    For example, a test suite is created for each user story, and all inline tests are added to that suite. In the following example, user story 152 is highlighted which has three manual tests defined with IDs of 153, 155, and 161.

    Screenshot showing  Inline test cases get added to test suites and test plans.

    For more information, see Plan your tests.

  2. If you have many tests to add, keep entering each title and select Enter.

    Screenshot showing Work item with several test cases added.

    To add details to the test case, open it. You can select the title, double-click the inline item, or open the context menu and choose Open.

    Screenshot showing opening a test case form from board.

See Create manual tests to learn more about defining tests.

Before running the test, you must add details.

Run the inline test

Run the test by selecting Run icon Run test from the actions menu for the inline test.

Screenshot showing running a test.

Microsoft Test Runner starts in a new browser instance. For more information, see Run manual tests.

Update the status of an inline test from the action menu

You can update the status of the test from the actions menu.

Screenshot showing completed tasks. Updating the status of tests lets you track test results.

Expand or collapse inline tests

When you first open a board, you're presented with an unexpanded view of checklists.

Screenshot showing Inline tests collapsed.

Hover over the inline test summary to show a test summary.

Screenshot showing test summary upon hover.

Select the inline test summary to expand a collapsed set of tests. Select the same summary to collapse an expanded list.

Screenshot showing Inline tests expanded.

Copy or reparent a test

To reparent a test, drag and drop the test to a different user story.

Screenshot showing Drag tests to reassign them to a different user story.

This action automatically changes the linked relationship of the test and points to the new user story.

To create a copy of a test to add to a different user story, select the test, select the CTRL key, and then drag and drop the test onto the user story card.

When you link a test case to a work item using the "Tested By" link type, the board reflects the test status of the linked test case. However, if the requirement-based suite has multiple configurations, the board only shows the test outcome for the default configuration.

Next steps