Modify test cases within a test set

During or after creating a test set, you can edit the test cases by changing the wording of questions or modifying the expected responses, keywords, or tools as needed. You can select multiple test cases to edit them in bulk by selecting the checkboxes beside each test case.

Edit test cases within a test set

Single response

1. Go to your agent's Evaluation page.

   

2. Select the test set.

3. In the test set, select the test case you want to edit.

   

4. Change the wording of a question by editing the text in the Question field.

   

5. Some test methods require expected answers, keywords, or capabilities for each test case. Add that information to each field. To learn more about configuring each test method, see Choose evaluation methods.

   Test method	Measures	Test set type	Scoring	Configurations
   General quality	How good is a test case's response(s) based on specific qualities	Single response or conversation	Scored out of 100%	None
   Compare meaning	How well the meaning of the test case's answer matches the expected answer	Single response	Scored out of 100%	Pass score, expected answer
   Capability use	Whether the test case used all or any the expected resources	Single response	Pass/fail	Expected capabilities
   Keyword match	Whether the test case used all or any of the expected keywords or phrases	Single response or conversation	Pass/fail	Expected keywords or phrases
   Text similarity	How well the text of the test case's answer matches the expected answer	Single response	Scored out of 100%	Pass score, expected answer
   Exact match	Whether the test case's answer matches the expected answer exactly	Single response	Pass/fail	Expected answer

6. Select Apply to save changes to a test case.

7. When you're finished with your changes to your test set, select Save to save your test set or Evaluate to run the test.

Conversation

1. Go to your agent's Evaluation page.

   

2. Select the test set.

3. In the test set, select the test case you want to edit.

   

4. In the right panel, change the conversation by selecting the edit icon.

   

   The conversation editor appears. Here, you can see the user messages, which you can edit, and the agent's reference responses. These reference responses are how you expect the agent to respond in the context of the conversation.

5. To change a user question or agent reference response, select it.

   

6. Optionally, select Add a user question to add more questions and responses.

   

7. Select Done to save your changes and close the conversation editor.

8. Complete the requirements for the test methods you selected. To learn more about configuring each test method, see Choose evaluation methods.

   Test method	Measures	Test set type	Scoring	Configurations
   General quality	How good is a test case's response(s) based on specific qualities	Single response or conversation	Scored out of 100%	None
   Compare meaning	How well the meaning of the test case's answer matches the expected answer	Single response	Scored out of 100%	Pass score, expected answer
   Capability use	Whether the test case used all or any the expected resources	Single response	Pass/fail	Expected capabilities
   Keyword match	Whether the test case used all or any of the expected keywords or phrases	Single response or conversation	Pass/fail	Expected keywords or phrases
   Text similarity	How well the text of the test case's answer matches the expected answer	Single response	Scored out of 100%	Pass score, expected answer
   Exact match	Whether the test case's answer matches the expected answer exactly	Single response	Pass/fail	Expected answer

9. To save changes to a test case, select Apply.

10. When you're finished with your changes to your test set, select Save to save your test set or Evaluate to run the test.

Add more test cases to a test set

While creating or editing a test set, you can add more test cases.

1. In your agent's Evaluation page, select the test set.

2. Select Add questions or Add conversations. Then select an option to generate or manually add more test cases.

   

3. To add details, select and edit any new test cases.