Batch testing is available from source code or as a downloadable executable zipped. The format of the command to run the batch test is:
batchtesting.exe input.tsv https://YOUR-HOST.azurewebsites.net ENDPOINT-KEY out.tsv
Param |
Expected Value |
1 |
name of tsv file formatted with TSV input fields |
2 |
URI for endpoint, with YOUR-HOST from the Publish page of the QnA Maker portal. |
3 |
ENDPOINT-KEY, found on Publish page of the QnA Maker portal. |
4 |
name of tsv file created by batch test for results. |
Use the following information to understand and implement the TSV format for batch testing.
TSV input file fields |
Notes |
KBID |
Your KB ID found on the Publish page. |
Question |
The question a user would enter. |
Metadata tags |
optional |
Top parameter |
optional |
Expected answer ID |
optional |
TSV output fields
TSV Output file parameters |
Notes |
KBID |
Your KB ID found on the Publish page. |
Question |
The question as entered from the input file. |
Answer |
Top answer from your knowledge base. |
Answer ID |
Answer ID |
Score |
Prediction score for answer. |
Metadata tags |
associated with returned answer |
Expected answer ID |
optional (only when expected answer ID is given) |
Judgment label |
optional, values could be: correct or incorrect (only when expected answer is given) |