Speech to Text, Word Error Rate (WER), Custom Speech

Question

On the custom speech portal under the testing portion, there is data that shows the WER.

I would like to know if it is possible to print just the WER in a C# application.
I have found the documentation to print the total details but was looking for just the WER as a high-level assessment.

Thank you.

Answer 1

Hello @dddd

Sorry, I don't think we have direct way to return a parameter from SDK, sorry about the limitation. I have forwarded your feedback to product team to do proper evaluation.

For workaround, I have got three ways to get the WER please check if those help:

1 . SPX - Azure Speech CLI support WER calculations: https://learn.microsoft.com/en-us/azure/cognitive-services/speech-service/spx-basics?tabs=windowsinstall%2Cpowershell

2 . Open source scoring tool - SCTK: https://github.com/usnistgov/SCTK

3 . Speech Studio - Test and Evaluate as I mentioned above, but the shortage is, it need to be in studio and not only just WER is returned.

I hope the feature to return WER direct by SDK can be supported in close future. Hope this helps!

Regards,
Yutong

-Please kindly accept the answer if you feel helpful to support the community, thanks a lot!