Speech to Text, Word Error Rate (WER), Custom Speech

dddd 61 Reputation points
2022-04-13T14:03:03.043+00:00

On the custom speech portal under the testing portion, there is data that shows the WER.

I would like to know if it is possible to print just the WER in a C# application.
I have found the documentation to print the total details but was looking for just the WER as a high-level assessment.

Thank you.

Azure Speech
Azure Speech
An Azure service that integrates speech processing into apps and services.
910 questions
Azure Cognitive Services
Azure Cognitive Services
A group of Azure artificial intelligence services and cognitive APIs that help build intelligent apps.
1,141 questions
{count} votes

Accepted answer
  1. YutongTie-MSFT 31,121 Reputation points
    2022-04-18T23:21:51.587+00:00

    Hello @dddd

    Sorry, I don't think we have direct way to return a parameter from SDK, sorry about the limitation. I have forwarded your feedback to product team to do proper evaluation.

    For workaround, I have got three ways to get the WER please check if those help:

    1 . SPX - Azure Speech CLI support WER calculations: https://learn.microsoft.com/en-us/azure/cognitive-services/speech-service/spx-basics?tabs=windowsinstall%2Cpowershell
    193900-image.png

    2 . Open source scoring tool - SCTK: https://github.com/usnistgov/SCTK

    3 . Speech Studio - Test and Evaluate as I mentioned above, but the shortage is, it need to be in studio and not only just WER is returned.
    194052-image.png

    I hope the feature to return WER direct by SDK can be supported in close future. Hope this helps!

    Regards,
    Yutong

    -Please kindly accept the answer if you feel helpful to support the community, thanks a lot!

    0 comments No comments

0 additional answers

Sort by: Most helpful