The scores in JSON on speech studio website

yujing 45 Reputation points
2023-06-03T07:01:40+00:00

When I used Speech Studio (https://speech.microsoft.com/portal/pronunciationassessmenttool), I found the Pronunciation score, Accuracy score, Fluency score, and Completeness score are kind of different from thePronunciationAssessment in JSON file.

For example, in the Sample1: We had a great time taking a long walk outside in the morning.

The Pronunciation score, Accuracy score, Fluency score, and Completeness score are 95, 92, 96, and 100, respectively.

sample1

However, in th JSON file,

[
    {
        "Id": "7db365b51aa34dd589cddf6d1a867d7e",
        "RecognitionStatus": 0,
        "Offset": 1200000,
        "Duration": 38300000,
        "DisplayText": "We had a great time taking a long, long walk in the morning.",
        "SNR": 32.28842,
        "NBest": [
            {
                "Confidence": 0.9797814,
                "Lexical": "we had a great time taking a long long walk in the morning",
                "ITN": "we had a great time taking a long long walk in the morning",
                "MaskedITN": "we had a great time taking a long long walk in the morning",
                "Display": "We had a great time taking a long, long walk in the morning.",
                "PronunciationAssessment": {
                    "AccuracyScore": 100,
                    "FluencyScore": 96,
                    "CompletenessScore": 100,
                    "PronScore": 97.6
                },
                "Words": [ .... 

PronunciationAssessment showed the completely different value, especially for accuracy score.

So my question is which one I should trust?

If the first one is more reliable, then how should I got these four values by using JSON file?

Azure AI Speech
Azure AI Speech
An Azure service that integrates speech processing into apps and services.
1,554 questions
0 comments No comments
{count} votes

Accepted answer
  1. romungi-MSFT 43,691 Reputation points Microsoft Employee
    2023-06-05T15:16:32.85+00:00

    @yujing The JSON and the display should show the same values. I have observed that the UI takes some time to update if you have previously used the tool, it is sometimes displaying previous values and takes time to update the UI. Here is a screen shot of my result where both of them match.

    User's image

    In any case, you should use the JSON score if you are using the studio and with REST API too the same JSON format should be available. Thanks!!

    If this answers your query, do click Accept Answer and Yes for was this answer helpful. And, if you have any further query do let us know.

    1 person found this answer helpful.
    0 comments No comments

0 additional answers

Sort by: Most helpful