Azure AI Speech
An Azure service that integrates speech processing into apps and services.
1,975 questions
Getting "Confidence": 0 in the response for every word
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(22.400000000000002, 35%, 12%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EA%3C/text%3E%3C/svg%3E)
Anju
31
Reputation points
I am using Speech to Text REST API in my work.
Taking help of the documentation https://learn.microsoft.com/en-us/azure/cognitive-services/speech-service/rest-speech-to-text-short#pronunciation-assessment-parameters
The response does not match with the documentation. I am getting a new variable with value 0 e.g.
"Words": [
{
"Word": "how",
"Offset": 600000,
"Duration": 2400000,
"ErrorType": "None",
"Confidence": 0,
"AccuracyScore": 62
},
{
"Word": "is",
"Offset": 3100000,
"Duration": 900000,
"ErrorType": "None",
"Confidence": 0,
"AccuracyScore": 92
},
{
"Word": "the",
"Offset": 4100000,
"Duration": 1100000,
"ErrorType": "None",
"Confidence": 0,
"AccuracyScore": 100
}
]
Can you please help as what is the purpose of the variable "Confidence" and why is it value always 0?
Thanks
{count} votes
-
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(195.2, 4%, 28%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EVM%3C/text%3E%3C/svg%3E)
VasaviLankipalle-MSFT 18,656 Reputation points2023-03-11T02:23:02.5566667+00:00 Hi @Anju , Thanks for using Microsoft Q&A Platform.
Is it possible for you to share the code snippets with us so that we can reproduce them? Have you checked the confidence score generated for a sentence?
-
VasaviLankipalle-MSFT 18,656 Reputation points
2023-03-14T02:38:31.23+00:00 Hi @Anju , the "Confidence" score in the pronunciation assessment at the word level is a value between 0 and 1 that represents the level of confidence from 0.0 (no confidence) to 1.0 (full confidence).
If the value is always 0, I believe it could indicate that there is an issue with the audio input or the recognition settings.Please share the code details with us so we can check on our end as well.
-
Anju 31 Reputation points
2023-03-16T15:07:46.59+00:00 Hi,
Adding the response.
At the word level,If the accuracy score is 100.0 but the confidence score is 0.0, it looks like the two scores are telling entirely opposite thing
{"RecognitionStatus":"Success","Offset":10800000,"Duration":20000000,"NBest":[{"Confidence":0.9891657,"Lexical":"How do I run this program","ITN":"How do I run this program","MaskedITN":"how do i run this program","Display":"How do I run this program?","AccuracyScore":100.0,"Words":[{"Word":"How","Offset":10800000,"Duration":3300000,"Confidence":0.0,"AccuracyScore":97.0},{"Word":"do","Offset":14200000,"Duration":3200000,"Confidence":0.0,"AccuracyScore":100.0},{"Word":"I","Offset":17500000,"Duration":1000000,"Confidence":0.0,"AccuracyScore":100.0},{"Word":"run","Offset":18600000,"Duration":2900000,"Confidence":0.0,"AccuracyScore":100.0},{"Word":"this","Offset":21600000,"Duration":2300000,"Confidence":0.0,"AccuracyScore":100.0},{"Word":"program","Offset":24000000,"Duration":6800000,"Confidence":0.0,"AccuracyScore":100.0}]}],"DisplayText":"How do I run this program?"} -
VasaviLankipalle-MSFT 18,656 Reputation points
2023-03-16T15:12:28.31+00:00 @Anju , as mentioned earlier there could be many reasons. Is it possible to share the code you are trying with so that I can reproduce it on my end and help you more on this?
-
Anju 31 Reputation points
2023-03-22T12:12:16.3+00:00 Hi,
I m using the curl command for this. Sharing the request json (removing the API key)
curl -X POST "https://centralindia.stt.speech.microsoft.com/speech/recognition/conversation/cognitiveservices/v1?language=en-US&format=simple" -H "accept: application/json" -H "Ocp-Apim-Subscription-Key: <api-key>" -H "Content-Type: audio/wav; codecs=audio/pcm; samplerate=16000" -H "Pronunciation-Assessment: ewogICJSZWZlcmVuY2VUZXh0IjogIkhvdyBkbyBJIHJ1biB0aGlzIHByb2dyYW0uIiwKICAiR3JhZGluZ1N5c3RlbSI6ICJIdW5kcmVkTWFyayIsCiAgIkdyYW51bGFyaXR5IjogIldvcmQiCn0=" --data-binary @./en-US_0.wavThe PronunciationAssessment block is created from this input block
{ "ReferenceText": "How do I run this program.", "GradingSystem": "HundredMark", "Granularity": "Word" } -
Anju 31 Reputation points
2023-04-06T14:13:42.12+00:00 @VasaviLankipalle-MSFT , any updates? Thanks
Sign in to comment
Sign in to answer