[ISSUE] Pronunciation Assessment in Polish Fails

Question

[ISSUE] Pronunciation Assessment in Polish Fails

Jordan Cadon 0

Hello, the Azure Team,

I have noticed audio passed to the Azure Pronunciation Assessment in Polish doesn't work at all. Uploaded audio and even the live microphone in your Azure Speech dashboard fail in Polish. I haven't tested all the languages but the other ones I use work (English, French, Spanish).

Can you please take a look? Maybe some of your machines or endpoints are down for some languages.

Thanks,

Jordan.

santoshkc 15,435 Reputation points Microsoft External Staff Moderator

2025-02-06T14:40:40.03+00:00

Hi @Jordan Cadon,

Thank you for reaching out to Microsoft Q&A forum!

I tried to reproduce the issue you encountered with the Azure Pronunciation Assessment in Polish, and it worked on my end. However, intermittent issues can sometimes arise due to temporary network or server-related problems. I recommend trying again later to see if the issue resolves itself. Additionally, clearing your browser cache and cookies or trying a different browser may help resolve any temporary glitches.

Audio quality can also affect the assessment. Even though other languages might work fine, subtle distortions or background noise in the Polish audio can cause recognition issues. Ensuring the audio is clear can improve the chances of success.

Still, if you face any issues, please let us know the region you're working in and provide the screen-short of an error, and we’ll work on resolving the issue for you.

I hope you understand! Thank you.

Do click Accept Answer and Yes for was this answer helpful. And, if you have any further query do let us know.
Jordan C 20 Reputation points

2025-02-06T15:01:54.65+00:00

It doesn't work. I am on Sweden Central and the microphone input gets turned off directly after being switched on and the upload of an audio file outputs no results. Can you please check in this region? All the other languages work on my side except this one.
Jordan C 20 Reputation points

2025-02-11T00:45:49.1133333+00:00

Did you have the time to check this issue? The issue is still present both in the API and in the dashboard.
navba-MSFT 27,550 Reputation points Microsoft Employee Moderator

2025-02-17T05:28:18.6166667+00:00

@Jordan Cadon Thank you for reaching out to Microsoft Q&A forum!

.

Please note for Swedan Central, Custom speech training with audio is not supported.

The region has dedicated hardware for custom speech training. If you plan to train a custom model with audio data, you must use one of the regions with dedicated hardware.

The same is documented ***here. *Please try in the supported region and check if that works fine.

.

Awaiting your reply.

**

Please do not forget to "Accept the answer” and “up-vote” wherever the information provided helps you, this can be beneficial to other community members.
Jordan C 20 Reputation points

2025-02-17T11:32:16.6433333+00:00

Hi @navba-MSFT . The issue is not on custom speech. The issue is on Pronunciation Assessment in your dashboard and with the API with the Polish language in the Sweden Central region. Can you check that please?
navba-MSFT 27,550 Reputation points Microsoft Employee Moderator

2025-02-19T08:57:50.11+00:00

@Jordan C Could you please share the sample audio (WAV) file here along with the text so that I can test this at my end ? If you cannot attach the audio file here, you may have to rename the audio file as .txt and attach it here.
Jordan C 20 Reputation points

2025-02-20T05:18:03.6566667+00:00

Hello @navba-MSFT

You can test with these 2 MP3 files, one in Polish (doesn't work), one in French (works).

French: french.txt

Polish: polish.txt

You can see the results here:

In French all good.

In Polish nothing is detected:
navba-MSFT 27,550 Reputation points Microsoft Employee Moderator

2025-03-03T08:50:55.24+00:00

@Jordan Cadon Thanks for sharing the details. I created a Swedan Central resource and use the polish.mp3 file and it is working just fine. Could you please ensure that you have selected Polish as the language ? Awaiting your reply.
Jordan C 20 Reputation points

2025-03-03T12:23:22.6233333+00:00

I see that it doesn't work in your screenshot either. You don't have any pronunciation score and no word is detected in Polish (everything at the bottom is in grey). If it worked, you would have seen the pronunciation score and see the score of the detected words like in my French screenshot example. The model in Polish doesn't assess anything. The phrase in the audio is the same as the text. Please check it @navba-MSFT
navba-MSFT 27,550 Reputation points Microsoft Employee Moderator

2025-03-03T12:51:37.1766667+00:00

@Jordan Cadon Thanks for getting back. here is the complete screenshot:

Could you please share the actual text script in polish ? Awaiting your reply.
Jordan C 20 Reputation points

2025-03-03T13:10:26.5366667+00:00

@navba-MSFT Zostało wykryte zagrożenie. Został wykryty podejrzany plik. Został wykryty program, którego obecność może być niepożądana. Skan został zakończony. Baza wirusów programu Avast została zaktualizowana. Witamy w oprogramowaniu Avast.
navba-MSFT 27,550 Reputation points Microsoft Employee Moderator

2025-03-03T13:15:06.2933333+00:00

@Jordan C Thanks for sharing the text. Here is the screenshot for polish.mp3:
Jordan C 20 Reputation points

2025-03-03T13:19:35.2266667+00:00

@navba-MSFT You are using the English model. You have 4 samples shown. These 4 examples are only in English and 44% score accuracy comes from the English model assessing the Polish speech which makes no sense. Please try using the Polish model.
Jordan C 20 Reputation points

2025-03-09T21:18:56.8066667+00:00

Any news on this?
navba-MSFT 27,550 Reputation points Microsoft Employee Moderator

2025-03-11T03:19:31.9333333+00:00

@Jordan C Apologies for the delay. Thanks for clarifying. As you rightly pointed out I see the below behavior:

I am looking into this internally. I will keep you posted.

1 answer

Your answer

santoshkc 15,435 Reputation points Microsoft External Staff Moderator

2025-02-06T14:40:40.03+00:00

Hi @Jordan Cadon,

Thank you for reaching out to Microsoft Q&A forum!

I tried to reproduce the issue you encountered with the Azure Pronunciation Assessment in Polish, and it worked on my end. However, intermittent issues can sometimes arise due to temporary network or server-related problems. I recommend trying again later to see if the issue resolves itself. Additionally, clearing your browser cache and cookies or trying a different browser may help resolve any temporary glitches.

Audio quality can also affect the assessment. Even though other languages might work fine, subtle distortions or background noise in the Polish audio can cause recognition issues. Ensuring the audio is clear can improve the chances of success.

Still, if you face any issues, please let us know the region you're working in and provide the screen-short of an error, and we’ll work on resolving the issue for you.

I hope you understand! Thank you.

Do click Accept Answer and Yes for was this answer helpful. And, if you have any further query do let us know.
Jordan C 20 Reputation points

2025-02-06T15:01:54.65+00:00

It doesn't work. I am on Sweden Central and the microphone input gets turned off directly after being switched on and the upload of an audio file outputs no results. Can you please check in this region? All the other languages work on my side except this one.
Jordan C 20 Reputation points

2025-02-11T00:45:49.1133333+00:00

Did you have the time to check this issue? The issue is still present both in the API and in the dashboard.
navba-MSFT 27,550 Reputation points Microsoft Employee Moderator

2025-02-17T05:28:18.6166667+00:00

@Jordan Cadon Thank you for reaching out to Microsoft Q&A forum!

.

Please note for Swedan Central, Custom speech training with audio is not supported.

The region has dedicated hardware for custom speech training. If you plan to train a custom model with audio data, you must use one of the regions with dedicated hardware.

The same is documented ***here. *Please try in the supported region and check if that works fine.

.

Awaiting your reply.

**

Please do not forget to "Accept the answer” and “up-vote” wherever the information provided helps you, this can be beneficial to other community members.
Jordan C 20 Reputation points

2025-02-17T11:32:16.6433333+00:00

Hi @navba-MSFT . The issue is not on custom speech. The issue is on Pronunciation Assessment in your dashboard and with the API with the Polish language in the Sweden Central region. Can you check that please?
navba-MSFT 27,550 Reputation points Microsoft Employee Moderator

2025-02-19T08:57:50.11+00:00

@Jordan C Could you please share the sample audio (WAV) file here along with the text so that I can test this at my end ? If you cannot attach the audio file here, you may have to rename the audio file as .txt and attach it here.
Jordan C 20 Reputation points

2025-02-20T05:18:03.6566667+00:00

Hello @navba-MSFT

You can test with these 2 MP3 files, one in Polish (doesn't work), one in French (works).

French: french.txt

Polish: polish.txt

You can see the results here:

In French all good.

In Polish nothing is detected:
navba-MSFT 27,550 Reputation points Microsoft Employee Moderator

2025-03-03T08:50:55.24+00:00

@Jordan Cadon Thanks for sharing the details. I created a Swedan Central resource and use the polish.mp3 file and it is working just fine. Could you please ensure that you have selected Polish as the language ? Awaiting your reply.
Jordan C 20 Reputation points

2025-03-03T12:23:22.6233333+00:00

I see that it doesn't work in your screenshot either. You don't have any pronunciation score and no word is detected in Polish (everything at the bottom is in grey). If it worked, you would have seen the pronunciation score and see the score of the detected words like in my French screenshot example. The model in Polish doesn't assess anything. The phrase in the audio is the same as the text. Please check it @navba-MSFT
navba-MSFT 27,550 Reputation points Microsoft Employee Moderator

2025-03-03T12:51:37.1766667+00:00

@Jordan Cadon Thanks for getting back. here is the complete screenshot:

Could you please share the actual text script in polish ? Awaiting your reply.
Jordan C 20 Reputation points

2025-03-03T13:10:26.5366667+00:00

@navba-MSFT Zostało wykryte zagrożenie. Został wykryty podejrzany plik. Został wykryty program, którego obecność może być niepożądana. Skan został zakończony. Baza wirusów programu Avast została zaktualizowana. Witamy w oprogramowaniu Avast.
navba-MSFT 27,550 Reputation points Microsoft Employee Moderator

2025-03-03T13:15:06.2933333+00:00

@Jordan C Thanks for sharing the text. Here is the screenshot for polish.mp3:
Jordan C 20 Reputation points

2025-03-03T13:19:35.2266667+00:00

@navba-MSFT You are using the English model. You have 4 samples shown. These 4 examples are only in English and 44% score accuracy comes from the English model assessing the Polish speech which makes no sense. Please try using the Polish model.
Jordan C 20 Reputation points

2025-03-09T21:18:56.8066667+00:00

Any news on this?
navba-MSFT 27,550 Reputation points Microsoft Employee Moderator

2025-03-11T03:19:31.9333333+00:00

@Jordan C Apologies for the delay. Thanks for clarifying. As you rightly pointed out I see the below behavior:

I am looking into this internally. I will keep you posted.

Answer 1

@Jordan Cadon Apologies for the late response.

I had reached out to the Product Owners in the background and they were working on providing the fix. Hence the delay.

.
Updated:

We have tested in the East US region and the results are good. When I tested on the Sweden Central region, I could reproduce the issue. The fix will be deployed to Swedan Central region by EOD today.

User's image

Could you please test this again and get back to us ?

.

Hope this helps. If you have any follow-up questions, please let me know. I would be happy to help.

**

Please do not forget to "Accept the answer” and “up-vote” wherever the information provided helps you, this can be beneficial to other community members.

Share via

[ISSUE] Pronunciation Assessment in Polish Fails

1 answer

Your answer