AndrewMultilingualNeural en-US says the wrong word when only one word to speech.

洋焦 20

for example: The word 'abandon', the voice like you cut off the letter a. He just said 'bandon'. The problem occurs when you use AndrewMultilingualNeural, en-US, and only one word. This just happened by this time. I'm sure that It is correct before.

Do you guys have the same problem?

I am waiting for your answer. Thanks.

I tried speech studio and java SDK.

speech studio version: 1.1 java SDK below.

       <dependency>
            <groupId>com.microsoft.cognitiveservices.speech</groupId>
            <artifactId>client-sdk</artifactId>
            <version>1.35.0</version>
        </dependency>

<speak version='1.0' xmlns='http://www.w3.org/2001/10/synthesis' xml:lang='en-US'>
        <voice name='en-US-AndrewMultilingualNeural'>
                <lang xml:lang='en-US'>
                        <prosody rate='-22.0%'>
                                 abandon
                        </prosody>
                </lang>
        </voice>
</speak>

navba-MSFT 20,810 Reputation points Microsoft Employee

2024-03-18T04:40:03.95+00:00
@洋焦 Welcome to Microsoft Q&A Forum, Thank you for posting your query here!

Plan 1:

I tried with the below curl command and it was fine:

curl --location --request POST "https://YourRegion.tts.speech.microsoft.com/cognitiveservices/v1" ^ --header "Ocp-Apim-Subscription-Key: 4cd8XXXXXXXXXXXXXXXXXXXdbb1b8" ^ --header "Content-Type: application/ssml+xml" ^ --header "X-Microsoft-OutputFormat: audio-16khz-128kbitrate-mono-mp3" ^ --header "User-Agent: curl" ^ --data-raw "<speak version='1.0' xml:lang='en-US'><voice xml:lang='en-US' xml:gender='Male' name='en-US-AndrewMultilingualNeural'>abandon</voice></speak>" --output output.mp3

Could you please run the same above curl command and check if that sounds accurate to you ?

Plan 2:

Could you please test with the Speech Studio too as shown below and check if that is better ?

Awaiting your reply. If you have any follow-up questions, please let me know. I would be happy to help.
洋焦 20 Reputation points

2024-03-18T09:42:07.1966667+00:00

Thanks for your answer.

I've made a video about the issue.

It can clear show what problem is.

I wonder that It did not happen before. It was correct and now it doesn't work.

If need extra setting?

Please check below.

https://tingxie100-1317670271.cos.ap-shanghai.myqcloud.com/test/abandon%E9%94%99%E8%AF%AF%E5%8F%91%E9%9F%B3%E8%A7%86%E9%A2%91%E5%BD%95%E5%88%B6.mp4
navba-MSFT 20,810 Reputation points Microsoft Employee

2024-03-18T10:35:50.96+00:00

@洋焦 Thanks for getting back and sharing the details. I am looking into this and I will get back to you with an update.
洋焦 20 Reputation points

2024-03-21T01:04:09.31+00:00

Hi, Dear navba-MSFT.

Has the issue been solved?
navba-MSFT 20,810 Reputation points Microsoft Employee

2024-03-21T04:25:14.1733333+00:00

@洋焦 Thanks for your reply. This issue has been escalated to the Product Owners and they are looking into this. I am awaiting the reply from them. I will update you once I hear from them.

Accepted answer

navba-MSFT 20,810 Reputation points Microsoft Employee

2024-03-24T04:51:13.8866667+00:00

@洋焦 Apologies for the delay. I appreciate your patience on this.I had reached out to the Product Owners. We confirmed this issue on AndrewMultilingualNeural voice and we're investigating why it happens. **Plan:**Currently there is no ETA on when the fix would be provided.

I will keep you posted and update this thread once we have a concrete solution for this.

Workaround:

Meanwhile, there's a workaround solution to mitigate it which is adding a period mark(".") at the end of the single word. By doing so, the reading will be correct.**

Please do not forget to "Accept the answer” and “up-vote” wherever the information provided helps you, this can be beneficial to other community members.
Please sign in to rate this answer.

1 person found this answer helpful.
洋焦 20 Reputation points

2024-03-24T14:10:36.1466667+00:00

Thanks for your reply. @navba-MSFT

I tried the method you give me last comment and It worked with

AndrewMultilingualNeural voiceId. I tried lots of single word It was nice.

Unfortunately, the method add . at the end of single word. It did not work with voiceId EmmaMultilingualNeural . like some word (activity. accord. accordance. act. activity. affair. apparent. ) So, that is a problem. please try it out.

Thanks again. your services is great.

navba-MSFT 20,810 Reputation points Microsoft Employee

2024-03-25T03:52:26.7233333+00:00

@洋焦 Thanks for getting back. I am glad that the workaround helped for AndrewMultilingualNeural. I have shared the feedback for EmmaMultilingualNeural with the Product Group so that they can look into this further. I will update this thread, once I hear from them. Currently there is no ETA. Hope this helps.
Sign in to comment

Share via

AndrewMultilingualNeural en-US says the wrong word when only one word to speech.

0 additional answers