TTS question intonation

Question

TTS question intonation

Christtian Mariano Pires Crispim 1

Hi,

Whe have a TTS solution that use the voice Antonio(Neural) for Brazilian Portuguese. I've noticed that Antonio doen't speek question correctly. When running the same sentence with Francisca (Neural), she identify the question and use the right intonation, as in these samples:

Eu estou muito feliz hoje.
Eu estou muito feliz hoje?

I'm looking for a way to inform the TTS service that a sentence is a question, to keep using Antonio voice. Something like

Rohit Mungi 49,131 Reputation points Microsoft Employee Moderator

2020-12-18T07:40:46.61+00:00

@Christtian Mariano Pires Crispim Thanks for the feedback. Could you please provide us the region of speech endpoint too for reference?

I am not a native speaker of Portuguese but I have ran through the audio samples with the above example and it sounds like AntonioNeural voice did not pick up the question mark. We will run this through our product team engineers for analysis and provide you an update. If possible, you can also add additional sentences with similar issues and we will try to pass this feedback to our team. Thanks!!
Christtian Mariano Pires Crispim 1 Reputation point

2020-12-18T12:09:08.53+00:00
@Rohit Mungi of course I can! And thanks for the help!

The region is East US:
https://eastus.tts.speech.microsoft.com/cognitiveservices/v1

Here are some sentences with similar issues:

Interessante, não é mesmo [ ?. ]

Achou interessante o nosso papo sobre linguagem [ ?. ]

Você sabia que a textualidade tem sete fatores [ ?. ]

Não sabe quem foi Émile Durkheim [ ?. ]

Posso te ajudar com mais alguma coisa [ ?. ]

Não está claro para você o que são valores positivistas [ ?. ]

Quer entender mais sobre esse tipo de racismo [ ?. ]

In this one the question was identified, the initial "Quer" has changed, but the end hasn't question intonation:

Quer saber mais sobre isso [ ?. ]

Let me know if you need more sentences.

All the best!
Rohit Mungi 49,131 Reputation points Microsoft Employee Moderator

2020-12-18T12:23:36.077+00:00

@Christtian Mariano Pires Crispim Thanks for sharing more details. Our team is investigating the same.

4 answers

Your answer

Rohit Mungi 49,131 Reputation points Microsoft Employee Moderator

2020-12-18T07:40:46.61+00:00

@Christtian Mariano Pires Crispim Thanks for the feedback. Could you please provide us the region of speech endpoint too for reference?

I am not a native speaker of Portuguese but I have ran through the audio samples with the above example and it sounds like AntonioNeural voice did not pick up the question mark. We will run this through our product team engineers for analysis and provide you an update. If possible, you can also add additional sentences with similar issues and we will try to pass this feedback to our team. Thanks!!
Christtian Mariano Pires Crispim 1 Reputation point

2020-12-18T12:09:08.53+00:00

@Rohit Mungi of course I can! And thanks for the help!

The region is East US:
https://eastus.tts.speech.microsoft.com/cognitiveservices/v1

Here are some sentences with similar issues:

Interessante, não é mesmo [ ?. ]

Achou interessante o nosso papo sobre linguagem [ ?. ]

Você sabia que a textualidade tem sete fatores [ ?. ]

Não sabe quem foi Émile Durkheim [ ?. ]

Posso te ajudar com mais alguma coisa [ ?. ]

Não está claro para você o que são valores positivistas [ ?. ]

Quer entender mais sobre esse tipo de racismo [ ?. ]

In this one the question was identified, the initial "Quer" has changed, but the end hasn't question intonation:

Quer saber mais sobre isso [ ?. ]

Let me know if you need more sentences.

All the best!
Rohit Mungi 49,131 Reputation points Microsoft Employee Moderator

2020-12-18T12:23:36.077+00:00

@Christtian Mariano Pires Crispim Thanks for sharing more details. Our team is investigating the same.

Answer 1

Garfield He 6 Microsoft Employee

@Rvoice @Christtian Mariano Pires Crispim I would like to update you that we just checked-in the latest pt-BR Antonio voice with question tone improved last week, please notes that this new model is in public preview, which means only available at 3 regions: East US, West Europe, and Southeast Asia. We will roll out to all regions if there is no negative feedback of this new version in next couples of months

0 comments

Answer 2

CX DBX 0

Olá! Depois de algumas tentativas e erros descobri que uma quebra de linha resolve a entonação não só da voz do Antonio, mas das demais vozes também. Espero que ajude.

Testado no clipcahmp.com

Hi, after some trial and error I found that a line break fixes the intonation of not only Antonio's voice, but the other voices as well. I hope it helps.

Tested on clipchamp.com

0 comments

Answer 3

Rvoice 1

@Rohit Mungi

We've been having the same problem for months and no response and or update from the Microsoft engineering team!

The problem in the intonation of interrogative sentences can be understood as something punctual by the Microsoft team but for us who deliver this service to our customers it is a big problem in all the dialogs we use! Making the sentences lose all sense of context.

Microsoft TTS has always been our main preference, we make more than 5 million requests per month on Microsoft's TTS API and now we find ourselves in the situation of changing the supplier to Google TTS, even though it's not our preference, because Microsoft doesn't solve this problem for over years!

If you are interested in solving the problem let us know so we can reevaluate!

Antonio(Neural) for Brazilian Portuguese
https://eastus.tts.speech.microsoft.com/cognitiveservices/v1

Rvoice 1 Reputation point

2022-08-11T17:06:52.62+00:00
One of the big problems with proper names is that when you put the sentence in the interrogative, ending with the proper name, the microsoft TTS engine puts the sentence in the affirmative!

Eu falo com João?

Eu falo com Maria?

Eu falo com Marcos?

Falo com Maria?

Eu gostaria de falar com Maria, é você?

.......

Att,

Answer 4

patrick azevedo 1

Descobriu alguma forma de ajustar a entonação?

0 comments

Share via

TTS question intonation

4 answers

Your answer