Speech Translation seems not working for me

Question

Screenshot from 2023-03-07 14-33-08.png

this is my sample code, and screenshot.

From screenshoot

[14:31:58] RECOGNIZED: Text=How are you?
[14:31:58] TRANSLATED: How are you?

TRANSLATED: How are you? -> "你好嗎". I expected the translated result is [14:31:58] TRANSLATED: 你好嗎?

That seems not to translated. Do anyone know why ?

var autoDetectSourceLanguageConfig = AutoDetectSourceLanguageConfig.FromLanguages(new string[]{ "en-US", "zh-TW", "ja-JP" });

SpeechTranslationConfig config  = SpeechTranslationConfig.FromSubscription(Config.SpeechServiceSubscriptionKey, Config.SpeechServiceRegion);
        
config.SpeechRecognitionLanguage = "zh-TW";

        
config.AddTargetLanguage("zh-Hant");
print($"config.SpeechRecognitionLanguage {config.SpeechRecognitionLanguage}");
var targetLanguages = config.TargetLanguages;
foreach (var language in targetLanguages)
{
    print($" config.TargetLanguages  :{ language }");
}


pushStream = AudioInputStream.CreatePushStream(AudioStreamFormat.GetWaveFormatPCM(48000, 16, 1));

recognizer = new TranslationRecognizer(config, autoDetectSourceLanguageConfig, AudioConfig.FromStreamInput(pushStream));

       
recognizer.Recognized += (s, e) =>
{
      if (e.Result.Reason == ResultReason.TranslatedSpeech)
      {
         Debug.Log($"RECOGNIZED: Text={e.Result.Text}");
         Debug.Log($"TRANSLATED: {e.Result.Translations["zh-Hant"]} ");
                
      }
};

Answer 1

timchen I think the issue here could be the setting of speech recognition language and the audo detect language config. Try using only the speech recognition language of en-US and comment out autoDetectSourceLanguageConfig and do not pass the same in TranslationRecognizer() as it is optional. Here is what I tried and it works as expected.

As you can see, I only used the recognition language and target language to get accurate output. You can add

auto_detect_source_language_config to the recognizer and pass the required languages but it should be consistent with the recognition language that is actually used.

In your snippet change the following:

config.SpeechRecognitionLanguage = "zh-TW";

to

config.SpeechRecognitionLanguage = "en-US";

Comment out auto detection config and remove it from the recognizer and check if it works.

If this answers your query, do click Accept Answer and Yes for was this answer helpful. And, if you have any further query do let us know.

Answer 2

Screenshot from 2023-03-07 14-33-08.png

Answer 3

Screenshot from 2023-03-07 14-33-08.png

https://learn.microsoft.com/api/attachments/e08e4243-da99-420f-8244-99b91acd8965?platform=QnA