Can a Custom Neural Voice be voiced out in different languages from a single voice actor?

Question

Can a Custom Neural Voice be voiced out in different languages from a single voice actor?

Nick U 20

Assuming it's a pro voice is there anything stopping me from using a single voice actor in all 63 languages. I know this will incur cost, but i'm asking if theres any usage limits?

Arabic (Egypt), Arabic (Oman), Arabic (Saudi Arabia), Arabic (Syria), Arabic (Tunisia), Bulgarian (Bulgaria), Catalan (Spain), Chinese (Cantonese, Traditional), Chinese (Mandarin, Simplified), Chinese (Simplified, Singapore), Chinese (Taiwanese Mandarin), Croatian (Croatia), Czech (Czech), Danish (Denmark), Dutch (Belgium), Dutch (Netherlands), English (Australia), English (Canada), English (India), English (Ireland), English (Kenya), English (Nigeria), English (Philippines), English (Singapore), English (South Africa), English (Tanzania), English (United Kingdom), English (United States), Finnish (Finland), French (Belgium), French (Canada), French (France), French (Switzerland), German (Austria), German (Germany), German (Switzerland), Greek (Greece), Hebrew (Israel), Hindi (India), Hungarian (Hungary), Indonesian (Indonesia), Italian (Italy), Japanese (Japan), Korean (Korea), Malay (Malaysia), Norwegian (Bokmål, Norway), Polish (Poland), Portuguese (Brazil), Portuguese (Portugal), Romanian (Romania), Russian (Russia), Slovak (Slovakia), Slovenian (Slovenia), Spanish (Argentina), Spanish (Colombia), Spanish (Mexico), Spanish (Spain), Swedish (Sweden), Tamil (India), Telugu (India), Thai (Thailand), Turkish (Türkiye), Vietnamese (Vietnam)

dupammi 8,615 Reputation points Microsoft External Staff

2024-02-08T11:03:39.3033333+00:00

Hi @Nick U

Thank you for the question.

You are correct that the cross-lingual adaptation feature currently supports only a limited number of languages, and Hindi and Arabic are not included in the list. In this case, you can create separate custom neural voice models for each language you want to support. You can use the Azure Text-to-Speech service to create a custom neural voice for each language, and then use the appropriate voice model to synthesize speech in that language.

I hope you understand. Thank you.
Nick U 20 Reputation points

2024-02-08T20:43:14.9666667+00:00

I see, so we'll need to train a CNV for each of the languages outside the dozen cross-lingual adaptation included languages. Thanks for the clear answers @dupammi !

Accepted answer

0 additional answers

Your answer

dupammi 8,615 Reputation points Microsoft External Staff

2024-02-08T11:03:39.3033333+00:00

Hi @Nick U

Thank you for the question.

You are correct that the cross-lingual adaptation feature currently supports only a limited number of languages, and Hindi and Arabic are not included in the list. In this case, you can create separate custom neural voice models for each language you want to support. You can use the Azure Text-to-Speech service to create a custom neural voice for each language, and then use the appropriate voice model to synthesize speech in that language.

I hope you understand. Thank you.
Nick U 20 Reputation points

2024-02-08T20:43:14.9666667+00:00

I see, so we'll need to train a CNV for each of the languages outside the dozen cross-lingual adaptation included languages. Thanks for the clear answers @dupammi !

Answer 1

Hi @Nick U

Thank you for using the Microsoft Q&A forum.

To answer your question, it is possible to use a single voice actor to voice out a custom neural voice in different languages. However, it's important to note that the backend models used for training are language-specific, so it's recommended to create a project with a specific language setting and use data or scripts with the same format to avoid any issues with the CNV voice output or training.

For example, if you want to create a custom neural voice that speaks both Mandarin and English, you can create a project that supports traditional Chinese, which also supports cross-lingual features. This can help your voice to speak a secondary language that also supports cross-lingual features, such as en-US, without additional training data.

It's also worth noting that the Azure Text-to-Speech service supports a wide range of languages, including the 63 languages you listed. You can find more information about the supported languages and voices on the Azure Text-to-Speech Language support page.

I hope this helps!

If this answers your query, do click Accept Answer and Yes for was this answer helpful.

Nick U 20 Reputation points

2024-02-07T21:25:26.85+00:00

Thanks for your answer @dupammi

I see, so I would only be able to use the cross-lingual adaptation, but from what I can see online that only supports these 12 languages:
Chinese (Mandarin, Simplified), Dutch (Netherlands), English (Australia), English (United Kingdom), English (United States), French (Canada), French (France), German (Germany), Indonesian (Indonesia), Italian (Italy), Japanese (Japan), Korean (Korea), Portuguese (Brazil), Russian (Russia), Spanish (Mexico), Spanish (Spain) To shed some light on my use case, i'm creating dubbed voiceovers for a video. Specifically we're targeting 30 of the 63 languages, including Hindi and Arabic that aren't in the list of cross-lingual languages. What would I do for those languages?

Share via

Can a Custom Neural Voice be voiced out in different languages from a single voice actor?

0 additional answers

Your answer