The language detection doesn't work correctly. Recently, it always return English even though I upload the videos with different languages

Phuoc Nguyen Minh 5 Reputation points
2024-05-30T09:12:39.75+00:00

In the past, when I submitted a video to AI Video Indexer to get a transcript with the mode = auto-detect single language, it can detect correctly for other languages like French, German, Chinese, etc. However, recently, it hasn't worked correctly, it always returns English as the source language even though the videos I uploaded contain other languages supported by AI Video Indexer. Please advise.

244d6718-99ba-4e12-8beb-197eb8f4dda4

Ex: I upload the short French video https://www.youtube.com/watch?v=VTYjLBWks6k

The insight file returns as the following:

User's image

Azure AI Video Indexer
Azure AI Video Indexer
An Azure video analytics service that uses AI to extract actionable insights from stored videos.
64 questions
{count} votes

1 answer

Sort by: Most helpful
  1. romungi-MSFT 43,451 Reputation points Microsoft Employee
    2024-05-30T13:02:59.1066667+00:00

    It seems like the language isn't detected correctly and it falls back on default of English. I think the reason for this could be due the last reason mentioned in the guidelines and limitations.

    • If the audio contains languages other than the supported list, the result is unexpected.
    • If Azure AI Video Indexer can't identify the language with a high enough confidence (greater than 0.6), the fallback language is English.
    • Currently, there isn't support for files with mixed language audio. If the audio contains mixed languages, the result is unexpected.
    • Low-quality audio may affect the model results.
    • The model requires at least one minute of speech in the audio.
    • The model is designed to recognize a spontaneous conversational speech (not voice commands, singing, and so on).

    Did you also try to use auto detect multi language and check if there are better results?

    If this answers your query, do click Accept Answer and Yes for was this answer helpful. And, if you have any further query do let us know.

    0 comments No comments