Azure Media Services
A group of Azure services that includes encoding, format conversion, on-demand streaming, content protection, and live streaming services.
318 questions
Azure Video Indexer - Auto-detect multi language Fails to Process Both Channels in Stereo
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(176, 80%, 27%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ERW%3C/text%3E%3C/svg%3E)
Ray Weber
1
Reputation point
Azure Video Indexer's Auto-detect multi language fails under the following scenario: When the input WAV file is 8 KHz stereo, and there is a different person talking in each channel, one channel is completely ignored and the resulting transcript only has the dialogue from one channel. Interestingly, if it is only one person, talking into both channels, then both channels are picked up. Also, if the file is merged into mono, then the entire transcript is picked up. Similarly, if the file is recorded in 44.1 KHz, then both channels are picked up as well. Lastly, if Auto-detect single language is used, then again, both channels are picked up.
So, to recap, in Azure Video Indexer, if you select Auto-detect multi language with an 8 KHz stereo WAV file that has a different person talking in each channel, one channel is completely ignored. The vast majority of our input files fit this use case.
Any guidance that you can provide is greatly appreciated!
{count} votes
-
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(153.6, 92%, 24%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EA%3C/text%3E%3C/svg%3E)
ajkuma 27,956 Reputation points Microsoft Employee2022-06-16T19:50:17.657+00:00 @Ray Weber , Thanks for posting this great question. I'm checking on this internally and will get back to you shortly.
-
Ray Weber 1 Reputation point
2022-06-16T19:52:50.653+00:00 Excellent, thank you so much for checking on this; greatly appreciated!
-
ajkuma 27,956 Reputation points Microsoft Employee
2022-06-17T10:13:29.183+00:00 @Ray Weber , Following-up on this, just to confirm, do you also observe this when selecting a specific language or is it only during Auto-Detect?
To better assist you, if the source file/repo is public, could you please share it with us for detailed investigation? Or I can reach out to you privately.
Note: Kindly do not share any PII data on the public forum/post.
-
Ray Weber 1 Reputation point
2022-06-17T14:42:54.857+00:00 It is only when I select "Auto-Detect Multi Language" that I observe this behavior. If I select a specific language or "Auto-Detect Single Language" it works.
Yes, I can send you a link to a file that we are using for testing.
Thank you!
Sign in to comment
Sign in to answer