Generating subtitle in different language of Video where audio could be in different language

Question

Generating subtitle in different language of Video where audio could be in different language

vikas 1

I am able to generate vtt file using azure media service transform job. but I have a requirement where in my input video file's audio could be in English language and I want to generate vtt file in Spanish language. I tried passing language to preset and in generated VTT file also says NOTE language:es-es but the VTT file content is not as per the audio.

could you please assist what could go wrong here ?

vikas 1 Reputation point

2022-01-17T18:51:52.857+00:00

anyone can assist here ? my requirement is to be able to generate captions in any other supported language other than video language. i could not see an option of passing language parameter for caption file
vikas 1 Reputation point

2022-01-17T19:01:29.2+00:00

@John Deutscher ...could you please assist if possible ?
John Deutscher (MSFT) 2,126 Reputation points

2022-01-18T18:33:45.25+00:00

It kind of depends on how you set up your transform. As David Bristol noted below in his anser, you have to set the language tag on the audio analyzer preset in the Transform.
I have a Typescript sample showing that, and how to use preset overrides if you need to change that on a per-job basis. See the code here
https://github.com/Azure-Samples/media-services-v3-node-tutorials/blob/2c71e84ddc2b4841054c50d9323c92f0244a7c5b/AudioAnalytics/index.ts#L84

1 answer

Your answer

vikas 1 Reputation point

2022-01-17T18:51:52.857+00:00

anyone can assist here ? my requirement is to be able to generate captions in any other supported language other than video language. i could not see an option of passing language parameter for caption file
vikas 1 Reputation point

2022-01-17T19:01:29.2+00:00

@John Deutscher ...could you please assist if possible ?
John Deutscher (MSFT) 2,126 Reputation points

2022-01-18T18:33:45.25+00:00

It kind of depends on how you set up your transform. As David Bristol noted below in his anser, you have to set the language tag on the audio analyzer preset in the Transform.
I have a Typescript sample showing that, and how to use preset overrides if you need to change that on a per-job basis. See the code here
https://github.com/Azure-Samples/media-services-v3-node-tutorials/blob/2c71e84ddc2b4841054c50d9323c92f0244a7c5b/AudioAnalytics/index.ts#L84

Answer 1

David Bristol 971 Microsoft Employee

In Media Services the language setting for the AudioAnalyzerPreset is there to help describe the input. According to https://learn.microsoft.com/en-us/azure/media-services/latest/analyze-video-audio-files-concept, "Specify the language for the audio payload in the input using the BCP-47 format of 'language tag-region'." Media Services does not offer translation. For that you could use something like Video Indexer (https://videoindexer.ai) that generates VTT files and translates them as well.

John Deutscher (MSFT) 2,126 Reputation points

2022-01-18T18:34:44.277+00:00

Correct, AMS audio analyzer does not provide any text-to-text translation feature. For that, you should look at the other service known as Azure Video Analyzer for Media (it was previously called Video Indexer)

Share via

Generating subtitle in different language of Video where audio could be in different language

1 answer

Your answer