Will a custom phrases' or vocabulary list be available in Speech to Text API at some time?

Rafa Torres 46

I opened this post's question: https://learn.microsoft.com/en-us/answers/questions/360649/custom-list-phrase-vocavulary-on-batch-transcripti.html and I want to know if more than one year later, apart from the SDK, is Microsft working in some vocabulary features for the Speech To Text API?

Looking forward to hearing any positive answer!

romungi-MSFT 45,721 Reputation points Microsoft Employee

2022-08-22T12:14:04.433+00:00

@Rafa Torres The phraselist feature can now be used with the speech studio and speech cli apart from the SDK. This is not yet added to the REST API or the batch transcription API.
Rafa Torres 46 Reputation points

2022-08-23T07:25:37.223+00:00

Thank you for the quick answer, hoping to work with this feature within the REST API soon, it would be quite valuable for our users!
romungi-MSFT 45,721 Reputation points Microsoft Employee

2022-08-24T08:40:52.067+00:00

@Rafa Torres I believe you are referring to the short audio API? If yes, could you provide a use case scenario that could help us to pass the feedback?
Rafa Torres 46 Reputation points

2022-08-30T07:04:55.45+00:00

I'm working with batch transcription API, for long audio transcription, this API allows us to work with URLs from external storage. We use it for company meetings where users use specific vocabulary in every meeting they have (company names, technical words of their respective fields...), so the need for a custom phrase list/vocabulary is a must for us. For example, depending on the language, we use a different engine, and with the other we use, we can introduce custom vocabulary and spelling (just to let you know). In addition, we use this transcription to generate other outputs, so if the transcription has any incoherence, this will affect them. We are happy enough with the azure model results, so we have no need to train a custom model for now, but the vocabulary feature would highly increase the results.

I hope my use case can help you to pass the feedback, I'm willing to keep helping you if needed, thanks!
zest 5 Reputation points

2023-03-15T15:48:11.28+00:00

@romungi-MSFT has Microsoft considered adding the "Phrase List" feature to the REST API for speech-to-text? Every other speech service (AWS, IBM, Google) offers this without requiring an SDK.

Why Phrase lists?: Phrase lists are so important that the current REST API is unusable for our purposes without them.

Why REST API?: The reason the REST API is so valuable is for serverless architectures where you just want to quickly submit an audio file for processing before stopping whatever infrastructure was used to submit. Later on, ideally a callback (URL) triggers separate infrastructure for receiving the output, or you can use something like AWS EventBridge to automatically poll the REST API for the completion status (i.e. zero code solutions).

Why not SDK/CLI?: In serverless architecture, you ideally do not want to install custom environment like an SDK or even CLI and, furthermore, you cannot afford to wait/poll for results since you are charged by time and are not running on dedicated servers.

Thanks for your consideration on this feature!

Share via

Will a custom phrases' or vocabulary list be available in Speech to Text API at some time?

Your answer