Streaming audio data from a browser to a node server and further to Azure speech-to-text

Question

Streaming audio data from a browser to a node server and further to Azure speech-to-text

Steffen Schreiber 25

Is there a cross-browser way to record audio data in a browser, stream it to a Node server and from there forward it to Azure STT?

I am aware of the SDK for JavaScript and I checked the examples for sending data from the browser directly to Azure or from Node directly to Azure. However, what I would like to do is to record an audio stream in the browser, stream it to the Node server (in best case while the recording is still running; using MediaRecorder's ondataavailable method?) and then send a request from the Node server to Azure STT.

The building blocks must be in the SDK code, but can such a setup be achieved with native SDK functions?

The whole setup should work cross-browser as does the Azure JavaScript SDK.

Thanks in advance for any help!

Best regards,
Steffen

romungi-MSFT 48,906 Reputation points Microsoft Employee Moderator

2023-03-23T07:35:06.9866667+00:00

@Steffen Schreiber The JS SDK supports AudioInputStream class which can create pull and push streams. This issue discusses on how it can be used with SpeechRecognizer. This might still not be exactly what you are looking for, I would request to raise an issue on the JS SDK repo to check if SDK supports your requirement. The SDK team should be able to better answer this query if there is existing support or if they plan to add one in the future.
Steffen Schreiber 25 Reputation points

2023-03-24T21:45:24.8266667+00:00

Thanks, I created an issue in the repo and will update here about the outcome.

Your answer

romungi-MSFT 48,906 Reputation points Microsoft Employee Moderator

2023-03-23T07:35:06.9866667+00:00

@Steffen Schreiber The JS SDK supports AudioInputStream class which can create pull and push streams. This issue discusses on how it can be used with SpeechRecognizer. This might still not be exactly what you are looking for, I would request to raise an issue on the JS SDK repo to check if SDK supports your requirement. The SDK team should be able to better answer this query if there is existing support or if they plan to add one in the future.
Steffen Schreiber 25 Reputation points

2023-03-24T21:45:24.8266667+00:00

Thanks, I created an issue in the repo and will update here about the outcome.

Share via

Streaming audio data from a browser to a node server and further to Azure speech-to-text

Your answer