When are we supporting WebRTC connection with Azure OpenAI audio models?

Question

When are we supporting WebRTC connection with Azure OpenAI audio models?

LeetGPT 90

https://platform.openai.com/docs/guides/realtime#connect-with-webrtc

We've been experimented with webrtc connection on openai audio models for a while. Asking to see what's a good way to switch onto webrtc support with Azure OpenAI realtime models? I do not see currently how we can do that on documentation.

For OpenAI, we have to connect with:

https://api.openai.com/v1/realtime/sessions
https://api.openai.com/v1/realtime

Wonder what is the equivalent url to connect to webrtc sessions using Azure OpenAI models?

Rahul Patil 0 Reputation points

2025-03-22T10:51:41.6233333+00:00

I was working on the exact thing yesterday and bummed to realize that Azure does not support WebRTC. I hope it is rolled out soon.
LeetGPT 90 Reputation points

2025-03-24T02:45:23.8066667+00:00

@SriLakshmi C Gotcha thanks for the answer, do we have plans to support WebRTC in the future? Asking since this will guide us through the decisions whether to migrate onto websocket for our technical roadmap. It's not a trivial effort and we want to make sure we don't end up with throwaway works.
SriLakshmi C 4,390 Reputation points Microsoft External Staff

2025-03-24T09:28:40.2833333+00:00

@LeetGPT

As of now, Azure OpenAI does not support WebRTC directly. The current Realtime API for speech and audio interactions relies on WebSockets for asynchronous streaming communication.

However, there have been discussions about adding WebRTC support in the future, though official confirmation or release timelines are not yet available.
SriLakshmi C 4,390 Reputation points Microsoft External Staff

2025-03-25T05:48:22.75+00:00

@LeetGPT

We haven’t heard from you on the last response and was just checking back to see if you have a resolution yet. In case if you have any resolution please do share that same with the community as it can be helpful to others. Otherwise, will respond with more details and we will try to help.

Accepted answer

0 additional answers

Your answer

Rahul Patil 0 Reputation points

2025-03-22T10:51:41.6233333+00:00

I was working on the exact thing yesterday and bummed to realize that Azure does not support WebRTC. I hope it is rolled out soon.
LeetGPT 90 Reputation points

2025-03-24T02:45:23.8066667+00:00

@SriLakshmi C Gotcha thanks for the answer, do we have plans to support WebRTC in the future? Asking since this will guide us through the decisions whether to migrate onto websocket for our technical roadmap. It's not a trivial effort and we want to make sure we don't end up with throwaway works.
SriLakshmi C 4,390 Reputation points Microsoft External Staff

2025-03-24T09:28:40.2833333+00:00

@LeetGPT

As of now, Azure OpenAI does not support WebRTC directly. The current Realtime API for speech and audio interactions relies on WebSockets for asynchronous streaming communication.

However, there have been discussions about adding WebRTC support in the future, though official confirmation or release timelines are not yet available.
SriLakshmi C 4,390 Reputation points Microsoft External Staff

2025-03-25T05:48:22.75+00:00

@LeetGPT

We haven’t heard from you on the last response and was just checking back to see if you have a resolution yet. In case if you have any resolution please do share that same with the community as it can be helpful to others. Otherwise, will respond with more details and we will try to help.

Answer 1

Hello LeetGPT,

The Azure OpenAI Realtime API enables real-time audio interactions but does not natively support WebRTC connections. Instead, it depends on client-side integrations to manage the transmission and reception of audio streams in real time. The API is not designed to directly connect to end-user devices, including those utilizing WebRTC.

At present, the official documentation does not specify a URL for integrating WebRTC sessions with Azure OpenAI models. The primary approach involves using the Realtime API through a secure WebSocket connection to the /realtime endpoint of your Azure OpenAI resource.

Please refer this Realtime API (Preview) reference, How to use the GPT-4o Realtime API for speech and audio (Preview).

I hope this information helps.

Kindly consider upvoting the comment if the information provided is helpful. This can assist other community members in resolving similar issues.

Share via

When are we supporting WebRTC connection with Azure OpenAI audio models?

0 additional answers

Your answer