Does AZURE Assistant API provide streaming

Question

Does AZURE Assistant API provide streaming

Karishma Nanda 265

Hi I am using gpt-35-turbo-0613 model and using Assistant API . I am dealing with high latency (40 sec) and wanted to use streaming to deal with it, I went though below documentation but could not find anything related to streaming for assistant api (streaming = True) . Could you please help/point me for streaming for azure openai assistant, is available or not ?
https://learn.microsoft.com/en-us/azure/ai-services/openai/whats-new#assistants-api-public-preview

Accepted answer

0 additional answers

Your answer

Answer 1

YutongTie-MSFT 53,971 Moderator

@Karishma Nanda Thanks for reaching out to us, streaming is currently not available for Assistance API.

Already checked on internally to see what the ETA for this feature is, will let you know once I get any response.

Regards,

Yutong

-Please kindly accept the answer if you feel helpful to support the community, thanks a lot.

Karishma Nanda 265 Reputation points

2024-04-11T10:15:34.3666667+00:00

Hi YutongTie thank you for your reply, did yo get any information on ETA for this feature?
YutongTie-MSFT 53,971 Reputation points Moderator

2024-04-13T00:17:21.11+00:00

The ETA is still not been decided yet, sorry.
Lefevre Adrien 0 Reputation points

2024-04-17T12:13:58.22+00:00

I would be also interested in this feature. As it has been released on OpenAI side (streaming support for assistant since march), I would expect the same on Azure OpenAI side. Could it be a problem from Azure rest API?
Srikanth Ganta 0 Reputation points

2024-12-05T08:30:47.36+00:00

Any updates on this? :)

Share via

Does AZURE Assistant API provide streaming

0 additional answers

Your answer