Does AZURE Assistant API provide streaming

Question

Hi I am using gpt-35-turbo-0613 model and using Assistant API . I am dealing with high latency (40 sec) and wanted to use streaming to deal with it, I went though below documentation but could not find anything related to streaming for assistant api (streaming = True) . Could you please help/point me for streaming for azure openai assistant, is available or not ?
https://learn.microsoft.com/en-us/azure/ai-services/openai/whats-new#assistants-api-public-preview

Answer 1

@Karishma Nanda Thanks for reaching out to us, streaming is currently not available for Assistance API.

Already checked on internally to see what the ETA for this feature is, will let you know once I get any response.

Regards,

Yutong

-Please kindly accept the answer if you feel helpful to support the community, thanks a lot.