How to integrate OpenAIClient.GetCompletionsStreamingAsync in MS Team Chatbot

Rajeesh M R 206

The GetCompletionsStreamingAsync concept in Azure OpenAI is interesting, and I am uncertain about how to integrate it into an MS Team chatbot using C#. Presently, all send activities occur in a single method call within the bot framework. However, streaming involves a loop-like concept, allowing for sequential user responses. This feature could significantly enhance the user experience.

YutongTie-MSFT 46,986 Reputation points

2023-06-30T04:33:56.1666667+00:00

Hello @Rajesh M R

Thanks for reaching out to us, I have added Teams development tag for more experts to help.
Sayali-MSFT 2,266 Reputation points Microsoft Vendor

2023-07-03T06:51:42.69+00:00

Hello @Rajesh M R -Thanks for reporting your issue.

We will check this at our end and will get back to you.
Sayali-MSFT 2,266 Reputation points Microsoft Vendor

2023-07-05T07:21:16.6966667+00:00
Could you please look into this document-

https://learn.microsoft.com/en-us/dotnet/api/overview/azure/ai.openai-readme?view=azure-dotnet-preview

https://learn.microsoft.com/en-us/dotnet/api/azure.ai.openai.openaiclient.getcompletionsstreamingasync?view=azure-dotnet-preview

Hope it is helpful!!
Rajeesh M R 206 Reputation points

2023-07-05T11:10:28.9733333+00:00

I have already checked the above link, and it work well in console applications in .NET Core. However, consider when integrating an MS Teams chatbot, where the response has a single entry. If you were to use send activity in a 'for each' loop, then multiple 'send activity' messages would appear on the screen.
vijay sai mutyala 30 Reputation points

2023-08-21T14:46:34.6766667+00:00

@Rajeesh M R Were you able to find a solution for this ?
Rajeesh M R 206 Reputation points

2023-08-23T06:22:40.8666667+00:00

vijay sai mutyala - Not yet.
Edward Skrod 0 Reputation points Microsoft Employee

2024-02-29T13:54:08.71+00:00

This is not a Teams issue. This is an Azure Bot Framework issue and should be tagged with AzureBotFramework or similar.
Shuang Liang 5 Reputation points Microsoft Employee

2024-04-22T08:05:30.2866667+00:00

Hi @Rajeesh M R @Edward Skrod did you found any update on integrating stream message in Teams chat bot? We want to build the similar experience.
Edward Skrod 0 Reputation points Microsoft Employee

2024-04-22T14:26:46.0133333+00:00

Shuang, if the bot is built using the Azure Bot Framework SDK, there are no plans to add support for streaming chat completions, per their PM.
Shuang Liang 5 Reputation points Microsoft Employee

2024-04-23T02:01:58.84+00:00

Sad news. But thanks for the update, @Edward Skrod

1 answer

ChetanSharmamsft 1,026 Reputation points Microsoft Vendor

2024-03-01T15:17:06.7133333+00:00

Hello @Rajeesh M R - You can use Teams AI library to integrate Open AI related capability to your Teams application.

Reference doc: https://learn.microsoft.com/en-us/microsoftteams/platform/bots/how-to/teams%20conversational%20ai/teams-conversation-ai-overview

You can refer existing sample from this repo https://github.com/microsoft/teams-ai
Please sign in to rate this answer.

0 comments No comments
Sign in to comment