Teams(GPT) bot does not response when taking longer to generate answer via Azure OpenAI

kosuke tsuda 0 Reputation points
2024-03-25T13:28:56.22+00:00

We have created a GPT bot for MS Teams using "Azure Bot Service SDK for Python".

It works fine usually, however, the bot does not respond sometimes. It seems that it happens when Azure OpenAI takes longer to generate a text.

I guess this is caused by timeout settings in Team, but i have no crew so far.

Could anyone advice me where to look?

Microsoft Teams Development
Microsoft Teams Development
Microsoft Teams: A Microsoft customizable chat-based workspace.Development: The process of researching, productizing, and refining new or existing technologies.
2,863 questions
0 comments No comments
{count} votes

1 answer

Sort by: Most helpful
  1. ChetanSharmamsft 1,026 Reputation points Microsoft Vendor
    2024-03-26T07:45:19.06+00:00

    Hello kosuke tsuda,
    Thanks for raising your query.

    Sometimes Azure Open AI takes time to get answers due to high traffic, please wait for couple of mins before resubmitting.

    So, you can return appropriate response via bot like below:
    Sometimes it takes time to get answers due to high traffic, please wait for couple of mins before resubmitting.