How do you provide feedback or suggestions to Azure Open AI?

Data Juggler 181 Reputation points
2024-06-13T17:52:04.03+00:00

I have been using the new Azure Open AI 2.0.0 beta, and I noticed that in the examples shown, the entire message history is fed back for each subsequent call, so the message history grows with each round of prompts.

Wouldn't it be more efficient to pass back a Conversation Id with a prompt, and the rest of the conversation could be loaded from a temporary cache of the current conversation?

I am considering building a site as a demo, but if each user sends the entire conversation back, it seems that doesn't scale as well.

Azure OpenAI Service
Azure OpenAI Service
An Azure service that provides access to OpenAI’s GPT-3 models with enterprise capabilities.
2,541 questions
0 comments No comments
{count} votes

1 answer

Sort by: Most helpful
  1. AshokPeddakotla-MSFT 30,066 Reputation points
    2024-06-14T02:50:38.1633333+00:00

    Data Juggler You can share your feedback by creating a new issue on the repo and/or on this portal.

    Do let me know if you have any further queries.

    0 comments No comments