How can I prevent the Azure OpenAI chat from adding unnecessary details to its responses when asking questions on my documents?

AMROUN Lysa 241 Reputation points
2024-05-24T08:33:43.5466667+00:00

I'm using the azure openai chat playground on my documents and I'm doing test questions, I notice that when I ask a question on a document the chat answers me correctly but adds other details of the document that are not necessary to the question asked, how can I fix this?

thks

lysa

Azure AI Search
Azure AI Search
An Azure search service with built-in artificial intelligence capabilities that enrich information to help identify and explore relevant content at scale.
798 questions
Azure OpenAI Service
Azure OpenAI Service
An Azure service that provides access to OpenAI’s GPT-3 models with enterprise capabilities.
2,437 questions
{count} votes

Accepted answer
  1. AshokPeddakotla-MSFT 29,811 Reputation points
    2024-05-27T03:08:19.1766667+00:00

    AMROUN Lysa Greetings!

    I'm using the azure openai chat playground on my documents and I'm doing test questions, I notice that when I ask a question on a document the chat answers me correctly but adds other details of the document that are not necessary to the question asked, how can I fix this?

    Did you enable Limit responses to your data setting?

    When Limit responses to your data setting is disabled, the model supplements its responses with its own knowledge in addition to your documents. When this setting is enabled, the model attempts to only rely on your documents for responses.

    Screenshot of the advanced settings.

    Also, you need to train the model and use correct system message. See Prompt engineering techniques for more details.

    Do let me know if you have any further queries.

    1 person found this answer helpful.

0 additional answers

Sort by: Most helpful