Azure OpenAI Service
An Azure service that provides access to OpenAI’s GPT-3 models with enterprise capabilities.
4,106 questions
Why do chatbots sometimes fail to answer a question on the first attempt?
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(288, 79%, 37%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EBJ%3C/text%3E%3C/svg%3E)
Bao, Jeremy (Cognizant)
105
Reputation points
The exact results differ depending on what temperature and search method is being used, but sometimes, when I ask a GPT-3.5 Turbo based chatbot using RAG a question for the first time, it says that It could not find relevant information answer the question based on the retrieved documents, but if I ask again, it produces an answer? How can I get it to produce that answer the first time?
Azure OpenAI Service
{count} votes
-
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(214.4, 74%, 30%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EAM%3C/text%3E%3C/svg%3E)
AshokPeddakotla-MSFT 35,971 Reputation points Moderator2024-04-10T02:19:45.24+00:00 Bao, Jeremy (Cognizant) Greetings!
The exact results differ depending on what temperature and search method is being used, but sometimes, when I ask a GPT-3.5 Turbo based chatbot using RAG a question for the first time, it says that It could not find relevant information answer the question based on the retrieved documents, but if I ask again, it produces an answer? How can I get it to produce that answer the first time?
It is possible that the chatbot needs more context or information to provide a relevant answer to your question. You can try providing more details or rephrasing your question to see if that helps the chatbot understand your query better.
You can define a system message to steer the model's reply when using Azure OpenAI On Your Data. This message allows you to customize your replies on top of the retrieval augmented generation (RAG) pattern that Azure OpenAI On Your Data uses. The system message is used in addition to an internal base prompt to provide the experience.
Also, see Content retrieval in Azure AI Search for more details.
Do let me know if that helps.
-
Bao, Jeremy (Cognizant) 105 Reputation points
2024-04-10T15:36:14.62+00:00 It is the same question in both cases, so why would asking twice provide more context? And I do have a system message.
-
AshokPeddakotla-MSFT 35,971 Reputation points Moderator
2024-04-16T13:53:13.7566667+00:00 I understand that, if possible could you share the sample prompt which you have tried? Is it same with every new query you are trying?
Sign in to comment
Sign in to answer