Why I am getting the response beyond the data source added in Azure Open AI ?

Question

Why I am getting the response beyond the data source added in Azure Open AI ?

Katriya Bhavik Babubhai 10

Hi Everyone,

I have added data from blob storage, also configured cognitive search and indexing. When I am asking question beyond the data source, I am able to get response, which should not happen.

For example, Bot is giving responses for generic questions like:

who is PM/President of XYZ country?
what is capital of XYZ country?

while responding it is also incorrectly referring to the document that I have added in data source.

Could someone please help me solve this issue?

Thanks,

Bhavik

1 answer

Your answer

Answer 1

brtrach-MSFT 17,741 Microsoft Employee Moderator

@Katriya Bhavik Babubhai It sounds like the default pre-built knowledge base is enabled.

To exclude the pre-built knowledge base, set the "isTest" property to "true" in the request body when you call the question-answering API. This will ensure that the model only uses the data source(s) that you have specified in the configuration.

For example, the request body might look like this:

{
    "question": "<span class=" active-doc-0" data-doc-items="0">How long does it take to charge a Surface Pro 4[1](#doc-pos=0)</span>?",
    "dataSources": "myDataSource",
    "isTest": true
}

In this example, the question-answering model will only use the "myDataSource" data source to retrieve answers and will not use the pre-built knowledge base.

I hope this answers your question. Let me know if you have any further questions.

Katriya Bhavik Babubhai 10 Reputation points

2023-08-21T04:10:07.5366667+00:00

@brtrach-MSFT I am using Azure Open AI chat playground. How do I configure my REST API in such a way that it responds only from my data source (azure blob storage, cognitive search and indexing has been used while configuring data source)?

I am referring https://learn.microsoft.com/en-us/azure/ai-services/openai/reference#completions-extensions
brtrach-MSFT 17,741 Reputation points Microsoft Employee Moderator

2023-08-24T22:55:42.8033333+00:00
@Katriya Bhavik Babubhai to configure your REST API to respond only from your data source, you can use the model parameter in the request body when you call the completions API.

For example, the request body might look like this:

{ "model": "YOUR_MODEL_NAME", "prompt": "YOUR_PROMPT", "temperature": 0.7, "max_tokens": 60, "top_p": 1, "frequency_penalty": 0, "presence_penalty": 0 }

In this example, the model parameter specifies the name of the model that you want to use for generating completions. You can find the name of your model in the Azure portal or in the OpenAI Studio.

By specifying the name of your model, you can ensure that the completions API only uses the data source(s) that you have specified in the configuration of that model.
Katriya Bhavik Babubhai 10 Reputation points

2023-08-28T09:17:11.4133333+00:00

Hi @brtrach-MSFT ,

I got your point, but I am facing challenge as mentioned in this question while creating a custom model.

Thanks
brtrach-MSFT 17,741 Reputation points Microsoft Employee Moderator

2023-09-06T05:22:23.8866667+00:00

It might be best to take this offline as I have not been able to locate a solution. Can you please email me at azcommunity@microsoft.com with the subject as ATTN: Bryan and in the body of the email please include your Azure subscription ID.

We look forward to your reply.

Share via

Why I am getting the response beyond the data source added in Azure Open AI ?

1 answer

Your answer