Using the same model for Function Calling and Enterprise Data Search

Question

Using the same model for Function Calling and Enterprise Data Search

Neeraj Kumar 51

I am using Azure OpenAI function calling for some custom processing and responding in a natural way, but when I ask questions, which does not require custom processing, it should use the cognitive search to bring back the response as configured in the Azure OpenAI studio, but somehow it is not bring the response from the cognitive search. It is rather bringing from the internet. Please suggest. I am using gpt-35-turbo-16k 0613.

AshokPeddakotla-MSFT 36,021 Reputation points Moderator

2023-08-28T05:39:02.8766667+00:00

Neeraj Kumar Greetings!

Can you share the sample you have tried and the results you got?

Also, I would recommend checking the configuration settings for your Azure OpenAI function and ensuring that it is set up to use Azure Cognitive Search as the source for responses.
Neeraj Kumar 51 Reputation points

2023-08-28T08:14:34.3433333+00:00
Hi Ashok, I was able to find the issue. The problem was that when I was uploading the file from the chat playground with Azure Open AI studio for our own data, it was uploading it to the storage account, but in the cognitive search index, the indexer was not getting created, which I believe should be an automated process, in the same was as the index gets created. I had to manually create it. After that when the index ran, it was able to fetch the data.

Now the issue is when I try to ask a question, I am getting the response, but there are 2 issues:

This response is getting merged with an internal website, which is not a part of the cognitive search and

When I ask for reputable sources for the response, it is bringing back the url of the external website and not giving the URL to the enterprise document that is part of search.
AshokPeddakotla-MSFT 36,021 Reputation points Moderator

2023-08-31T02:36:55.8533333+00:00

Neeraj Kumar Glad to hear you found the issue.

This response is getting merged with an internal website, which is not a part of the cognitive search

Did you turn on Semantic Search which returns more relevant results by applying language understanding to an initial search result.

When I ask for reputable sources for the response, it is bringing back the url of the external website and not giving the URL to the enterprise document that is part of search.

Please check the available data preparation script to ingest the data into cognitive search and see if that helps with better results.