Adding more fields to retrieve via Azure OpenAI API

johananmahendran 115

Hi,

I am using Azure OpenAI API to search data from my Azure AI Search service. I have additional fields in the search index, that I would like to retrieve alongside the filename, url, filepath, content and vector fields.

On the reference, it just mentions these fields (and vector field). I am not sure if this is truly impossible or if it is a hidden feature.

My current plan is to use one of the fields, e.g. url, to search for the id on the AI Search document and retrieve the full document using this id. But it seems like an extra step if Azure OpenAI API can do it already.

I would like some insight on this.

Thank you.

AshokPeddakotla-MSFT 34,611 Reputation points

2024-10-01T11:27:45.6966667+00:00

johananmahendran

Just checking to see if you had a chance to review the below response.

Do let me know if that helps or have any other queries.

If the response helped, please do click Accept Answer and Yes for was this answer helpful.

2 answers

Sina Salam 11,991 Reputation points

2024-09-30T02:16:04.8166667+00:00

Hello johananmahendran,

Welcome to the Microsoft Q&A and thank you for posting your questions here.

You can retrieve an additional field from your Azure AI Search index using the Azure OpenAI API. Also, to ensure that your search index schema includes these additional fields and that your search query explicitly requests them. Follow these links for more step by steps: https://learn.microsoft.com/en-us/azure/ai-services/openai/references/azure-search and https://learn.microsoft.com/en-us/azure/ai-services/openai/concepts/use-your-data

I hope this is helpful! Do not hesitate to let me know if you have any other questions.

Please don't forget to close up the thread here by upvoting and accept it as an answer if it is helpful.
Please sign in to rate this answer.
Ronald Wyman 1 Reputation point

2024-10-03T10:37:12.69+00:00

I'm also trying to have my index fields included in the rest response. I believe I have followed the directions properly, but still to no eval. The Index has the fields, retrievable, filterable, and searchable. My rest request is as follows

Request:

{

"messages": [ { "role": "user", "content": "What vendor has the highest invoice" } ], "past_messages": 20, "temperature": 0.7, "top_p": 0.95, "max_tokens": 800, "stop": null, "stream": false, "frequency_penalty": 0, "presence_penalty": 0, "data_sources": [ { "type": "azure_search", "parameters": { "endpoint": "https:\/\/dxaisearch.search.windows.net", "index_name": "azureblob-index", "semantic_configuration": "default", "query_type": "semantic", "fields_mapping": { "content_fields_separator": "\n", "content_fields": [ "content", "DOCUMENTID", "DBDEFID", "PID" ] }, "in_scope": true, "role_information": "You are an AI assistant that helps people find information.", "filter": "search.in(DOCUMENTID, 'XX')", "select": "DBDEFID, DOCUMENTID, PID", "strictness": 3, "top_n_documents": 10, "authentication": { "type": "api_key", "key": "XX" } } } ]

}

Everything works except the inclusion of our index fields in the citation. Please advise what I'm missing.

Thx

Ron

johananmahendran 115 Reputation points

2024-10-04T09:17:43.1566667+00:00

I am still having the same difficulties. The FAQ provided only shows the regular field mappings, but if I want to include additional field mappings (not necessarily for content, but as metadata) I am seem to be at a loss.

Just FYI I am using my own code for OpenAI with my own data, but I am using the Azure OpenAI API.
Sign in to comment

Use comments to ask for clarification, additional information, or improvements to the question.
Deleted

This answer has been deleted due to a violation of our Code of Conduct. The answer was manually reported or identified through automated detection before action was taken. Please refer to our Code of Conduct for more information.
2 deleted comments

Comments have been turned off. Learn more

Share via

Adding more fields to retrieve via Azure OpenAI API

2 answers

Your answer