Azure AI Search
An Azure search service with built-in artificial intelligence capabilities that enrich information to help identify and explore relevant content at scale.
1,342 questions
Azure OpenAI does not pass document meta data to OpenAI
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(233.6, 38%, 32%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EAM%3C/text%3E%3C/svg%3E)
Andrew Murphy
0
Reputation points
I am starting to use the OpenAI interface with my own data. As a data source, I am using a SQL database that sits on top of Azure Search service. I was getting poor results of my data when chatting. My data is a movie database with rich columns like title, keywords, crew, revenue, rating and more. However, when OpenAI receives it, it has no knowledge of those fields. See the chat response here. When I asked what fields were available in the retrieved documents it replied title and content only. This makes sense when I ask things like what is highest rated film it does not have any awareness of that rating field. It appears to be whatever columns you select for the index data field mapping, it just passes that right through without any of the column/meta data. So what should I do? I could put the column name ("ex. Rating:") as a prefix in the database values themselves? Anything else I can do to pass some of that rich meta-data over to OpenAI? Thanks much
Azure AI Search
Azure OpenAI Service
Azure OpenAI Service
An Azure service that provides access to OpenAI’s GPT-3 models with enterprise capabilities.
4,082 questions
Azure AI services
Azure AI services
A group of Azure services, SDKs, and APIs designed to make apps more intelligent, engaging, and discoverable.
3,603 questions
{count} votes
-
romungi-MSFT 48,906 Reputation points Microsoft Employee Moderator2024-02-07T11:21:59.7+00:00 @Andrew Murphy Did you try semantic or hybrid search option instead of keyword search? If you are looking at better citation in the response, The field mapped to File name generates the citation names in the response. Thanks!!
-
Andrew Murphy 0 Reputation points
2024-02-07T12:47:08.0766667+00:00 @romungi-MSFT yes, I did try the semantic search. The issue is the field names (example budget) from my dataset are not getting passed to OpenAI. So it just sees the number but not the label that tells it that number is a budget. So it doesn't know what the number is supposed to represent. But I did an experiment where I added the column name inside the data column itself (see picture) and it did help. But it still seems like a flaw that it doesn't pass any of that structure over to OpenAI when it is in the data source? Would it be better to output files with JSON or something to ensure the structure is available to Open AI?
-
romungi-MSFT 48,906 Reputation points Microsoft Employee Moderator
2024-02-13T04:25:35.8566667+00:00 @Andrew Murphy I think the information available to OpenAI depends on how the search service index is built. The supported file formats if you plan to use web address or URL as input for data source are the following. Even in this scenario, the documents are processed and the data is indexed on Azure search.
-
Andrew Murphy 0 Reputation points
2024-02-13T13:49:14.8+00:00 I have had some luck but have had to trick the search service to not treat the input as JSON but rather just text. So then the full meta data is available to Open AI - as the tags are embedded in the data itself. But this still seems like a flaw in how it works. It seems there there should be an option to somehow pass the metadata (even just the field names from the index) over to Open AI from the data source?
Sign in to comment
Sign in to answer