Bringing My Own Data, Handful of Documents, I would like to be able to query information from specific documents individually - Any Ideas?

Question

Bringing My Own Data, Handful of Documents, I would like to be able to query information from specific documents individually - Any Ideas?

Nate York 35

Greetings!

I am bringing in my own data, multiple documents in this case, and I would like to be able to ask questions about the data in each document separately.

For instance 'in document 1, what is the country the sender is located in'

So far I have been unable to query specifics from each individual document

One way around this is to feed the entire document text in the API call, one at a time and prompt that data, but it is very token heavy.

Any insight is appreciated!

romungi-MSFT 48,786 Reputation points Microsoft Employee

2023-08-22T10:05:16.74+00:00
@Nate York Did you try to check for citations when a query is passed? Enabling semantic search while using the index should help provide a better response and citation. If you are using an existing index, there is an option to set the content, URL, title and file path in the data mapping column screen. If this is set to the correct fields from your index, the model will provide a better citation and a relevant response from a document used in the index.

Once, this is set the request should also contain the optional fieldsMapping parameter as part of dataSources to provide better response and citation. This will still not completely ensure you can get a response from a single document as OpenAI will still limit your response to the data on the index which is from several documents.

For the above mapping scenario, the request field for fieldsMapping should be:

"fieldsMapping":{ "titleField":"title", "urlField":"url", "filepathField":"filepath", "contentFields":[ "content", "merged_content" ], "contentFieldsSeparator":"\n" }

I hope this helps!!

Your answer

romungi-MSFT 48,786 Reputation points Microsoft Employee

2023-08-22T10:05:16.74+00:00

@Nate York Did you try to check for citations when a query is passed? Enabling semantic search while using the index should help provide a better response and citation. If you are using an existing index, there is an option to set the content, URL, title and file path in the data mapping column screen. If this is set to the correct fields from your index, the model will provide a better citation and a relevant response from a document used in the index.

Once, this is set the request should also contain the optional fieldsMapping parameter as part of dataSources to provide better response and citation. This will still not completely ensure you can get a response from a single document as OpenAI will still limit your response to the data on the index which is from several documents.

For the above mapping scenario, the request field for fieldsMapping should be:

"fieldsMapping":{ "titleField":"title", "urlField":"url", "filepathField":"filepath", "contentFields":[ "content", "merged_content" ], "contentFieldsSeparator":"\n" }

I hope this helps!!

Share via

Bringing My Own Data, Handful of Documents, I would like to be able to query information from specific documents individually - Any Ideas?

Your answer