Azure OpenAI limiting the search/answer on only 5 documents

Cezar Pimentel 66 Reputation points
2024-07-01T02:52:42.06+00:00

I'm testing Azure OpenAI Studio to check if it would be a possible tool to use on a project.

The problem is, I added my own movie data (100 documents), and when I prompt (for an instance)
"How many movies do you have in your knowledge base?"

It replies answering it knows/has only 5 documents.

Why is this happening? How do I tell it to use all documents instead of only 5?

Thanks in advanceUser's image

Azure AI Search
Azure AI Search
An Azure search service with built-in artificial intelligence capabilities that enrich information to help identify and explore relevant content at scale.
859 questions
Azure OpenAI Service
Azure OpenAI Service
An Azure service that provides access to OpenAI’s GPT-3 models with enterprise capabilities.
2,612 questions
0 comments No comments
{count} votes

2 answers

Sort by: Most helpful
  1. Sam Cogan 10,342 Reputation points MVP
    2024-07-01T07:27:54.8766667+00:00

    The way bring your own data works, means that the AI doesn't know how many movies it has in it's database, so it can't tell you. When you use bring your own data the process to query it looks like this:

    • You enter your question in the UI
    • Your data is searched for relevant answers to the questions you have asked
    • The results of the search are sent to the AI, along with your question and it provides an answer based on this data only

    So the AI only has access to data that was retrieved from your data store, that is relevant to the question "how many movies do you have in your knowledge based". The actual search that occurs is just looking for data relevant to this in you data, it is not counting your items. The AI is probably getting 5 relevant pieces of data back, and so that is what it knows about.


  2. Cezar Pimentel 66 Reputation points
    2024-07-10T01:31:28.47+00:00

    Anyone? I really could use some help. ☹️

    0 comments No comments