Azure OpenAI - Bringing my own data, does the Scoring Profile have an effect on the chat completion?

Question

Using the playground, Bringing my own data and using a Cognitive Search Index.

Do the Weights in the index's scoring profile have an effect as to the chat completions or data available to the chat completion? For instance, if a field has a low weight would the chat completion take that into consideration? Thanks!

Answer 1

Hi @Nate York
Welcome to Microsoft Q&A! Thanks for posting the question.

As per my understanding, the weights in the index’s scoring profile do have an effect on the chat completions or data available to the chat completion. The weights determine how much each field contributes to the overall relevance score of a document. A higher weight means that the field is more important for ranking the documents. A lower weight means that the field is less important for ranking the documents.

So, when you are using a search index with an existing scoring profile then it will affect results based on the scoring profile. For example, if you have a field called “title” with a weight of 5 and a field called “description” with a weight of 1, then a document that matches the query term in the title field will have a higher score than a document that matches the query term in the description field. This means that the chat completion will be more likely to use the title field as a source of information or suggestion than the description field. However, Azure OpenAI playground does not create a scoring profile for your index. Hope this helps. Thanks Saurabh