Azure OpenAI Chat on own data - different results Studio vs REST API

Dennis 5 Reputation points


I've been using the Azure OpenAI with "own data" through the REST API as outlined in the Azure OpenAI documentation. When I compare responses to the same question between what I receive in the Azure AI Studio and what I obtain via the REST API, there's a discrepancy. For instance, the response from the REST API to a specific question is: "The retrieved documents do not provide information on why XXX products are expensive." However, for the same question in Azure AI Studio, I get a satisfactory result. I've noticed numerous such instances where the outcomes differ. Do you have any suggestions on what might be causing this?

Thank you in advance.

Kind regards

Azure OpenAI Service
Azure OpenAI Service
An Azure service that provides access to OpenAI’s GPT-3 models with enterprise capabilities.
1,018 questions
{count} vote