Azure OpenAI Service
An Azure service that provides access to OpenAI’s GPT-3 models with enterprise capabilities.
1,018 questions
Azure OpenAI Chat on own data - different results Studio vs REST API
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(281.6, 87%, 37%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ED%3C/text%3E%3C/svg%3E)
Dennis
5
Reputation points
Hi
I've been using the Azure OpenAI with "own data" through the REST API as outlined in the Azure OpenAI documentation. When I compare responses to the same question between what I receive in the Azure AI Studio and what I obtain via the REST API, there's a discrepancy. For instance, the response from the REST API to a specific question is: "The retrieved documents do not provide information on why XXX products are expensive." However, for the same question in Azure AI Studio, I get a satisfactory result. I've noticed numerous such instances where the outcomes differ. Do you have any suggestions on what might be causing this?
Thank you in advance.
Kind regards
Dennis
{count} vote
-
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(22.400000000000002, 11%, 12%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ERM%3C/text%3E%3C/svg%3E)
-
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(137.6, 32%, 23%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EMG%3C/text%3E%3C/svg%3E)
Miguel Gomes 0 Reputation points2023-09-15T14:17:12.2166667+00:00 Hi!
I'm having the same exact behavior on my subscription and I'm using Open AI since march/april.
I'm also seeing that discrepancy on the Search Service, whereas on the portal I get a good set of results and when using the Azure.Search.Documents.SearchClient I dont receive the same results even using the same query.
For the OpenAI client I'm using the Completions SDK Azure.AI.OpenAI.ChatCompletions and when comparing the results I get from Azure OpenAI Studio they aren't the same, even with the same exact prompt and parameters.
Thank you.
Miguel
-
Miguel Gomes 0 Reputation points
2023-09-15T14:22:25.1833333+00:00 Hi,
I'm having the same exact behavior not only with OpenAI Studio but with other services like Azure Search Service.
I noticed that I'm not getting the same results from Azure.Search.Documents.SearchClient that I get when I use the portal to try the query.
On the OpenAI I have the same issue since I'm using Azure.AI.OpenAI.ChatCompletions and I'm not getting the same results I get on the Azure OpenAI Studio portal even with the same prompt and parameters.
Thank you.
Miguel
-
Dennis 5 Reputation points
2023-09-18T08:26:25.0666667+00:00 Hi @Ramr-msft I am using following Services and Regions:
- Azure OpenAI - East US
- Search Service - West US
- Storage Account - West Europe
The Model is gpt-35-turbo based on the Version 0301
-
Ramr-msft 14,506 Reputation points
2023-09-18T08:35:10.81+00:00 @Dennis Thanks, The gpt-35-turbo model is GA, the Completions endpoint is still in preview. We recommend using the ChatCompletions endpoint, as it is GA. You can try with the gpt-35-turbo-16k as given here.
-
Dennis 5 Reputation points
2023-09-18T09:30:01.34+00:00 Thanks @Ramr-msft
Does this mean that the API version "2023-06-01-preview" is not functioning as expected? I've been using this endpoint: "$AOAIEndpoint/openai/deployments/$AOAIDeploymentId/extensions/chat/completions?api-version=2023-06-01-preview" to construct a website search based on my own data. My use case isn't limited to just chat completion, but rather an extended search on my data where users can also view the citations. Here's the relevant documentation: https://learn.microsoft.com/en-us/azure/ai-services/openai/use-your-data-quickstart?pivots=rest-api&tabs=command-line#example-curl-commands.Could you provide more insight into this?
-
Sign in to comment