Azure GPT3.5 Turbo model replies are very different than OpenAI gpt-3.5-turbo

Itai Marks 25 Reputation points
2023-05-08T09:13:01.79+00:00

Hi,

We noticed that the results of the Azure deployed gpt-35-turbo-v0301 model diverge substantially from OpenAI gpt-3.5-turbo-0301.

These are not minor differences, for the same prompt and parameters results are completely different. The Azure deployment is much less predictable, does not follow instructions, seems like an essentially different model.

Could this be an issue with our specific organization deployed version or is it a known issue?

Azure OpenAI Service
Azure OpenAI Service
An Azure service that provides access to OpenAI’s GPT-3 models with enterprise capabilities.
4,101 questions
0 comments No comments
{count} votes

3 answers

Sort by: Most helpful
  1. Ramr-msft 17,826 Reputation points
    2023-05-08T16:01:01.23+00:00

    @Itai Marks Thanks for the question, The Azure Open AI gpt-35-turbo is equivalent to the gpt-3.5-turbo model from OpenAI. Can you check the parameters difference if any, Here is the document for the ChatGPT.

    1 person found this answer helpful.

  2. ben rigby 30 Reputation points
    2023-11-03T04:41:49.17+00:00

    im seeing the same thing, esp for function calling. just a radically different response from azure for the same prompt. and a ton of hallucination.


  3. Baptiste Cumin 0 Reputation points
    2024-03-29T11:31:07.3766667+00:00

    I've found the same thing here, specifically function calling is just unusable in Azure OpenAI. These are not equivalent models, or the function calling must be stuffed into the system prompt of Open AI's API.

    0 comments No comments

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.