Share via

Open AI inconsistent performance

Sakib Ali Choudhary 225 Reputation points
2023-11-24T04:04:14.7766667+00:00

Hi,
I am using open ai service for quite a long time and it was very promising but recently since one month it is not behaving and responding as it should be. We are assuming that there might be some issue from your side as the production application which was built with open ai a long time back is not preforming the same as it was before.
We would like to hear your opinion and will appreciate your quick response.

Thanks

Azure OpenAI Service
Azure OpenAI Service
An Azure service that provides access to OpenAI’s GPT-3 models with enterprise capabilities.
4,081 questions
Accepted answer
  1. Ramr-msft 17,826 Reputation points
    2023-11-26T14:25:04.8433333+00:00

    Thanks for the question, It now works in AOAI through SDK with the latest v1106 models:https://learn.microsoft.com/en-us/azure/ai-services/openai/how-to/reproducible-output

    New seed indeed helps to reproduce the same output (although with some occasional differences).

    Generating reproducible output in GPT-4-Turbo v1106 with the "seed" parameter in Python SDK v1.x

    Here is the repo for the same.

    0 comments

0 additional answers

Sort by: Most helpful
Most helpful Newest Oldest

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.