Availability of OpenAI's "seed" parameter in Azure

Jai-6363 245 Reputation points
2023-11-20T10:03:10.2933333+00:00

Is the "seed" parameter supported in Azure OpenAI? I want to reduce the randomness of responses to the same prompt/configuration and found that OpenAI has a "seed" parameter that can help by using the same integer. However, our API documentation does not mention this parameter. Can someone confirm whether it's supported or not?

Azure OpenAI Service
Azure OpenAI Service
An Azure service that provides access to OpenAI’s GPT-3 models with enterprise capabilities.
4,101 questions
Azure AI services
Azure AI services
A group of Azure services, SDKs, and APIs designed to make apps more intelligent, engaging, and discoverable.
3,632 questions
0 comments No comments
{count} votes

3 answers

Sort by: Most helpful
  1. Azar 29,520 Reputation points MVP Volunteer Moderator
    2023-11-20T10:19:52.3833333+00:00

    Hi Jai-6363

    I guess the seed parameter is not supported in OpenAI, and for more info on this follow the below link and keep updated on this via documentation as you are.

    https://platform.openai.com/docs/introduction

    If you find this helpful kindly accept the answer thanks much.

    0 comments No comments

  2. Ramr-msft 17,826 Reputation points
    2023-11-20T10:54:06.5633333+00:00

    By default if you ask an Azure OpenAI Chat Completion model the same question multiple times you are likely to get a different response. The responses are therefore considered to be non-deterministic. Reproducible output is a new preview feature that allows you to selectively change the default behavior towards producing more deterministic outputs.

    Reproducible output support:

    Reproducible output is only currently supported with the following:

    Supported models

    • gpt-4-1106-preview
    • gpt-35-turbo-1106

    API Version

    • 2023-12-01-preview

    Here is the document that could help.

    0 comments No comments

  3. Saurabh Sharma 23,851 Reputation points Microsoft Employee Moderator
    2023-11-20T15:27:54.6533333+00:00

    Hi @Jai-6363

    Welcome to Microsoft Q&A! Thanks for posting the question.

    The seed parameter you are looking for is available in gpt-35-turbo-1106 and in the newly announced GPT-4-Turbo (gpt-4-1106-preview) model.

    • gpt-4-1106-preview is currently available for all customers in the below regions -

    User's image

    Please refer to how to use reproducible output (preview) documentation for details

    Thanks

    Saurabh


    Please 'Accept as answer' and Upvote if it helped so that it can help others in the community looking for help on similar topics.


Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.