Are the parameters inside the model invariant if the GPT-3.5 version is the same?

Question

Are the parameters inside the model invariant if the GPT-3.5 version is the same?

Yupeng 40

Dear Azure OpenAI Service Team.

I am considering using GPT-3.5.

I want the output of the models to be the same as long as the inputs are the same.

Is there any information that the internal parameters of a certain version of the GPT-3.5 model have been the same since the start of the service?

romungi-MSFT 48,911 Reputation points Microsoft Employee Moderator

2023-05-12T11:00:22.77+00:00
@Yupeng I think your question is similar to this one. Shorter prompts are cheaper and faster. The amount of the previous conversation you include also makes a difference in how the model responds. There are two options in this scenario:

Option 1: Keep the conversation within a given token limit

Option 2: Keep the conversation within a given number of turns

The sample notebook provides an example of using both these scenarios. Could you check if this works for your setup?
Yupeng 40 Reputation points

2023-05-15T04:40:07.6166667+00:00

I apologize for making my question confusing.

My question is whether it will happen in the future that a silent update is performed inside the model and changes the output results, even though the version description of the model remains the same.
romungi-MSFT 48,911 Reputation points Microsoft Employee Moderator

2023-05-25T08:36:59.06+00:00

@Yupeng Did the below answer help answer your query?

Accepted answer

0 additional answers

Your answer

romungi-MSFT 48,911 Reputation points Microsoft Employee Moderator

2023-05-12T11:00:22.77+00:00

@Yupeng I think your question is similar to this one. Shorter prompts are cheaper and faster. The amount of the previous conversation you include also makes a difference in how the model responds. There are two options in this scenario:

Option 1: Keep the conversation within a given token limit

Option 2: Keep the conversation within a given number of turns

The sample notebook provides an example of using both these scenarios. Could you check if this works for your setup?
Yupeng 40 Reputation points

2023-05-15T04:40:07.6166667+00:00

I apologize for making my question confusing.

My question is whether it will happen in the future that a silent update is performed inside the model and changes the output results, even though the version description of the model remains the same.
romungi-MSFT 48,911 Reputation points Microsoft Employee Moderator

2023-05-25T08:36:59.06+00:00

@Yupeng Did the below answer help answer your query?

Answer 1

romungi-MSFT 48,911 Microsoft Employee Moderator

@Yupeng I think the training data of the model could change but the versioning of the model should allow you to keep using the same model unless you want to upgrade your model to use results from latest training data. See the models page for details on training data that times that were used with current models.

If this answers your query, do click Accept Answer and Yes for was this answer helpful. And, if you have any further query do let us know.

Share via

Are the parameters inside the model invariant if the GPT-3.5 version is the same?

0 additional answers

Your answer