Why do I get different results every time I run the same query?

Question

Why do I get different results every time I run the same query?

Terry Matthews 0

I created a model, I'm passing info as role: system and user...

But it seems like it randomly picks and chooses the System content and as a result I get back different responses each time I run the same question?? I'm using 3.5 turbo.

romungi-MSFT 48,916 Reputation points Microsoft Employee Moderator

2023-05-05T11:46:53.0033333+00:00
@Anonymous I think the amount of the previous conversation you include also makes a difference in how the model responds, this sample notebook addresses this scenario with two options.

Option 1: Keep the conversation within a given token limit

Option 2: Keep the conversation within a given number of turns

I think the second option should help to achieve the consistency you are looking for. Could you try and check if this works?

Your answer

romungi-MSFT 48,916 Reputation points Microsoft Employee Moderator

2023-05-05T11:46:53.0033333+00:00

@Anonymous I think the amount of the previous conversation you include also makes a difference in how the model responds, this sample notebook addresses this scenario with two options.

Option 1: Keep the conversation within a given token limit

Option 2: Keep the conversation within a given number of turns

I think the second option should help to achieve the consistency you are looking for. Could you try and check if this works?

Share via

Why do I get different results every time I run the same query?

Your answer