How does the ChatGPT api act behind the parameter "past messages included"?

Iris Wu 10

I noticed that there is a setting named 'past messages included' in Azure OpenAI Studio ChatGPT playground, but didn't find any documentation on how it works.

Could you please explain the underneath logic of this setting? How is the past message included when sent to GPT?

Thanks.

YutongTie-MSFT 52,596 Reputation points

2023-05-11T01:22:03.6+00:00

Hello @Iris Wu

Thanks for reaching out to us.

Past messages included setting is -

Select the number of past messages to include in each new API request. This helps give the model context for new user queries. Setting this number to 10 will include 5 user queries and 5 system responses.

This is a previous feature so the document has not included it. I will contact content team input more introduce for it.

Regards,

Yutong
Iris Wu 10 Reputation points

2023-05-11T01:37:49.6266667+00:00

Hi @YutongTie-MSFT , thanks for the reply.

Sorry I didn't make myself clear. Actually, I would like to know how you give the model context in new queries, as the official OpenAI API does not provide any relevant parameters to control this.

1 answer

Rpoon@abrs.edu.hk (PrgDirector) 1 Reputation point

2023-07-14T16:27:02.9133333+00:00

I guess it is like every time you ask/talk, for up to how long ago you want Chat GPT to refer to the history: every human has a limit, and for machine AI, what is the context (other than your latest question as input).

the longer you request, the higher the overhead, but probably the highest accuracy - but could be some drawback - as human sometimes want to forget the past and move forward.

Anyway, like the "context" + "new input" to your new programming command for the algorithm to recompute
Please sign in to rate this answer.
Hossna Gharaee 0 Reputation points

2024-06-20T18:02:35.2533333+00:00

Like a memory?
Sign in to comment

Use comments to ask for clarification, additional information, or improvements to the question.

Share via

How does the ChatGPT api act behind the parameter "past messages included"?

1 answer

Your answer