Really bad errors on GPT-4 response

Question

Hi everybody,

we are working on developing a chatbot application using GPT-4. Our application runs in Javascript and the endpoint we are calling is the following: https://france-gpt4.openai.azure.com/openai/deployments/gpt-4/chat/completions?api-version=2023-03-15-preview (we are based in the region on france central).

The big problem is that from time to time we receive really bad responses from the model. Here some examples:

dep dep dep dep dep Entire dep dep dep dep dep Entire dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep Entire dep dep dep Entire dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep dep

premature TB CST TB CST TB premature TB TB TB TB CST premature CST premature CST TB premature Minimal premature TB prematurea premature revision premature premature premature premature premature premature premature premature CST premature premature premature premature replay premature premature premature premature premature premature premature premature premature premature premature premature premature premature premature premature premature premature premature premature premature premature Minimal premature prematurea replay premature premature premature premature premature premature premature premature premature premature premature premature Travis premature premature premature premature premature premature premature premature premature premature premature premature premature premature premature premature premature Travis premature premature premature premature premature premature replay premature premature premature replay premature Travis premature premature premature premature premature replay premature premature premature premature premature premature premature premature premature premature premature premature premature premature premature premature premature replay REV premature premature premature premature Travis premature premature premature premature premature premature premature premature premature premature premature premature premature premature premature premature premature premature premature premature premature premature premature premature premature premature premature premature premature premature premature premature premature premature premature premature Travis premature premature prematurea premature premature premature premature premature premature premature premature premature premature premature premature premature premature TB premature CST premature Travis premature Minimal premature premature premature premature premature premature premature premature premature premature premature premature premature replay premature premature premature premature premature premature premature premature premature premature premature premature premature premature premature premature premature premature premature premature premature premature CST premature premature premature premature premature premature premature premature premature premature premature premature premature premature premature premature premature premature premature premature premature Travis premature premature premature premature Travis premature premature premature Minimal premature premature premature premature premature premature premature premature premature premature premature premature premature premature premature premature premature premature premature premature premature Travis premature premature premature premature premature premature premature premature Travis premature premature premature premature premature replay premature premature premature premature premature premature premature Minimal TB premature premature premature premature premature premature premature premature Minimal premature premature premature premature premature Minimal premature premature premature premature premature premature Minimal premature premature premature premature premature premature premature Minimal premature premature scripted premature premature premature premature premature premature premature premature premature premature premature premature premature replay premature premature premature premature premature premature premature premature premature Minimal premature premature premature premature premature premature premature premature premature premature premature premature premature premature premature premature premature premature premature premature Minimal premature premature premature premature Travis premature premature premature premature premature premature premature premature premature premature prematurea TB premature Minimal premature premature Minimal premature premature Travis premature premature premature premature premature premature premature premature premature premature premature premature Minimal premature premature Minimal premature premature premature Minimal premature Minimal Minimal premature premature premature premature premature premature premature premature Minimal premature Minimal Minimal premature premature premature premature premature premature premature Minimal premature premature premature Minimal premature premature premature premature premature Minimal premature premature premature premature Minimal Minimal premature REV premature premature premature premature premature premature premature premature premature premature premature scripted premature premature premature premature premature premature premature premature premature premature Minimal premature premature premature premature premature premature premature premature premature premature premature premature premature premature Rev premature premature premature premature premature TB premature premature premature premature premature premature premature premature premature premature premature premature premature premature premature premature premature premature premature premature Travis premature premature premature premature premature premature premature premature premature premature premature premature CST premature CST premature TB TB CST premature premature revision premature TB TB TB TB TB premature CST CST CST premature CST TB premature CST CST CST CST premature TB TB premature premature TB TB CST TB CST TB CST premature replay

The problem is not easy to replicate and happens from time to time in a random way apparently, but it is really annoying because we can not use the chatbot like this.

How can it be solved?

Answer 1

@Alberto Prospero The api version 2023-05-15 is in GA, you can use the same. I could see you are using the preview version.