Azure OpenAI Webapp: There was an error generating a response. Chat history can't be saved at this time. Error code: 400

Fabian Bruenger 10

I set up a new Azure Open AI Chat GPT Model 4 instance and chose to enable the website feature.

When I select: Store history, the webapp is not working:

There was an error generating a response. Chat history can't be saved at this time. Error code: 400

navba-MSFT 24,985 Reputation points Microsoft Employee

2024-07-30T07:46:37.8766667+00:00
@Fabian Bruenger Welcome to Microsoft Q&A Forum, Thank you for posting your query here!

.

Questions:

Please confirm the model version, Is it GPT 4 or GPT 4 with Vision or GPT4o ?

Is this a new setup ? Or was this working fine earlier and started to fail recently ?

.
Plan 1:

To enable chat history, you will need to set up CosmosDB resources. This will be used to deploy an app service and a CosmosDB with the database and container configured. Then specify these additional environment variables:

AZURE_COSMOSDB_ACCOUNT

AZURE_COSMOSDB_DATABASE

AZURE_COSMOSDB_CONVERSATIONS_CONTAINER

AZURE_COSMOSDB_ACCOUNT_KEY

Ensure that you have the above keys within the AppSettings of Azure WebApp as shown below:

Plan 2:

While reproducing the issue, go to the Browser Developer Tools by clicking F12 --> Console Tab and check if any errors:

Plan 3:

Ensure that the CORS setting is enabled for your Azure Web App with * (Asterisk) as the Allowed Origin as shown below:

Plan 4:

If none of the above helps, please collect the browser HAR traces and share it via the private message.

Awaiting your reply.
navba-MSFT 24,985 Reputation points Microsoft Employee

2024-08-05T02:34:13.07+00:00

@Fabian Bruenger Just following up to check if my suggestion helped. Please let me know if you have any further queries. I would be happy to help.
Fabian Bruenger 10 Reputation points

2024-08-05T09:26:44.67+00:00

Hi,

I will try your solutions. But I honestly have to say that I forked the repo of the App and build a Docker container to run a Container Instance. For me this works better since I encountered errors even without the history being saved.

It is a new set up and I tried with all the models: gpt-4, gpt4o and gpt-3

I will come back to you once my set up is fine.
navba-MSFT 24,985 Reputation points Microsoft Employee

2024-08-05T10:29:30.86+00:00

@Fabian Bruenger Thanks for the update.
Drese, Max 0 Reputation points

2024-09-05T08:24:00.6366667+00:00
Hi,

I have the same issue as above. i tried you solution by setting the env variables and adding CORS. but i still get the error

There was an error generating a response. Chat history can't be saved at this time. Error code: 400 - {'error': {'requestid': '66a419b4-ff6c-472f-8540-d5a348f49fc6', 'code': 400, 'message': 'Failed to get managed identity token. Response: {"error":{"code":"ManagedIdentityIsNotEnabled","message":"Managed Identity (MI) is not set for this account while the encryption key source is 'Microsoft.KeyVault', customer managed storage or Network Security Perimeter is used."}}'}}

When i look into developer tools on the webpage i see that the error is coming from this code

const response = await fetch('/history/generate', {

method: 'POST', headers: { 'Content-Type': 'application/json' }, body: body, signal: abortSignal

})

any help?
Drese, Max 0 Reputation points

2024-09-05T08:27:05.29+00:00
Helle i have the same issue. I added the env variables and added CORS, but still get this error

There was an error generating a response. Chat history can't be saved at this time. Error code: 400 - {'error': {'requestid': '0a804bcd-6662-4022-a1e4-5f9b2692fd10', 'code': 400, 'message': 'Failed to get managed identity token. Response: {"error":{"code":"ManagedIdentityIsNotEnabled","message":"Managed Identity (MI) is not set for this account while the encryption key source is 'Microsoft.KeyVault', customer managed storage or Network Security Perimeter is used."}}'}}

When i open the developer tools the error points to this piece of code in api.ts

const response = await fetch('/history/generate', {

method: 'POST', headers: { 'Content-Type': 'application/json' }, body: body, signal: abortSignal

})

any help??

Share via

Azure OpenAI Webapp: There was an error generating a response. Chat history can't be saved at this time. Error code: 400

Your answer