Azure OpenAI Responses API - conversation storage

Akundy, Vyas 120 Reputation points
2025-10-16T19:22:30.1933333+00:00

Hi Team,

Regarding the suggestions here https://learn.microsoft.com/en-us/azure/ai-foundry/openai/api-version-lifecycle?tabs=python#api-evolution around moving towards the Responses AI and also the documentation around it I see that it is able to maintain the conversation state by just providing the "previous_response_id" as a parameter to the client.responses.create() call.

My question is where are these conversations being stored since we are no longer maintaining it on our side? Can we get access to where they are being stored if they are being help in any Azure Blob storage? OpenAI does mention in their documentation that they retain it for 30 days. Since we use the Azure OpenAI endpoint I wanted to know where the conversations are being stored inside Azure since we are only using an ID to track it.

Azure OpenAI in Foundry Models

Answer accepted by question author
Anshika Varshney 15,535 Reputation points Microsoft External Staff Moderator
2025-10-17T19:48:27.7433333+00:00

As a Solution Architect, understanding the storage flow is crucial for aligning with internal compliance documentation and architectural standards.

When utilizing the Azure OpenAI Responses API, all conversation data, including user inputs, model outputs, and intermediate tool results, is temporarily stored within Azure's infrastructure to maintain conversational context. This data is retained for up to 30 days by default, primarily for monitoring and abuse detection purposes. Microsoft Learn

Key Points:

Data Retention: By default, response data is retained for 30 days. You can delete specific responses using the response.delete("{response_id}") method. Microsoft Learn

Data Storage Location: The exact storage location (e.g., Azure Blob Storage or another internal system) is not publicly detailed for security and compliance reasons.

Compliance and Security: Azure adheres to strict compliance and security standards, ensuring that data is handled responsibly. Microsoft Learn

Troubleshooting and Further Information:

For more detailed information on data handling, privacy, and security within Azure OpenAI, you can refer to the following resources:

Data, privacy, and security for Azure OpenAI Service

Azure OpenAI Responses API Documentation

If you require assistance in replicating this issue or need further clarification, please provide more details about your specific use case, and I'll be glad to assist you further.

Was this answer helpful?

1 person found this answer helpful.

0 additional answers

Sort by: Most helpful

Your answer

Answers can be marked as 'Accepted' by the question author and 'Recommended' by moderators, which helps users know the answer solved the author's problem.