An Azure service that provides access to OpenAI’s GPT-3 models with enterprise capabilities.
Hello Jordan Lesson,
Welcome to Microsoft Q&A and Thank you for reaching out.
I understand that you have strong privacy and compliance requirements, and you’re trying to understand whether Azure OpenAI can support a zero-data-retention model and how to formally engage Microsoft if exceptions or confirmations are needed. Here’s the best, accurate, and realistic answer, merging all the points and aligning with Microsoft’s current position.
Azure OpenAI & Zero Data Retention – What’s Possible Today
- Default Azure OpenAI data handling (important baseline)
By default, Azure OpenAI:
Does NOT use your prompts or completions to train models
Temporarily retains prompts and completions for up to 30 days
Purpose: abuse monitoring, debugging, and service reliability
Soft-delete window: up to 48 hours after deletion before permanent purge
This behavior is standard and documented, even for sensitive workloads.
- Is a “Zero Data Retention” plan available?
No public, self-service “zero data retention” plan exists today for Azure OpenAI.
However:
Azure OpenAI already operates in a “no training, limited retention” mode
Retention is service-side and not customer-accessible
Microsoft does not provide a toggle to reduce retention below the documented window
That said, large enterprise customers may receive:
Formal data-handling attestations
Contractual clarifications via Microsoft Legal / Account Teams
Documented assurances aligned to internal compliance needs
This requires direct engagement, not portal configuration.
- What you can do today to achieve “practical zero retention”
Even without a special plan, many regulated customers operate safely by design:
Application-side controls (critical)
Ensure no prompts, completions, or embeddings are logged in:
- application logs
- telemetry
- request tracing
Keep all sensitive content in-memory only
Avoid storing:
- raw prompts
- raw model outputs
Immediately discard responses after downstream processing
Platform security controls
Use:
- Private Endpoints
- VNET integration
- Managed Identity
Disable diagnostic logs for payload content
Apply RBAC and least-privilege access
Optional data minimization
Mask or tokenize PII before sending prompts
Avoid sending original documents when summaries suffice
This is how many finance, healthcare, and legal platforms meet internal privacy policies today.
- DLP and compliance alignment
While Azure OpenAI itself doesn’t expose fine-grained DLP switches:
You can integrate Azure Purview / Microsoft Purview
Enforce DLP at:
- storage
- ingress/egress
- logging pipelines
Combine with:
- Customer-managed keys (CMK)
- Private networking
- How to formally engage Microsoft for zero-retention assurances
Since this is not a portal feature, you must go through human channels:
Ask for:
“Formal clarification or contractual assurances regarding Azure OpenAI data retention for a production system processing PII.”
If you have:
- paid support
- meaningful Azure spend
- production workloads
this will route to the right internal team, not Q&A.
Please reach out to support team,
Go to Azure Portal
- Search for “Help + support”
Open Support plans
Look for:
Account Manager
*Customer Success Manager*
*Technical Account Manager*
If listed, that is your direct Microsoft contact.
I Hope this helps. Do let me know if you have any further queries.
Thank you!