An Azure service that provides access to OpenAI’s GPT-3 models with enterprise capabilities.
Hello Antti Varis,
Welcome to Microsoft Q&A and Thank you for reaching out.
I understand that you're dealing with some important concerns regarding data protection for your AI tool in the healthcare sector. Also, I understand that the lack of clarity on data storage duration for Abuse Monitoring can be a worry for your customers.
Here is the Summary,
Azure OpenAI Direct Models do not use your data to train or improve foundation models without explicit consent.
Data may be processed as part of abuse monitoring to ensure service safety and compliance.
Prompts and completions that may be associated with policy violations can be retained temporarily for monitoring and investigation purposes.
For deployments in Sweden Central and West Europe (Data Zone Standard – EUR), data processing and any human review occur within the European boundary (EEA).
Organizations with stricter requirements may explore the modified abuse monitoring option.
Explanation
Model Training and Data Usage
Customer data (prompts and completions):
Is not used to train or improve OpenAI or Microsoft foundation models.
Remains within the Azure enterprise compliance boundary.
Is handled according to Microsoft’s Product Terms and Data Protection Addendum.
This is especially important for healthcare and medical device software scenarios.
Abuse Monitoring – Why It Exists
Abuse monitoring is a safety mechanism designed to:
Detect misuse of the service
Identify policy-violating or harmful content
Protect platform integrity and other customers
This monitoring is separate from model training.
Abuse Monitoring Data Retention
Previously, documentation referenced “up to 30 days.” While that specific wording has been updated or removed, the general principle remains:
Prompts and completions that may align with abusive behavior can be retained for a limited period for monitoring and investigation.
Retention is governed by Microsoft’s internal compliance policies and Azure contractual commitments.
Data is retained only as long as necessary for abuse detection, investigation, and service protection purposes.
For formal and legally binding commitments, customers should rely on:
- Microsoft Product Terms
- Azure OpenAI documentation
- The Data Protection Addendum (DPA)
Human Review Location
For models deployed in:
Sweden Central
West Europe
Data Zone Standard (EUR)
Any human reviewers analyzing flagged content are located within the European Economic Area (EEA).
This helps address regional data residency and GDPR concerns.
Modified Abuse Monitoring Option
If your customers have stricter regulatory or data handling requirements, you can inform them that:
Microsoft offers a modified abuse monitoring option.
This can further limit how data is handled within the abuse monitoring process.
It is typically enabled through engagement with Microsoft and subject to approval.
For highly regulated healthcare environments, this option is often worth discussing with your Microsoft account team.
Our Azure OpenAI deployments in Sweden Central and West Europe operate within the European data zone. Customer prompts and responses are not used to train or improve foundation models. Data may be processed and temporarily retained as part of Microsoft’s abuse monitoring and safety mechanisms, in accordance with Azure Product Terms and enterprise compliance commitments. Any human review associated with flagged content occurs within the EEA. Where stricter handling is required, a modified abuse monitoring configuration may be available.
Please refer this
- Abuse Monitoring Overview
- Data Privacy and Security in Azure OpenAI
- Understanding Data Retention in Azure OpenAI Services
I Hope this helps. Do let me know if you have any further queries.
Thank you!