Share via


Use Microsoft Purview to manage data security & compliance for Azure AI services

Microsoft 365 licensing guidance for security & compliance

Use the following sections to identify the Microsoft Purview capabilities that are supported for AI interactions that use Azure AI services, and some get started recommendations for you to manage these AI interactions for security and compliance.

Managing these AI interactions with Microsoft Purview requires you to enable pay-as-you-go billing in your organization.

Capabilities supported

Use the following table to see at a glance the Microsoft Purview capabilities that are supported for Azure AI services.

Capability or solution in Microsoft Purview Supported for AI interactions
DSPM for AI
Auditing
Data classification
Sensitivity labels
Encryption without sensitivity labels
Data loss prevention
Insider Risk Management
Communication compliance
eDiscovery
Data Lifecycle Management
Compliance Manager

Data Security Posture Management for AI

Use Microsoft Purview Data Security Posture Management (DSPM) for AI as your front door to discover, secure, and apply compliance controls for AI usage across your enterprise. This solution uses existing controls from Microsoft Purview information protection and compliance management with easy-to-use graphical tools and reports to quickly gain insights into AI use within your organization. With personalized recommendations, one-click policies help you protect your data and comply with regulatory requirements.

For more information, see Learn about Data Security Posture Management (DSPM) for AI.

AI app-specific information:
  • Recommendation Secure data in Azure AI apps and agents, which has set up instructions to capture prompts and responses for AI apps that use one or more Azure AI subscriptions.

  • Recommendation Get guided assistance to AI regulations, which uses control-mapping regulatory templates from Compliance Manager.

  • One-click policy available:

    • DSPM for AI - Detect sensitive info shared with AI via network from the recommendation Extend insights into sensitive data in AI app interactions.

Auditing and AI interactions

Microsoft Purview Audit solutions provide comprehensive tools for searching and managing audit records of activities performed across various Microsoft services by users and admins, and help organizations to effectively respond to security events, forensic investigations, internal investigations, and compliance obligations.

Like other activities, prompts and responses are captured in the unified audit log. Events include how and when users interact with the AI app, and can include in which Microsoft 365 service the activity took place, and references to the files stored in Microsoft 365 that were accessed during the interaction. If these files have a sensitivity label applied, that's also captured.

These events flow into activity explorer in Data Security Posture Management for AI, where the data from prompts and responses can be displayed. You can also use the Audit solution from the Microsoft Purview portal to search and find these auditing events.

For more information, see Audit logs for Copilot and AI activities.

Data classification and AI interactions

Microsoft Purview data classification provides a comprehensive framework for identifying and tagging sensitive data across various Microsoft services, including Office 365, Dynamics 365, and Azure. Classifying data is often the first step to ensure compliance with data protection regulations and safeguard against unauthorized access, alteration, or destruction. You can use built-in system classifications or create your own.

Sensitive information types and trainable classifiers can be used to find sensitive data in user prompts and responses when they use AI apps. The resulting information then surfaces in the data classification dashboard and activity explorer in Data Security Posture Management for AI.

Data loss prevention and AI interactions

Microsoft Purview Data Loss Prevention (DLP) helps you identify sensitive items across Microsoft 365 services and endpoints, monitor them, and helps protect against leakage of those items. It uses deep content inspection and contextual analysis to identify sensitive items and it enforces policies to protect sensitive data such as financial records, health information, or intellectual property.

Windows computers that are onboarded to Microsoft Purview can be configured for Endpoint data loss prevention (DLP) policies that warn or block users from sharing sensitive information with third-party generative AI sites that are accessed via a browser. For example, a user is prevented from pasting credit card numbers into ChatGPT, or they see a warning that they can override. For more information about the supported DLP actions and which platforms support them, see the first two rows in the table from Endpoint activities you can monitor and take action on.

Additionally, a DLP policy scoped to an AI location can restrict AI apps from processing sensitive content. For example, a DLP policy can restrict Microsoft 365 Copilot from summarizing files based on sensitivity labels such as "Highly Confidential". After turning on this policy, Microsoft 365 Copilot and agents won't summarize files labeled "Highly Confidential" but can reference it with a link so the user can then open and view the content using Word. For more information that includes which AI apps support this DLP configuration, see Learn about the Microsoft 365 Copilot policy location.

AI app-specific information:

Insider Risk Management and AI interactions

Microsoft Purview Insider Risk Management helps you detect, investigate, and mitigate internal risks such as IP theft, data leakage, and security violations. It leverages machine learning models and various signals from Microsoft 365 and third-party indicators to identify potential malicious or inadvertent insider activities. The solution includes privacy controls like pseudonymization and role-based access, ensuring user-level privacy while enabling risk analysts to take appropriate actions.

Use the Risky AI usage policy template to detect risky usage that includes prompt injection attacks and accessing protected materials. Insights from these signals are integrated into Microsoft Defender XDR to provide a comprehensive view of AI-related risks.

AI app-specific information:
  • For prompts and responses, requires a collection policy such as DSPM for AI - Detect sensitive info shared with AI via network from the DSPM for AI recommendation Extend insights into sensitive data in AI app interactions.

Communication compliance and AI interactions

Microsoft Purview Communication Compliance provides tools to help you detect and manage regulatory compliance and business conduct violations across various communication channels, which include user prompts and responses for AI apps. It's designed with privacy by default, pseudonymizing usernames and incorporating role-based access controls. The solution helps identify and remediate inappropriate communications, such as sharing sensitive information, harassment, threats, and adult content.

To learn more about using communication compliance policies for AI apps, see Configure a communication compliance policy to detect for generative AI interactions.

AI app-specific information:
  • For prompts and responses, requires a collection policy such as DSPM for AI - Detect sensitive info shared with AI via network from the DSPM for AI recommendation Extend insights into sensitive data in AI app interactions.

eDiscovery and AI interactions

Microsoft Purview eDiscovery lets you identify and deliver electronic information that can be used as evidence in legal cases. The eDiscovery tools in Microsoft Purview support searching for content in Exchange Online, OneDrive for Business, SharePoint Online, Microsoft Teams, Microsoft 365 Groups, and Viva Engage teams. You can then prevent the information from deletion and export the information.

Because user prompts and responses for AI apps are stored in a user's mailbox, you can create a case and use search when a user's mailbox is selected as the source for a search query. For example, select and retrieve this data from the source mailbox by selecting from the query builder Add condition > Type > Equals any of > Add/Remove more options > Copilot interactions.

After the search is refined, you can export the results or add to a review set. You can review and export information directly from the review set.

To learn more about identifying and deleting user AI interaction data, see Search for and delete Copilot data in eDiscovery

AI app-specific information:
  • For prompts and responses, requires a collection policy such as DSPM for AI - Detect sensitive info shared with AI via network from the DSPM for AI recommendation Extend insights into sensitive data in AI app interactions.

Data Lifecycle Management and AI interactions

Microsoft Purview Data Lifecycle Management provides tools and capabilities to manage the lifecycle of organizational data by retaining necessary content and deleting unnecessary content. These tools ensure compliance with business, legal, and regulatory requirements.

Use retention policies to automatically retain or delete user prompts and responses for AI apps. For detailed information about this retention works, see Learn about retention for Copilot & AI apps.

As with all retention policies and holds, if more than one policy for the same location applies to a user, the principles of retention resolve any conflicts. For example, the data is retained for the longest duration of all the applied retention policies or eDiscovery holds.

AI app-specific information:
  • For retention policies, select the option for Enterprise AI apps.

  • For prompts and responses, requires a collection policy such as DSPM for AI - Detect sensitive info shared with AI via network from the DSPM for AI recommendation Extend insights into sensitive data in AI app interactions.

Compliance Manager and AI interactions

Microsoft Purview Compliance Manager is a solution that helps you automatically assess and manage compliance across your multicloud environment. Compliance Manager can help you throughout your compliance journey, from taking inventory of your data protection risks to managing the complexities of implementing controls, staying current with regulations and certifications, and reporting to auditors.

To help you keep compliant with AI regulations, Compliance Manager provides regulatory templates to help you assess, implement, and strengthen your compliance requirements for all generative AI apps. For example, monitoring AI interactions and preventing data loss in AI applications. For more information, see Assessments for AI regulations.

Use the following steps to get started with managing data security & compliance for AI interactions that use Azure AI services.

Because Data Security Posture Management for AI is your front door for securing and managing AI interactions, most of the following instructions use that solution:

  1. From DSPM for AI > Recommendations page, locate and select Secure data in Azure AI apps and agents, which has set up instructions to capture prompts and responses for AI apps that use one or more Azure AI subscriptions.

  2. Also from the recommendations list, select Secure interactions from enterprise apps, which creates a one-click policy to capture prompts and responses from enterprise AI apps.

  3. Wait at least a day for data, and then navigate to the Reports page to view the results of your policy. Select Enterprise AI apps and view information such as:

    • Total interactions over time (enterprise AI apps)
    • Sensitive interactions per AI app
    • Insider Risk severity
    • Insider risk severity per AI app
  4. Select View details for each of the report graphs to view detailed activities in the activity explorer.

    From the filters, select the AI app category of Enterprise AI apps with the App filter of Azure AI services, and then use the other filters if you need to further refine the displayed data. Drill down to each activity to view details that include displaying the prompts and response when you're a member of the Microsoft Purview Content Explorer Content Viewer role group. For more information about this requirement, see Permissions for Data Security Posture Management for AI.

  5. If you need to ensure that interactions from Azure AI services are retained for compliance reasons:

    In the Microsoft Purview portal, navigate to Data Lifecycle Management > Policies > Retention Policies and create a retention policy to retain interactions with Azure AI services by selecting the location Enterprise AI apps and specify the required retention period. For more information, see Create and configure retention policies.

Routinely review the reports in DSPM for AI to determine if you need to make changes, and use activity explorer and events for deeper analysis of how users are interacting with Azure AI services.