Configure Microsoft 365 in a copy activity

Microsoft Fabric Data pipelines integrate with Microsoft Graph data connect, allowing you to bring the rich organizational data in your Microsoft 365 tenant into Fabric and Azure in a scalable way and build analytics applications and extract insights based on these valuable data assets. Integration with Privileged Access Management provides secured access control for the valuable curated data in Microsoft 365. Please refer to this link for an overview of Microsoft Graph data connect.

This article outlines how to use the copy activity in a data pipeline to copy data from Microsoft 365. For now, within a single copy activity, you can ingest data from Microsoft 365 into Microsoft Fabric Lakehouse Table, Azure Blob Storage, Azure Data Lake Storage Gen1, and Azure Data Lake Storage Gen2. The supported data format is Avro, Delimited text, JSON, ORC and Parquet format.

Prerequisites

To copy data from Microsoft 365, you need to complete the following prerequisite steps:

• Your Microsoft 365 tenant admin must complete on-boarding actions as described here.
• Create and configure a Microsoft Entra web application in Microsoft Entra ID. For instructions, go to Create a Microsoft Entra application.
• Make note of the following values, which you use to define the connection for Microsoft 365: Tenant ID. For instructions, go to Get tenant ID.
• Application ID and Application key. For instructions, go to Get application ID and authentication key. Add the user identity who will be making the data access request as the owner of the Microsoft Entra web application (from the Microsoft Entra web application > Settings > Owners > Add owner).
• The user identity must be in the Microsoft 365 organization you're getting data from and must not be a Guest user.

Approving new data access requests

If you're requesting data for this context for the first time (a combination of which data table is being accessed, which destination account is the data being loaded into, and which user identity is making the data access request), the copy activity status is displayed as In Progress. Only when you select the Details link under Actions will the status be displayed as RequestingConsent. A member of the data access approver group needs to approve the request in the Privileged Access Management before the data extraction can proceed.

Refer to the frequently asked questions on how the approver can approve the data access request. Refer to the data connect integration with PAM article for an explanation of the overall integration with Privileged Access Management, including how to set up the data access approver group.

Supported configuration

For the configuration of each tab under copy activity, go to the following sections respectively.

• General
• Source
• Mapping
• Settings

General

For the General tab configuration, go to General.

Source

The following properties are supported for Microsoft 365 under the Source tab of a copy activity.

The following properties are required:

• Data store type: Select External.
• Connection: Select a Microsoft 365 connection from the connection list. If no connection exists, then create a new Microsoft 365 connection by selecting New.
• Table: Name of the table to extract from Microsoft 365. You can preview the sample data by selecting Preview sample data.

Under Advanced, you can specify the following fields:

• Scope: You can select All users or groups in the Microsoft 365 tenant or Select groups from the Microsoft 365 tenant

  If you select All users or groups in the Microsoft 365 tenant, the scope filter is displayed.

  

  • Scope filter: You can use a predicate expression that's applied on the entire tenant to filter the specific rows to extract from Microsoft 365. The predicate format should match the query format of Microsoft Graph APIs, for example https://graph.microsoft.com/v1.0/users?$filter=Department eq 'Finance'.

  If you select Select groups from the Microsoft 365 tenant, you can select Add user groups to select groups from the Microsoft 365 tenant. Use this property to select up to 10 user groups for whom the data is retrieved. If no groups are specified, then data is returned for the entire organization.

  

• Date filter: Specify the name of the DateTime filter column. Use this property to limit the time range for which Microsoft 365 data is extracted. If your dataset has one or more DateTime columns, you need to specify a column here. Refer to Filtering for a list of datasets that require this DateTime filter.

  Specify the Start time (UTC) and End time (UTC) to filter on when you select a DateTime filter column.

  

Mapping

For the Mapping tab configuration, go to Configure your mappings under mapping tab.

Settings

For the Settings tab configuration, go to Configure your other settings under settings tab.

Table summary

The following tables contain more information about the copy activity in Microsoft 365.

Source information

Name	Description	Value	Required	JSON script property
Data store type	Your data store type.	External	Yes	/
Connection	Your connection to the source data store.	<your connection>	Yes	connection
Table	Name of the table to extract from Microsoft 365.	<table>	Yes	table
Scope	When the user group isn't specified, you can use a predicate expression that's applied on the entire tenant to filter the specific rows to extract from Microsoft 365. The predicate format should match the query format of Microsoft Graph APIs, for example https://graph.microsoft.com/v1.0/users?$filter=Department eq 'Finance'.	<your scope>	Yes	scope
Scope filter	When the allowedGroups property isn't specified, you can use a predicate expression that's applied on the entire tenant to filter the specific rows to extract from Microsoft 365. The predicate format should match the query format of Microsoft Graph APIs, for example https://graph.microsoft.com/v1.0/users?$filter=Department eq 'Finance'.	<scope filter>	No	userScopeFilterUri
Group ID	Group selection predicate. Use this property to select up to 10 user groups for whom the data is retrieved. If no groups are specified, then data is returned for the entire organization.	<group id>	No	allowedGroups
Date filter (Column name)	Name of the DateTime filter column. Use this property to limit the time range for which Microsoft 365 data is extracted.	<your DateTime filter column>	Yes if data has one or more DateTime columns.	dateFilterColumn
Start time (UTC)	Start DateTime value to filter on.	<start time>	Yes if dateFilterColumn is specified	startTime
End time (UTC)	End DateTime value to filter on.	<end time>	Yes if dateFilterColumn is specified	endTime

Related content

• How to create a Microsoft 365 connection