Create a copy activity in Microsoft Fabric Data Factory

The copy activity in Microsoft Fabric Data Factory can help you connect to your Azure Database for PostgreSQL flexible server instance to perform data movement and transformation activities.

The copy activity supports copy command, bulk insert, and upsert as write methods. To learn more, see Configure Azure Database for PostgreSQL in a copy activity.

This article has step-by-step instructions on how to create a copy activity.

Prerequisites

• An Azure Database for PostgreSQL flexible server instance. To learn more, go to Create an Azure Database for PostgreSQL.
• A Microsoft Fabric Data Factory data pipeline.

Create a copy activity

1. In Microsoft Fabric, select your workspace, switch to Data factory, and then select the New item button.

2. On the New item pane, search for pipeline and select the Data pipeline tile.

   

3. In the New pipeline dialog, enter a name and then select the Create button to create a data pipeline.

   

4. On the Activities menu, select Copy data, and then select Add to canvas.

   

5. With the copy activity selected on the data pipeline canvas, on the General tab, enter a name for the activity.

   

6. On the Source tab, select or create a source connection. Learn more about connecting to your data by using the modern get-data experience for data pipelines.

   

   The following example shows the selection of an Azure Database for PostgreSQL table as a source connection.

   

7. On the Destination tab, select or create an Azure Database for PostgreSQL connection.

   

8. For Write method, select Copy command, Bulk insert, or Upsert.

   Copy command

   

   Bulk insert

   

   Upsert

   

9. If a custom mapping is required, configure your mapping on the Mapping tab.

10. Validate your pipeline.

11. Select the Run button, which runs the pipeline manually.

12. Set up a trigger for your pipeline.

Specify the behavior of key columns on upsert

When you upsert data by using the Azure Database for PostgreSQL connector, you need to specify fields called key columns. You specify them in the Key columns area of the Destination tab.

There are two acceptable ways to use key columns:

• Select New and add all the primary key columns of the table for the destination data source.

  

• Select New and add one or more unique columns of the table for the destination data source.

Related content

• Configure Azure Database for PostgreSQL in a copy activity
• Azure Database for PostgreSQL connector overview
• Create a script activity in Microsoft Fabric Data Factory