Edit

Share via

Learn how to create a Copy job (preview) in Data Factory for Microsoft Fabric

  • Article

This article describes how to use the Copy job in Data Factory for Microsoft Fabric.

Prerequisites

  • Enable the Copy job (preview) feature in your tenant.

    Note

    Since the Copy job feature is still in preview, you need to enable it through your tenant administration. If you already see the Copy job, your tenant might already have the feature enabled.

    1. Navigate to the Admin portal and select Tenant settings.
    2. Under Microsoft Fabric, expand the Users can create and use Copy job (preview) section.
    3. Select Apply.

Create a Copy job

Complete the following steps to create a new Copy job:

  1. Create a new workspace or use an existing workspace.

  2. Go to the Data Factory home page in Fabric.

  3. Select the Copy job (preview) icon to create a new Copy job.

    Screenshot showing where to navigate to the Data Factory home page and create a new Copy job (preview).

  4. Assign a name to the new job, then select Create.

  5. Choose the data stores to copy data from.

    Screenshot showing where to choose a data source for the Copy job.

  6. Once you enter your credentials to connect to source stores, select the tables and columns you wish to copy.

    Screenshot showing where to select tables and columns for the Copy job.

  7. Select your destination store:

    Screenshot showing where to select the destination store for the Copy job.

  8. Configure table or column mapping if you need.

    Screenshot showing where to specify table and column mappings.

  9. Choose the copy mode, either a one-time full data copy, or continuous incremental copying.

    Note

    • When you choose incremental copy mode, Data Factory initially performs a full load and subsequently carries out incremental copies in subsequent runs.
    • The Incremental column is specific to the incremental copy mode. This column in your source data helps identify changes. Each time, the Copy job saves the value from this column as a watermark, only copying rows where the Incremental column value exceeds the previous one.

    Screenshot showing where to select the Copy job mode.

  10. Review the job summary and save it.

    Screenshot showing where to review and save the newly created Copy job.

  11. In the Copy job panel, you can modify, execute, and track the job's status. The inline monitoring panel displays row counts read/written for the latest runs only. Select Monitor run history to view these metrics for past runs.

    Screenshot showing the Copy job panel where you can monitor run history.

  12. You can also see the data availability in the data destination.

    Screenshot showing the data in the destination store after a Copy job operation.

Known limitations

  • Monitor button isn't available yet to see the aggregated read/written row counts per table and database in Copy job life-cycle.
  • Configure Copy button isn't available yet for advanced settings including incremental copy without full load, override or upsert data in destination.
  • Incremental copy mode can't work with Fabric Lake House as source.
  • Row deletion can't be captured from source store.

Related content