Edit

Share via


Use the Dataflow activity to run a Dataflow Gen2

The Dataflow activity in Data Factory for Microsoft Fabric allows you to run a Dataflow Gen2.

Prerequisites

To get started, you must complete the following prerequisites:

Add a Dataflow activity to a pipeline with UI

To use a Dataflow activity in a pipeline, complete the following steps:

Creating the activity

  1. Create a new pipeline in your workspace.

  2. Search for Dataflow in the pipeline Activities pane, and select it to add it to the pipeline canvas.

    Screenshot of the Fabric UI with the Activities pane and Dataflow activity highlighted.

  3. Select the new Dataflow activity on the canvas if it isn't already selected.

    Screenshot showing the General settings tab of the Dataflow activity.

Refer to the General settings guidance to configure the General settings tab.

Dataflow activity settings

Select the Settings tab, then select an existing workspace and dataflow to run. If you have made a Dataflow Gen2 with CI/CD and Git integration support (Preview), you can also select it from the dropdown.

Screenshot showing the dropdown with a list of dataflows to select in the Dataflow activity Settings tab

The notification option is not currently available.

Screenshot showing the Dataflow activity Settings tab, and highlighting the tab.

Note

Public parameters mode and support for parameters to be passed to a Dataflow is a preview feature only available for Dataflow Gen2 with CI/CD support. Additionally, parameterizing the DataflowId in the dataflow pipeline activity settings will only support the legacy Dataflow Gen2 version without CICD support. I.e. you cannot invoke Dataflows w/CICD support using parameterization of the DataflowId. This is only a temporary limitation until all Dataflows are converted to the new CICD enabled version.

Inside the Dataflow parameters section you are able to enter the name of the parameter that you wish to pass as well as the type and value that you wish to pass.

For more information on how to enable the Dataflow parameters capability on your Dataflow Gen2, check the article on Public parameters for Dataflow Gen2.

Save and run or schedule the pipeline

After you configure any other activities required for your pipeline, switch to the Home tab at the top of the pipeline editor, and select the save button to save your pipeline. Select Run to run it directly, or Schedule to schedule it. You can also view the run history here or configure other settings.

Screenshot showing the Home tab in the pipeline editor with the tab name, Save, Run, and Schedule buttons highlighted.

How to monitor pipeline runs