How to pass a parameter from one dataflow to another dataflow in azure data factory?

Rachit Pandya 0 Reputation points
2024-06-13T07:07:50.5266667+00:00

I'm stuck in one of the azure data factory related problem int which i want to pass the parameter of one dataflow's sink to another dataflow's source.
Can anyone help me out with this problem?

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,112 questions
{count} votes

1 answer

Sort by: Most helpful
  1. Amira Bedhiafi 27,596 Reputation points
    2024-06-13T13:52:07.1+00:00

    Create the 2 parameters in the source and the destination. Then you create a new pipeline, where you add the source dataflow activity.

    In the settings of the dataflow activity, map the parameters as needed.

    After the source dataflow activity, add a Set Variable activity to store the output value. For example, if you need to pass an ID or any value, capture it here.

    Use dynamic expressions to capture the output. For example, @activity('SourceDataflowActivity').output.value.

    Then, add the destination dataflow activity.

    In the settings of the dataflow activity, map the parameters using the variables set from the previous activity.

    Then you pass the parameters between pipelines :

    • If the dataflows are in the same pipeline, directly use the output of the source dataflow in the destination dataflow activity.
    • If the dataflows are in separate pipelines, use a combination of Execute Pipeline activity to call the second pipeline and pass the necessary parameters.
    0 comments No comments

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.