Dynamic parameters in Azure Data Factory in dataflow activity

Question

i have use case of reading from azure sql table and iterating over each row .Each row has source and target table name and join condition on which i need to select data and then merge data into target table. I need to do this activity using Azure Data Factory . How can i implement it. I need to make it as generic using dynamic parameters.
As I am trying to merge data from one snowflake table to another, so I am using dataflow
i am getting error

{"StatusCode":"DFExecutorUserError","Message":"Job failed due to reason: at Sink 'sink1'(Line 8/Col 0): Input transformation 'target' not found","Details":""}

I am trying but I am getting error.106261-activity2.pdf

]7

Answer 1

Hi @Aditya Raj ,

Thank you for posting query in Microsoft Q&A Platform.

To create Join condition dynamically please check below detailed explanation.

Step 1: Create a Parameter in Data flow holds value "depid,depname" and we should use these columns(depid & depname) for join condition dynamically

Step 2: Added Source(employee data) and Sink(department data) transformations

Step 3: Join Transformation. Make sure to select Boardcast as Fixed and check Boardcast options.
Added Join condition dynamically by splitting parameter value.

Also, for SCD type2 implementation you can refer below vlog from product team
https://www.youtube.com/watch?v=tc283k8CWh8

Hope this will help

----------------------------------

• Please accept an answer if correct. Original posters help the community find answers faster by identifying the correct answer. Here is how.
• Want a reminder to come back and check responses? Here is how to subscribe to a email-notifications. 

Answer 2

The best option is to use the inline option in dataflow source and sink and pass parameters