How to pass arguments from Pipeline to Data Flow parameter of type 'map'

Hochmanj 101 Reputation points
2021-04-12T19:59:19.943+00:00

If one has a data flow with a parameter of type map[string, string], how do you pass in the argument when calling from a pipeline. See image below.

If i'm not mistaken, you cannot create a mapping in Pipelines using '->' notation. I tried a few approaches such as making string templates and/or equivalent jsons but none of the approaches seem to work.

87006-image.png

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,738 questions
0 comments No comments
{count} vote

1 answer

Sort by: Most helpful
  1. Saurabh Sharma 23,821 Reputation points Microsoft Employee
    2021-04-12T23:00:23.023+00:00

    Hi @Hochmanj ,

    Thanks for using Microsoft Q&A !!

    I have tried passing a values to dataflow parameter (having data type as map(string,string)) and it works fine for me. When you select the DataFlow activity on Pipeline canvas you will be presented with the parameters defined for the specific data flow and you can then pass the values either using DataFlow Expressions and Pipeline Expressions.
    87151-image.png
    When "DataFlow expressions" are used you can access the functions, parameters, or any other schema defined in your data flow and when you use "Pipeline Expressions" then you can refer to system variables, functions, pipeline parameters/variables. Also, pipeline expressions type does not need to match the parameters type as defined in Data Flow. Please refer to the documentation.
    I have tried using both these ways and able to pass the values correctly against a map datatype. Please refer to the below gif.
    87161-dataflow-mapdatatype.gif

    Hope this helps. Please let me know if you have any questions.

    Thanks
    Saurabh

    ----------

    Please do not forget to "Accept the answer" wherever the information provided helps you to help others in the community.


Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.