How to pass parameters from a pipeline to a data flow?

Poel van der, RE (Ron) 421 Reputation points
2020-10-09T13:13:05.407+00:00

Hai All

I am a newbie on ADF and learning bit by bit.
Made a flow which works fine when I hard-code values.
But I want the dataflow to be re-used over and over again, whereby the value of the parameters differ.
So I want to give the parameters through from pipeline to data flow (we will trigger a pipeline).

I am not able to do that and I don't understand what goes wrong.
Get the error : Parameter stream has parsing errors
In the attachment I explained with some pictures more in detail what I did

31190-step1.jpg31253-step2.jpg31282-step3.jpg

Really hope someone can help
@Vaibhav Chaudhari , @Sam Cogan maybe you know the answer ? :)

Regards
Ron

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
9,790 questions
{count} votes

1 answer

Sort by: Most helpful
  1. MartinJaffer-MSFT 26,041 Reputation points
    2020-10-09T21:59:24.597+00:00

    Hello @Poel van der, RE (Ron) and welcome to Microsoft Q&A.

    I think there is a little confusion here.
    Picture #3 is passing the values defined in picture #2 to the parameters in picture #1.

    Also, you do not need the values in picture #2 to be quoted. That is taken care of for you.

    Picture #4 only happens when the datasets you selected, have been parameterized outside of the data flow. As in the below pictures of a parameterized dataset.
    31352-image.png
    31196-image.png
    Picture #4 is passing values to the datasets parameters like above, not to the data flow parameters of picture #1.

    The interaction between the source/sink settings in the data flow, and the respective dataset properties can get complex very quickly.

    (VaibhavChaudhari and Sam-Cogan, feel free to engage if you like.)