How to pass parameters from a pipeline to a data flow?

Poel van der, RE (Ron) 451 Reputation points
2020-10-09T13:13:05.407+00:00

Hai All

I am a newbie on ADF and learning bit by bit.
Made a flow which works fine when I hard-code values.
But I want the dataflow to be re-used over and over again, whereby the value of the parameters differ.
So I want to give the parameters through from pipeline to data flow (we will trigger a pipeline).

I am not able to do that and I don't understand what goes wrong.
Get the error : Parameter stream has parsing errors
In the attachment I explained with some pictures more in detail what I did

31190-step1.jpg31253-step2.jpg31282-step3.jpg

Really hope someone can help
@Vaibhav Chaudhari , @Sam Cogan maybe you know the answer ? :)

Regards
Ron

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
{count} votes

1 answer

Sort by: Most helpful
  1. MartinJaffer-MSFT 26,161 Reputation points
    2020-10-09T21:59:24.597+00:00

    Hello @Poel van der, RE (Ron) and welcome to Microsoft Q&A.

    I think there is a little confusion here.
    Picture #3 is passing the values defined in picture #2 to the parameters in picture #1.

    Also, you do not need the values in picture #2 to be quoted. That is taken care of for you.

    Picture #4 only happens when the datasets you selected, have been parameterized outside of the data flow. As in the below pictures of a parameterized dataset.
    31352-image.png
    31196-image.png
    Picture #4 is passing values to the datasets parameters like above, not to the data flow parameters of picture #1.

    The interaction between the source/sink settings in the data flow, and the respective dataset properties can get complex very quickly.

    (VaibhavChaudhari and Sam-Cogan, feel free to engage if you like.)


Your answer

Answers can be marked as 'Accepted' by the question author and 'Recommended' by moderators, which helps users know the answer solved the author's problem.