Passing folder name from Pipeline to Dataflow

Question

Hi

I have a folder structure in the following way

Container 1 -
--Folder 1
--file1.json
--file2.json
--Folder 2
--file3.json
--file4.json

I want to process each folder in my dataflow. I am looping through container for folders through Metadata and using foreach activity as below

To loop I am using the following expression for foreach activity

@activity('Get Metadata1').output.childItems

Insider foreach I have a dataflow

Source dataset in dataflow I have given in the following manner

Now How to pass folder name into dataflow so that it would take one folder at a time. What should be the values in the following diagram? And why is it asking for linked services parameters?

Answer 1

Hello @Krishnamohan Nadimpalli ,
Thanks for the question and using MS Q&A platform.
As we understand the ask here is how to pass the parameter to the dataflow , please do let us know if its not accurate.
You will have to paramterized the Source dataset . First create the parameter and then add that to the path , as shown below .

Once you do that , please click on the Dataflow ( inside for each ) and you will see an new parameter , as shown below .

I did tested the pipeline with the above setting that it worked fine .

Please do let me if you have any queries.
Thanks
Himanshu

---

• Please don't forget to click on or upvote button whenever the information provided helps you. Original posters help the community find answers faster by identifying the correct answer. Here is how
• Want a reminder to come back and check responses? Here is how to subscribe to a notification
  • If you are interested in joining the VM program and help shape the future of Q&A: Here is how you can be part of Q&A Volunteer Moderators