Dataflow to foreach activity

Question

Dataflow to foreach activity

The dataflow has two activities as follows:
1- source - Reads from the csv dataset
2- Filters the dataset
3- What should the sink be?

Next is the foreach activity that for every item received, it uses a copy activity to do further work...

Question:
In step 3 for the dataflow, I am nor sure what the sink should be.
Any suggestions?
Thank you

Answer 1

Hi @arkiboys ,

Thank you for posting query on Microsoft Q&A Platform.

Dataflows, doesn't have ForEach kind of functionality but still you can write your output back to Pipeline activities using write output cache in Sink. Click here to know more about it.

How ever, you may also consider doing same using Lookup activity & Filter activity. Lookup activity to get all data from source in array format and then Filter activity to filter specific data items alone and then pass this to ForEach activity as per requirement.

Hope this will help. Please let us know if any further queries.

------------------------------

• Please don't forget to click on or upvote button whenever the information provided helps you. Original posters help the community find answers faster by identifying the correct answer. Here is how
• Want a reminder to come back and check responses? Here is how to subscribe to a notification
• If you are interested in joining the VM program and help shape the future of Q&A: Here is how you can be part of Q&A Volunteer Moderators