Dataflow to foreach activity

arkiboys 9,686 Reputation points
2021-09-16T12:09:29.503+00:00

Dataflow to foreach activity

The dataflow has two activities as follows:
1- source - Reads from the csv dataset
2- Filters the dataset
3- What should the sink be?

Next is the foreach activity that for every item received, it uses a copy activity to do further work...

Question:
In step 3 for the dataflow, I am nor sure what the sink should be.
Any suggestions?
Thank you

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
9,934 questions
0 comments No comments
{count} votes

Accepted answer
  1. ShaikMaheer-MSFT 38,311 Reputation points Microsoft Employee
    2021-09-17T11:15:05.917+00:00

    Hi @arkiboys ,

    Thank you for posting query on Microsoft Q&A Platform.

    Dataflows, doesn't have ForEach kind of functionality but still you can write your output back to Pipeline activities using write output cache in Sink. Click here to know more about it.

    How ever, you may also consider doing same using Lookup activity & Filter activity. Lookup activity to get all data from source in array format and then Filter activity to filter specific data items alone and then pass this to ForEach activity as per requirement.

    Hope this will help. Please let us know if any further queries.

    ------------------------------

    • Please don't forget to click on 130616-image.png or upvote 130671-image.png button whenever the information provided helps you. Original posters help the community find answers faster by identifying the correct answer. Here is how
    • Want a reminder to come back and check responses? Here is how to subscribe to a notification
    • If you are interested in joining the VM program and help shape the future of Q&A: Here is how you can be part of Q&A Volunteer Moderators
    0 comments No comments

0 additional answers

Sort by: Most helpful