Regarding the Dataflow to Foreach Activity

Kyle1245 420 Reputation points
2024-01-12T01:44:37.5166667+00:00

The Dataflow comprises two activities outlined below:

Source: I have a dataflow that includes two primary activities:

Source - This involves reading data from a CSV dataset.

Filter - This step filters the dataset.

Sink Configuration - I am uncertain about the appropriate configuration for the sink in this step. What would be the best option? Following the dataflow, I have a foreach activity. For each item it receives, the foreach activity utilizes a copy activity for additional processing.

Could anyone provide guidance or suggestions on what the sink should be in the third step of the dataflow?

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,209 questions
0 comments No comments
{count} votes

Accepted answer
  1. Smaran Thoomu 19,875 Reputation points Microsoft Vendor
    2024-01-12T03:32:13.65+00:00

    Hi @HideyoshiAkaio ,

    Thank you for posting query on Microsoft Q&A Platform.

    Dataflows doesn't have ForEach kind of functionality but still you can write your output back to Pipeline activities using write output cache in Sink. Click here to know more about it.

    How ever, you may also consider doing same using Lookup activity & Filter activity. Lookup activity to get all data from source in array format and then Filter activity to filter specific data items alone and then pass this to ForEach activity as per requirement.

    Hope this helps. Do let us know if you any further queries.


    If this answers your query, do click Accept Answer and Yes for was this answer helpful. And, if you have any further query do let us know.

    1 person found this answer helpful.

0 additional answers

Sort by: Most helpful

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.