dataflow1 returns fields in a select activity (Field1 which has multiple distinct values) and so there is no sink dataflow2 expects is to loop through each of the values from dataflow1 Here is what I have but I get an error when trying to debug: dataflow1 --> no sink found How do I do this please? Thank you

Hi @arkiboys , I would suggest to write/sink Dataflow1 output to a file ( the file could be save in a temporary/staging storageContainer). Then in the pipeline, if you want to pass 1 value at a time, read the file with a lookup activity --> then foreach loop, pass it to the second dataflow. If you want to read all the values, then read the file as a source in the Dataflow2. Hope this helps, thanks!

dataflow - no sink - Microsoft Q&A

Accepted answer

Nasreen Akter 10,806 Reputation points

2022-03-15T18:10:24.107+00:00

Hi @arkiboys ,

I would suggest to write/sink Dataflow1 output to a file ( the file could be save in a temporary/staging storageContainer). Then in the pipeline, if you want to pass 1 value at a time, read the file with a lookup activity --> then foreach loop, pass it to the second dataflow. If you want to read all the values, then read the file as a source in the Dataflow2. Hope this helps, thanks!
Please sign in to rate this answer.
MarkKromer-MSFT 5,216 Reputation points Microsoft Employee

2022-03-15T22:47:15.967+00:00

Alternatively, you can use a cached sink and then read the results from the next data flow activity in your pipeline.

arkiboys 9,696 Reputation points

2022-03-16T06:47:46.203+00:00

Hi,
I found which I believe is one of your tutorial videos. https://www.youtube.com/watch?v=r1m3Ya14qpE

The sink of dataflow1 is now cache sink. and when I check the result of the dataflow1 sink I see something like this:

p_venture

value1
value2
value3
...

in pipeline1, right after the dataflow1, I linked it to foreach activity as I would like to lop through each of the values in p_venture.
Inside for each activity, I have placed this expression: @activity('df_physical_details').output.runStatus.output.sink1.value[0].p_venture

It shows this error in foreach activity when I run the pipeline.

Error code
ExpressionEvaluationFailed
Failure type
User configuration issue
Details
The execution of template action 'MainForEach1' failed: the result of the evaluation of 'foreach' expression '@activity('df_physical_details').output.runStatus.output.sink1.value[0].p_venture' is of type 'String'. The result must be a valid array.

Any suggestions?
Thank you
Sign in to comment

Use comments to ask for clarification, additional information, or improvements to the question.

Share via

dataflow - no sink

p_venture

0 additional answers

Your answer