Me too. Very randomly. Pipeline with a for each that runs a data flow with a Synapse source which is the culprit. My for each usually kicks off 41 data flows of which on average around 10 have the issue. Just did a debug session in which only one data flow gets ran in the for each, and now also just this one has the issue.
Azure Synapse Analytics Pipeline Failure in For Each
pm-syn-lover
36
Reputation points
Running a for each loop across multiple files, and during the pipeline run, I received this error for processing one of the files through a data flow activity(see screenshot below).
with error code 5000 and message: Job failed during run time with state = [dead].
The activity failed after 53 minutes of attempting to process. Despite the failure, the activity did transform the file properly. Any insight as to why there was an error? Is this an issue?
:
2 answers
Sort by: Most helpful
-
-
Christopher Teljstedt 21 Reputation points
2021-07-04T08:24:58.587+00:00 I get the same problem too lately.