data flow activity gets stuck/hangs

javier 936 Reputation points
2021-01-08T21:42:26.027+00:00

Hi, my azure data flow activity gets stuck (run id aea495f9-5a19-4f38-96f3-f6f79831ada5) from time to time and I don't really know how to debug this.

When I inspect the progress of the activity I can see the activity status as "Running" but the final sub-activity marked as completed (green tick). The final subactivity is the sink to an Azure SQL database.

Could you please provide me with some guidance on how to debug this?

Also would like to know how can I get a warning or something when an activity/pipeline run takes more than certain time to complete or similar warning.

thanks

Azure SQL Database
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,859 questions
{count} votes

1 answer

Sort by: Most helpful
  1. javier 936 Reputation points
    2021-01-18T15:19:10.967+00:00

    Couldn't find what the issue was, so what i did is to insert the records I needed (5 columns) in a separate table using data flow and performing a join query when I need to get the data... not great but, seems to work for the moment...

    thanks guys

    1 person found this answer helpful.

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.