Azure SQL Database
An Azure relational database service.
Data flow not completing
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(121.6, 17%, 21%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESG%3C/text%3E%3C/svg%3E)
Shilpa Gusain
6
Reputation points
Hi All,
I am running data flow in Synapse workspace which fetches the data from parquet files and loads it into an Azure SQL database. Though all the data flow stages are completed, the activity is still in "In Progress" status after hours of all records being moved.
No. of records : 2155
Azure SQL Database
Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
{count} votes
-
PRADEEPCHEEKATLA 91,656 Reputation points Moderator2021-10-01T08:54:06.32+00:00 Hello @Shilpa Gusain ,
Welcome to the Microsoft Q&A platform.
When you say "Data Flow is not completing" - How long it is running?
- Could you please confirm if this is happening consistently for different pipeline runs as well? or is this a random issue?
As per repro from our end the Data flow status changed from running to success as soon as the pipeline succeeded.
Data flow status: The current status of your execution - Acquiring Compute => Running => Success
Meanwhile, please checkout the Monitor Data Flows.
-
Shilpa Gusain 6 Reputation points
2021-10-01T16:21:49.43+00:00 Hi @PRADEEPCHEEKATLA ,
Thanks for responding. This happening only for this pipeline and repeatedly. The first time I ran, it was in this state for almost 6 hours.
2nd time execution : almost 2 hours and then I cancelled it.
Our dataflow status is not changing to success even though all the internal steps have been completed..
-
PRADEEPCHEEKATLA 91,656 Reputation points Moderator
2021-10-04T04:04:27.873+00:00 Hello @Shilpa Gusain ,
This issue looks strange. For a deeper investigation and immediate assistance on this issue, if you have a support plan you may file a support ticket, else please do let us know.
-
PRADEEPCHEEKATLA 91,656 Reputation points Moderator
2021-10-06T08:01:35.357+00:00 Hello @Shilpa Gusain ,
Did you get a chance to open a support ticket?
Sign in to comment
Sign in to answer