What is the reason for Azure synapse pipeline activity is in queue for a longer time?

Jhaveri, Darshan 40 Reputation points
2024-08-27T21:30:01.7266667+00:00

Just like few days back the issue Data Factory failures or pipeline run delays in East US is back in East US. The Pipelines are all queued up and failed to enable the interactive authoring capability.

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,994 questions
{count} vote

2 answers

Sort by: Most helpful
  1. Vinodh247 23,111 Reputation points MVP
    2024-08-28T04:32:11.8+00:00

    Hi Jhaveri, Darshan,

    Thanks for reaching out to Microsoft Q&A.

    can be related to several underlying causes, given that you mentioned a similar issue occurred recently in the East US region with ADF failures or delays, it's possible that the current situation might be linked to ongoing or recurrent service disruptions in that region. Always keep a tab on service health using the URL below or even create an alert if needed. I am also mentioning few common reasons which you might check as well.

    https://portal.azure.com/#view/Microsoft_Azure_Health/AzureHealthBrowseBlade/~/serviceIssues

    • If there is a spike in usage within the East US region, the resources allocated to your Synapse workspace might be constrained, leading to queuing of pipeline activities.
    • There could be configuration issues in your Synapse Pipelines that cause excessive queuing. For example, dependencies on long-running activities or concurrency settings might lead to bottlenecks.
    • Check network configurations, including firewall rules, virtual network (VNet) setups, or other connectivity options.

    If nothing worked, create a service ticket with azure support.

    Please 'Upvote'(Thumbs-up) and 'Accept' as an answer if the reply was helpful. This will benefit other community members who face the same issue.

    1 person found this answer helpful.
    0 comments No comments

  2. Jhaveri, Darshan 40 Reputation points
    2024-08-29T13:15:10.7266667+00:00

    It was an outage which was resolved.


Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.