Azure Data Factory Pipeline Activities Stuck In Queued status

Frank GC 1 Reputation point
2021-03-17T19:00:10.21+00:00

We have been experiencing a number of failed jobs over the last week because of pipeline activities becoming stuck in a queued state. These seemed to have been working until we upgraded to the latest IR version. An example pipelinerunID is c560992a-d974-4806-9c39-1b6b71e5c7f4. We have looked at the IR server and nothing seems to be wrong but we can't figure out why activities keep becoming stuck and won't start.

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
6,292 questions
{count} votes

1 answer

Sort by: Most helpful
  1. KranthiPakala-MSFT 33,056 Reputation points Microsoft Employee
    2021-03-19T14:11:36.267+00:00

    Hi @Frank GC ,

    Sorry for your experience with this issue and thanks for reporting this to us.

    I have verified with internal product team and confirmed that there is a potential defect identified in the newer SHIR version (5.2 and above), which could cause the SHIR's capacity degradation under big loads. This might be the reason you are seeing this issue.

    For mitigation, a QFE SHIR is available in download center now. Product team have already sent a notification to the potential impacted customers with the mitigation steps and QFE download link.

    Here is the link: https://download.microsoft.com/download/E/4/7/E4771905-1079-445B-8BF9-8A1A075D8A10/IntegrationRuntime_5.2.7740.4.msi. Please download and do the manually update, in the meanwhile a new round of auto update is also in progress by the product team.

    Apologizes for the inconvenience due to this issue.

    Let us know how it goes.