Azure synapse pipeline copy activities remain in a Queued state

Davison, Mike (NBGGS) 21 Reputation points
2021-03-16T20:17:10.097+00:00

Since yesterday, all of our pipelines that extract data from on-prem SQL servers to Azure data lake storage no longer work. Any Copy data activity remains in a Queued state, that never clears. There was a major Azure issue yesterday that was widespread.

We have tried the following:

  • recycling the IR on the on-prem gateway server
  • deleting and rebuilding the Integration runtime in Synapse DF, and reinstalling the on-prem gateway with a new key on the latest version

One example copy activity that is currently stuck is : 0f174098-befe-43c6-9a43-a56db82877df

We have had this issue all day, with no improvement. This Synapse Analytics environment is in the East
US 2 region.

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,671 questions
{count} votes

Accepted answer
  1. HimanshuSinha-msft 19,381 Reputation points Microsoft Employee
    2021-03-19T16:38:13.91+00:00

    Thanks @Anonymous .
    Hello @Davison, Mike (NBGGS) ,

    Just heard back from the product team and they confirmed that there was a defect and the ask is to upgrade to ver 5.2.7740.4 of SHIR . This version has the fix .
    Please so let us know if you are still facing the issue .

    Thanks
    Himanshu

    2 people found this answer helpful.
    0 comments No comments

2 additional answers

Sort by: Most helpful
  1. Anonymous
    2021-03-19T16:11:21.033+00:00

    We have been having the same problem.
    I believe the problem started after the Integration Runtime updated last week (to a 5.3 version). The problem persisted after we updated to the latest versions (5.4....).
    However when I rolled back to a previous version (5.2.7740.4) it didn't happen again.

    0 comments No comments

  2. Davison, Mike (NBGGS) 21 Reputation points
    2021-03-19T18:27:38.723+00:00

    Thank you to both @Anonymous and @HimanshuSinha-msft !

    I downloaded version 5.2.7740.4 of SHIR directly from the MS website, as it is not yet available via Azure. I updated all of our gateway servers, and can now execute data extraction pipelines without issue. Good ending to a long week!

    -Mike

    0 comments No comments