Azure synapse pipeline copy activities remain in a Queued state

Question

Since yesterday, all of our pipelines that extract data from on-prem SQL servers to Azure data lake storage no longer work. Any Copy data activity remains in a Queued state, that never clears. There was a major Azure issue yesterday that was widespread.

We have tried the following:

• recycling the IR on the on-prem gateway server
• deleting and rebuilding the Integration runtime in Synapse DF, and reinstalling the on-prem gateway with a new key on the latest version

One example copy activity that is currently stuck is : 0f174098-befe-43c6-9a43-a56db82877df

We have had this issue all day, with no improvement. This Synapse Analytics environment is in the East
US 2 region.

Answer 1

Thanks @Anonymous .
Hello @Davison, Mike (NBGGS) ,

Just heard back from the product team and they confirmed that there was a defect and the ask is to upgrade to ver 5.2.7740.4 of SHIR . This version has the fix .
Please so let us know if you are still facing the issue .

Thanks
Himanshu

Answer 2

We have been having the same problem.
I believe the problem started after the Integration Runtime updated last week (to a 5.3 version). The problem persisted after we updated to the latest versions (5.4....).
However when I rolled back to a previous version (5.2.7740.4) it didn't happen again.

Answer 3

Thank you to both @Anonymous and @HimanshuSinha-msft !

I downloaded version 5.2.7740.4 of SHIR directly from the MS website, as it is not yet available via Azure. I updated all of our gateway servers, and can now execute data extraction pipelines without issue. Good ending to a long week!

-Mike