Synapse-Pipeline stuck in "Queued" during copy-activity using self hosted integration runtime

Question

Hello,

we have installed a self hosted integration runtime on prem and routed the traffic through a private network. The self hosted integration runtime is shown as running in synapse and also on the machine, where it is installed. It is routed through a proxy.

When trying to do a "copy activity" by calling a rest api, which is only accessible through the self hosted integration runtime, and try to copy it to a data lake, the pipeline is in indefinitely "Queued" state. The CPU utilization of the self hosted integration runtime is low and there are no concurrent pipelines. Strangely using the preview feature for the source in the "Copy Activity", I can see the data from the rest api call. It should mean that the self hosted integration runtime is working fine and connecting to the source. The linked service is also testing fine regarding the connection. But when activating the pipeline, it only is in queued state. For the data lake I also have tested the connection and it works through a managed virtual network IR.

Any idea why I cant copy data using the self hosted integration runtime?

Best regards!

Answer 1

Hello @Z.K.Z ,

Thanks for the question and using MS Q&A platform.

As per the troubleshooting guide below are few reasons for pipeline get Queues or stuck:

Ref doc: Pipeline status is queued or stuck for a long time

If none of these applies to your scenario, then it is recommended to file a support ticket for deeper investigation. In case if you don't have a support plan, please let me know here.

Thank you