CopyFromSourcetoADLS, Error: The Self-hosted Integration Runtime 'integrationRuntime-edw' is offline,

Question

Operation on target ForEach1 failed: Activity failed because an inner activity failed; Inner activity name: CopyFromSourcetoADLS, Error: The Self-hosted Integration Runtime 'integrationRuntime-edw' is offline, last connect time is '06/07/2024 05:12:00.455 UTC', Self-hosted Integration Runtime id is '5cbb97a6-c6bd-4073-bb78-b4a3e505acb1'.

I received this error and not sure what it means. Also what can I do to prevent and possibly eliminate it.

Answer 1

Hello Vineyard, Mr. Scotty,

Welcome to the Microsoft Q&A forum.

SHIR sends heartbeat to ADF service every 30 seconds. If heartbeats are lost for 100 seconds, SHIR will treat SHIR as unhealthy and show offline in portal.

If heartbeats are lost for 3 minutes, ADF will stop queuing activity to SHIR queue to avoid queue overflow and activity is failed with this error.

This can be caused by machine's CPU, memory or network. As SHIR is managed by customer instead of Microsoft, customer needs to make sure the availability of machine hosting SHIR.

Here are the Possible solutions:

1. Check any connectivity issue or VM crash. If yes, escalate to your network team or VM team.
2. Check any high CPU/low memory issue caused by activity runs during the downtime. If yes, check whether it is expected and scale up machine performance if necessary.
3. If SHIR only has one node, enable SHIR high availability (https://docs.microsoft.com/en-us/azure/data-factory/create-self-hosted-integration-runtime?tabs=data-factory#high-availability-and-scalability ) to prevent from such single point failure. (No downtime during registration/addition of new node)

I hope this helps. Please let me know if you have any further questions.