Data Factory SFTP Linked Services via self-hosted integration runtime failed on copy activity with timeout error

Question

Hi there, I have a sftp linked service. The connection works fine for both dev and test environment, but I've got error on production. The linked services using self-hosted integration runtime and the production linked service works fine when test connection and it also can be use to navigate the sftp folders without any issues, but copy activity failed with the error
"Meet network issue when connect to Sftp server, SocketErrorCode: 'TimedOut'. A connection attempt failed because the connected party did not properly respond after a period of time, or established connection failed because connected host has failed to respond ."

Answer 1

Hello Kathy,

Welcome to the Microsoft Q&A forum.

Below is one of the reasons for this error:

If the Copy activity ran several times inside a ForEach loop, creating many connections. Then the SFTP server closed the connection because of too many connection requests sent from Azure Data Factory.

Resolution

Optimize the pipeline structure to reduce the connections created to your SFTP server.

If the above solution doesn't resolve, please try the below.

Whitelist SHIR IPs on the SFTP server.

Change max concurrent connection to 1

I hope this helps.

Answer 2

Hi BhargavaGunnam,

Thank you very much for your help. The sftp site has no whitelisting IPs and the connection is public SSH key along with passphrase. We found out that we need enable the AWS link at our end. So the connection issue now is solved. Thanks again.

But now we have new issue regarding the Java run time, the new error is " java run time not found", but we had installed the latest JRE on both notes, and configured environment for the path.