SFTP Connection Issue

Question

SFTP Connection Issue

Kothai Ramanathan 946 Microsoft Employee

I am trying to copy from file share to sftp and getting the below error.

Message=Meet network issue when connect to Sftp server 'xxx', SocketErrorCode:
'TimedOut'.,Source=Microsoft.DataTransfer.ClientLibrary.SftpConnector,''Type=System.Net.Sockets.SocketException,
Message=A connection attempt failed because the connected party did not properly respond after a period of time,
or established connection failed because connected host has failed to respond,Source=Renci.SshNet,'"

However, the same pipeline works in a different environment (to the same sftp server). I have compared the linked service, dataset and the pipeline code between the two environments are they are the same.

When I test the connection in the linked service, it is successful. Any pointers on the above error will be helpful, thanks.

Accepted answer

2 additional answers

Your answer

Answer 1

KranthiPakala-MSFT 46,642 Microsoft Employee Moderator

Hi @Kothai Ramanathan ,

Thanks for your query. This could be because of either of the below 2 reasons:

a. It could be related to a firewall issue, if you are using SHIR on either source or sink and if the access is restricted to IPs that are whitelisted in the firewall rules of your SFTP, then could you please make sure to whitelist the IP address of the machine that hosts your SHIR. If you are using Azure IR, then you can choose to add Azure Integration Runtime IPs into the allow list.

Here is the download link: Azure IP Ranges and Service Tags – Public Cloud

b. Another possible reason I could think of is the number of Max concurrent connections to your SFTP server. Could you please check out what is the maximum concurrent connection limit to your sftp server? Based on that please set your sink Max concurrent connection less than the SFTP concurrent connection limit set by SFTP admin.

Hope this information helps. If you still experience the issue, please do share the failed pipeline runID for further investigation.

Thank you

Please do consider to click on "Accept Answer" and "Upvote" on the post that helps you, as it can be beneficial to other community members.

Kothai Ramanathan 946 Reputation points Microsoft Employee

2020-09-22T03:48:50.62+00:00

Thank you @KranthiPakala-MSFT for the details.

a. I guess it is not a IP issue, as when I test the connection, I am able to browse the folders in the SFTP server.
b. I am only transferring 3 small files, and this works perfectly fine from my dev environment. Hence dont this is an issue either.

This is one run id that has failed. e05fdf72-449d-4c0d-9a5d-301ac5836147

Any pointers to resolve this issue will be helpful.

Thanks,
Kothai.
Kothai Ramanathan 946 Reputation points Microsoft Employee

2020-09-22T09:47:58.393+00:00

Thank you @KranthiPakala-MSFT for further details. Yes, it was a case of IP whitelisting.
KranthiPakala-MSFT 46,642 Reputation points Microsoft Employee Moderator

2020-09-23T04:53:29.107+00:00

@Kothai Ramanathan - Glad to know your issue was resolved. Thanks for confirming it's a SHIR machine network issue.

Here is few additional info why you were able to test connection of SFTP but fails when copy pipeline is triggered.
The reason is when you did test connection to your sink SFTP, Azure IR is being used to test the connection, but when you actually trigger run the pipeline, your copy is executed on SHIR since you source (Fileshare) is using SHIR and sink SFTP is using Azure IR.

Please see below document for better understanding of this behavior: Copy activity determining which IR to use

Hope this additional information will be helpful for other community members who read this thread.

Thank you & Stay safe
Fahad Hameed 1 Reputation point

2021-08-12T14:02:58.137+00:00

Hi @KranthiPakala-MSFT , I am using Copy activity to copy file from source hosted by SHIR and target in Azure Runtime and facing the issue you mentioned above. Can you please guide what can be a possible solution to it?
Thanks in advance.

Answer 2

atul sahu 6

Hi Team,

Is there a set of standard-setting (like timeout value ), I need to share with the SFTP server admin?

My pipeline keeps failing on the linked service test, 2/5 times.

Answer 3

KANNIBALA MISKIN KANNISAH 31

Hi

I'm also facing the same issue.
Flow was working fine in DEV environment but it's getting failed in TST.

Copy activity- File share (SHIR) to SFTP (AutoResolveIntegrationRuntTime).

Pipeline RunID: 3a9964b0-c33f-4253-a732-30d14f21c0e6
Run ID: 003231b9-be86-4f81-87c0-f828801ecb0a

@KranthiPakala-MSFT

Share via

SFTP Connection Issue

2 additional answers

Your answer