Azure data factory copy to sftp times out from sql database

Question

I'm trying to create a pipeline that gets data from a sql stored procedure and copies it to an sftp. But I get the error: ErrorCode=SftpNetworkIssue,'Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=Meet network issue when connect to Sftp server '[redacted]', SocketErrorCode: 'TimedOut'.,Source=Microsoft.DataTransfer.ClientLibrary.SftpConnector,''Type=System.Net.Sockets.SocketException,Message=A connection attempt failed because the connected party did not properly respond after a period of time, or established connection failed because connected host has failed to respond,Source=Renci.SshNet,' I am able to connect to the sftp and was able to perform a copy operation successfully from the sftp to a different file on the sftp without issue using the exact same settings for the sink. Additionally, when I do a data preview on the stored procedure, I am able to connect and get the correct data. But it's not able to copy from an outside source to the sftp for some reason. It appears that the sql server data is being read but can't be copied, and it times out after 3 minutes despite my timeout settings for my copy being over an hour.

Answer 1

Hi,

Thanks for reaching out to Microsoft Q&A.

,Message=A connection attempt failed because the connected party did not properly respond after a period of time, or established connection failed because connected host has failed to respond,Source=Renci.SshNet,'

From the error message the connection could not be made successfully. Pls check if the linked services you are using for sink is all good? Also when you say it is able to read but unable to write, check any firewall blocks for incoming connections has been in place to the sftp in your environment.

I am able to connect to the sftp and was able to perform a copy operation successfully from the sftp to a different file on the sftp without issue

Thats obvious. It will work without any issues when you are copying when both source and sink are same. I also presume you used the same linked service for source and sink in this scenario.

Please Upvote and Accept as answer if the reply was helpful, this will be benefitting the other community members who go through the same issue.

==================================================