Facing Socket connection error while copying data from SFTP to Azure Blob Storage , linked service for SFTP is working, file names are also read from SFTP folder but while copying the files from SFTP to Azure Blob, it is throwing error.

Question

Azure Data Factory Copy activity to copy files from SFTP to Azure Blob Storage is throwing below error.

ErrorCode=SftpNetworkIssue,'Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=Meet network issue when connect to Sftp server '**********.com', SocketErrorCode: 'TimedOut'.,Source=Microsoft.DataTransfer.ClientLibrary.SftpConnector,''Type=System.Net.Sockets.SocketException,Message=A connection attempt failed because the connected party did not properly respond after a period of time, or established connection failed because connected host has failed to respond,Source=Renci.SshNet,'

These pipelines were running successfully from last 1.5 years, but from last couple of days, i am getting this error.

Connection is properly established via Linked service with SFTP , process is also able to succesfully fetch the file names from SFTP folder, but while copying the file, it is throwing error.

I tried to set concurrent connection to 1 for SFTP source, but there is no success.

Answer 1

Hello Rekha Rani,

Welcome to the Microsoft Q&A forum.

Per the error message " Meet network issue when connect to Sftp server '**********.com'"

the issue is with the network when connecting to the SFTP server from the ADF(could be a firewall issue or max concurrent connections issue)

Can you please try the below and see if it resolves the issue?

1. whitelist the ADF URL
2. Open port 443 and SHIR VM Ip in the SFTP server
3. set your sink Max concurrent connection less than the SFTP concurrent connection limit set by SFTP admin

If this doesn't help, please work with your network admin to open a network trace and see if the SHIR requests reach the SFTP server.

A similar thread has been discussed here with a detailed solution.

I hope this helps. Please let me know if you have any further questions.

If this answers your question, please consider accepting the answer by hitting the Accept answer and up-vote as it helps the community look for answers to similar questions.