Errors while downloading files from SFTP

Question

Hello,

I'm encountering an error since a few days from a pipeline that has been working fine for months, on the same SFTP server, with no changes recently.

The pipeline look up for files in a SFTP server (Get Metadata activity), then download each file to ADLS (Copy activity).

This is the error I get :

Failure happened on 'Sink' side. ErrorCode=UserErrorFailedToReadStream,'Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=Failed to read data from Sftp server 'sftpserver.com', file path '/path/myfile.zip', offset '16777216', length: '16777216'.,Source=Microsoft.DataTransfer.ClientLibrary.SftpConnector,''Type=Renci.SshNet.Common.SshException,Message=Failed to read file.,Source=Renci.SshNet,'

What could be the cause of this? It has been working fine for months.

Thanks

Answer 1

Hello @Alexandre G ,

Thanks for posting your question and using MS Q&A platform.

The error message indicates that the SFTP server not support read from non-zero offset. And our service has no changes recently, so I suspect there is behavior change in your SFTP server side.

Besides, I would suggest you to try this: in copy source, set max concurrent connections to 1, and see how the result.

Investigating with the provided activity id:

We suspect there are some changes on server side. I would suggest you reach out to the SFTP server vendor.

Hope this helps. Do let us know if you any further queries.

---------------------------------------------------------------------------

Please "Accept the answer" if the information helped you. This will help us and others in the community as well.