SFTPServerNotReturnExpectedDataLength

Question

SFTPServerNotReturnExpectedDataLength

sridhar 6

Hi,

We are facing the issue with while copying a file (comma delimited and with a file format PVXXXXX and without extension ) from an SFTP server (LINUX) into Azure using Copy activity from SFTP to Blob.

Below is the error message

If the file is marked as a binary in Linux (I think filetype as 0 as per our SFTP counter part), we are able to copy. but if the file type is mentioned as AscII (filetype as 1) it is failing.

Failure happened on 'Sink' side. ErrorCode=SftpServerNotReturnExpectedDataLength,'Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=Error occurred when trying to fetch the SFTP file 'pv112235'. This could be a transient issue and you may rerun the job. If it fails again continuously, contact customer support.,Source=Microsoft.DataTransfer.ClientLibrary.SftpConnector,'

Can you please help here

Thanks,
Sridhar

Answer 1

ShaikMaheer-MSFT 31,551 Microsoft Employee

Hi @sridhar ,

Thank you for posting query on Microsoft Q&A Platform.

Could you please try below suggestions and see if that helps.

Re-run your pipeline for the failure and see if that resolves issue?
Could you please try to use your source and sink dataset type as binary and load in Sink system as .csv file?
Below link has similar issue discussion, it seems sometimes SFTP may told to ADF incorrect file size which in turn may cause this issue. Kindly go through below link
https://learn.microsoft.com/en-us/answers/questions/316557/error-34failure-happened-on-39sink39-side-sftpserv.html

sridhar 6 Reputation points

2021-09-23T18:14:29.68+00:00

Hi Maheer, We cannot mark them as binary as the file at source is process generated and that will be of code 101 type (which is Ascii text file).
And the other suggestions are not working for me.. Can you plz help here

Thanks,
sridhar
sridhar 6 Reputation points

2021-09-28T11:40:49.19+00:00

Hi team,

Can I get some help on this. Any additional properties do we need to set up on source and sink side. My use case is it is comma delimited text file not able to be copied to blob from SFTP when file code is 101. Below is the command for reference for the file properties on SFTP. Any help will be appreciated.

put [source file] [destination file],101,50,50,200

Thanks,
Sridhar
ShaikMaheer-MSFT 31,551 Reputation points Microsoft Employee

2021-09-29T11:45:46.33+00:00

Hi @sridhar ,

Thank you for being patience on this.

Majorly its because of communication gap between your SFTP and ADF as discussed in below thread. I would encourage you to have a support ticket for this issue. Please feel free to share support ticket details here as well(preferably as private message) so that I can also follow up on ticket for speed resolution.

Answer 2

sridhar 6

The issue got resolved by Microsoft Support: there is an undocumented feature "disableChunking": true that solved the problem which is yet to be released

ShaikMaheer-MSFT 31,551 Reputation points Microsoft Employee

2021-12-23T16:28:49.907+00:00

Hi @sridhar - Thank you for sharing resolution details.

Kindly consider marking it as accepted answer? Accepted answers helps community as well.

SFTPServerNotReturnExpectedDataLength

2 answers

Activity