Decompression error when file was copied via ADF

Priya Jha 896 Reputation points
2022-08-01T13:25:48.813+00:00

I am copying a gz zipped csv file from SFTP location to blob via ADF and using compression option of binary dataset while copying as shown below:

226768-dataset.jpg

But receiving below error:

ErrorCode=InvalidDataFormat,'Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=The source data has an invalid format. Cannot decompress the source data. Source file name: '1.csv.gz'.,Source=Microsoft.DataTransfer.ClientLibrary,''Type=ICSharpCode.SharpZipLib.SharpZipBaseException,Message=Unexpected EOF,Source=ICSharpCode.SharpZipLib,'

Also tried to unzip that file using winzip tool and facing below error:
226680-sftperror.jpg

But when i directly download the file from SFTP and unzip it, the file gets unzipped properly.

Any idea why only receiving this decompression error when file is getting copied via ADF?

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,623 questions
{count} votes

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.