ADF -- Issue in unzipping

Mahesh Kumar SSM 66

Hello All,

I am facing an issue where a zip file which is around 21 MB fails while unzipping. The rest all files ranging 130 KB to 2.7 MB get unzipped perfectly. This 21 MB file, when I download to my local machine, I am able unzip it without any issues.

Attaching screenshots for your reference...

The screenshot "Error_13Apr" shows the error message.

The screenshot "File List_13Apr" shows the list of the files (which are less than 21 MB) that have succeeded and the file (which is around 21 MB) that has failed.

Please advise.
Thanks.

Note:

**
I have posted this issue in a related link as below...
https://learn.microsoft.com/en-us/answers/questions/96042/adf-fails-to-unzip-files.html

But, not sure, if that is being addressed, so I have posted here as a new issue.

Regards,
Mahesh

MartinJaffer-MSFT 26,011 Reputation points

2021-04-14T17:39:26.063+00:00
Hello @Mahesh Kumar SSM and welcome to Microsoft Q&A.

Thank you for opening a new thread. I do not monitor old threads as closely as new threads.

A couple questions,

is this the largerst of the files? are there any similar or larger sized ones which unzip properly?

are you using a self-hosted integration runtime or Azure integration runtime or something else?

zip files can contain single files, or entire directories. Are all of yours the same type?
Mahesh Kumar SSM 66 Reputation points

2021-04-15T03:27:04.797+00:00
Hello @MartinJaffer-MSFT ,

Thanks for replying!

Please find below my responses inline....

Is this the largest of the files? are there any similar or larger sized ones which unzip properly?

Yes. It is the largest of the files. All other files are less than 5 MB and they unzip properly.

are you using a self-hosted integration runtime or Azure integration runtime or something else?

We are using an Azure integration runtime (Region: AutoResolve)

zip files can contain single files, or entire directories. Are all of yours the same type?

Yes all the zip files contain only csv files.

Let me know if you need further details.
Thank you.
MartinJaffer-MSFT 26,011 Reputation points

2021-04-16T15:26:40.593+00:00

I was able to copy a csv of 100000 rows, 9712kb compressed (zip) to 22604kb uncompressed, using blob CSV -> blob CSV.

Other things I can try, using blob binary -> blob binary, making a larger file, other compression types.
Mahesh Kumar SSM 66 Reputation points

2021-04-19T07:22:59.703+00:00

@MartinJaffer-MSFT ..Thanks for your response !

A couple of questions...

1) You have mentioned about .9712kb compressed (zip) to 22604kb uncompressed, using blob CSV -> blob CSV.

My scenario is: the 21 MB zip file is itself a compressed file. Please refer the screenshots below..

2)
May I know what do you mean by "blob CSV -> blob CSV" , "blob binary -> blob binary" ?
Mahesh Kumar SSM 66 Reputation points

2021-04-19T07:27:39.73+00:00

@MartinJaffer-MSFT , thanks for your response !

A couple of queries...

1) You have mentioned as "9712kb compressed (zip) to 22604kb uncompressed". But, my scenario is, the 21 MB zip file is a compressed file.

2) May I know what do you mean by "blob CSV to blob CSV", "blob binary -> blob binary" ?
MartinJaffer-MSFT 26,011 Reputation points

2021-06-15T16:45:00.363+00:00

I mean using a different dataset type. By blob I mean a blob container in storage account. By CSV I mean delimited text dataset. Blob CSV means a delimited text document in a blob container in storage account.

The binary is another dataset type. The special thing about binary, is it does not try to read as a document. It just moves as-is. It can also do de/compression.