ADF error when unzipping file

John Aherne 106 Reputation points

I have seen this issue pop up here before, but no solutions.

We are downloading a zip file from SFTP, to ADLS gen 2 using a copy activity.
Then another copy activity unzips the file to a separate location.
This has been working for all files until yesterday. The zip file in question has one really large file (just over 25gb) and two smaller files - 812mb, and a few kb. The zip file itself is 1.8gb.

We are copying using a binary dataset for source and sink, with ZipDeflate.
The IR is autoresolve East US.

The two smaller files are extracted and look to be ok, but we get an error on the third file.

The error we are getting is:
Code: 9011
Failure happened on 'Source' side. ErrorCode=UserErrorFailedFileOperation,'Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=Upload file failed at path path/xyz.txt.,Source=Microsoft.DataTransfer.Common,''Type=System.ArgumentOutOfRangeException,Message=Number was less than the array's lower bound in the first dimension.
Parameter name: srcIndex,Source=mscorlib,'

We have manually downloaded the zip file from Azure storage and unzipped it successfully on our desktop. We rezipped the files and uploaded to storage but got the same error again.

Is there an upper limit we are hitting with the capabilities of the copy activity?


Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
7,159 questions
{count} votes