Synapse Copy task fails with error 409

Question

The copy task starts and copies a part of the files successfully, but then it fails with this error:

Operation on target Copy data1 failed: Failure happened on 'Sink' side. ErrorCode=AzureBlobWriteOperationFailed,'Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=Blob write operation on path='....' and blobName='...' failed with error message: The remote server returned an error: (409) Conflict..,Source=Microsoft.DataTransfer.ClientLibrary,''Type=Microsoft.WindowsAzure.Storage.StorageException,Message=The remote server returned an error: (409) Conflict.,Source=Microsoft.WindowsAzure.Storage,StorageExtendedMessage=The requested operation is not allowed in the current state of the entity. RequestId:4dc9e99c-901e-001c-7935-c69cf9000000 Time:2023-08-03T18:08:03.0942629Z,,''Type=System.Net.WebException,Message=The remote server returned an error: (409) Conflict.,Source=System,'

Any ideas?

Answer 1

Andrei F,

Thanks for confirming that this is not a firewall issue.

I checked with my internal team, and here is the possible root cause for this error.

This error can also occur when multiple activities are operating on the same file

Please check if the file is opened by some other tools when performing the copy. If yes, it will meet with 409 error.

I hope this helps.