Copy activity - Escape Character (\)

Question

Copy activity - Escape Character (\)

Madugundu Somashekara, Roopa 46

Hi Team,

I am using a copy activity with both source and sink dataset as binary. Also, I am trying to move the files using this copy activity i.e, checking the option "Delete files after completion"
In the source dataset, I've selected file in the dataset path and giving the value 'qrepc/country/@dataset().FileName'
Similarly for the sink dataset, I am giving the path 'qrepc/archive/country/@dataset().FileName'
When I am running the pipeline I am getting error as per below screenshot.

There are no escape characters in my filename but still it is showing error (). Could you kindly help how this can be resolved?

Thanks in advance!

Anonymous

2023-01-04T21:55:23.877+00:00

The actual error message is 'This operation not permitted because the blob has snapshots" so the /\ in the path may not be related at all. I am not familiar with snapshots on blob storage, I see where I can create one for a blob in the portal but don't know if that is the only way. Versioning is similar but seems to be different. In the portal you can view snapshots for a blob so maybe look at that and if you can remove them to see if the error goes away.

1 answer

Your answer

Anonymous

2023-01-04T21:55:23.877+00:00

The actual error message is 'This operation not permitted because the blob has snapshots" so the /\ in the path may not be related at all. I am not familiar with snapshots on blob storage, I see where I can create one for a blob in the portal but don't know if that is the only way. Versioning is similar but seems to be different. In the portal you can view snapshots for a blob so maybe look at that and if you can remove them to see if the error goes away.

Answer 1

MartinJaffer-MSFT 26,161

Hello @Madugundu Somashekara, Roopa ,
Thanks for the question and using MS Q&A platform.

As I understand, you are getting error when using Copy Activity + "Delete files after completion". You think it has to do with a backslash \

I agree with @Anonymous 's assessment. Can you please test this by in the Copy Activity, by unchecking "Delete files after completion" ? If it works without deleting files, then the cause it the snapshots being not-deletable. If it still fails, share the error message.

Snapshots are read-only, so trying to write over a snapshot is expected to fail.

Is the snapshot on the source side, the sink side , or both?

In further research, I found this error code mentioned on the "delete blob" operation.

If this header isn't specified on the request and the blob has associated snapshots, Blob Storage returns status code 409 (Conflict).

In this case, it sounds like Data Factory might be forgetting to send the "delete all snapshots and blob" or "delete only snapshots" message. I'll try on my side, and maybe talk to the product group.

Please do let me if you have any queries.

Thanks
Martin

Please don't forget to click on or upvote button whenever the information provided helps you. Original posters help the community find answers faster by identifying the correct answer. Here is how
Want a reminder to come back and check responses? Here is how to subscribe to a notification
- If you are interested in joining the VM program and help shape the future of Q&A: Here is how you can be part of Q&A Volunteer Moderators

Madugundu Somashekara, Roopa 46 Reputation points

2023-01-09T09:44:46.77+00:00

Thanks for your response!

Indeed it was the snapshots that was causing the issue. I've fixed it and now its working fine.
MartinJaffer-MSFT 26,161 Reputation points

2023-01-11T17:19:49.0766667+00:00

I have reproduced the error, and will not raise a bug report internally.
MartinJaffer-MSFT 26,161 Reputation points

2023-01-11T17:22:47.0566667+00:00

Great, thanks for letting me know. Since this resolved your issue, please mark as accepted answer Madugundu Somashekara, Roopa

Share via

Copy activity - Escape Character (\)

1 answer

Your answer