No escape character not working as expected

Question

I am using a copy data activity to copy data from ADLS into Snowflake. My source data is a gzip csv file which is pipe delimted. One of the field has the following value ending with a "\". The pipe delimiter after the field is ignored making my pipeline to fail. I have selected no escape character and also tried to provide an unused character (^). But the copy activity still ignores the setting and escapes the delimiter.

COMPANY NAME\

I cannot change my source file format. Is there a way to skip the "\" as escape character? Why is ADF not respecting the setting of no escape character?

Answer 1

Hello @Manohar Punna and thank you for bringing this to our attention.
Thank you anonymous user for the assistance. Please continue to help the community.

I believe this is a bug in the preview data feature in the UI, but not in the actual copy. The actual copy respects your escape character choice. See below.

When previewing I reproduced your issue.

Then I tried a debug run anyway, copying with the above source settings to a sink of blob csv. Below you see the results.

Please let me know if this helped. I will raise a bug report internally. Thank you for showing this issue so it can be fixed.

Answer 2

@Manohar Punna Do you want "COMPANY NAME \" to be "COMPANY NAME"? Are you trying to capture with the "\" after the COMPANY NAME \ hidden, as in the attached capture?![30244-%E3%82%AD%E3%83%A3%E3%83%95%E3%83%81%E3%83%A3.png][1] [1]: /api/attachments/30244-キャフチャ.png?platform=QnA