Share via

Unable to produce .CSV files in ADF without surrounding quotation marks

DLPDev 1 Reputation point
2022-01-24T19:38:15.13+00:00

Similar issue was also asked here: attempting-to-disable-quote-all-text-option-when-c.html

Currently when trying to use the Copy activity and having a DelimitedText as a sink, it is surrounding all fields with quotation marks. Normally, this could be worked around by changing the settings in the dataset Escape Character and Quote Character to none but it doesn't seem to make a difference.

I've tried manually changing the setting of quoteAllText to false in the JSON for the pipeline, but it now throws this error:

ErrorCode=DelimitedTextInvalidSettings,'Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=QuoteAllText cannot set to false for Copy activity currently.,Source=Microsoft.DataTransfer.ClientLibrary,'... Why?

Is there a workaround? I've tried transforming the data using a data flow but it still adds quotation marks at the sink stage

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,196 questions

1 answer

Sort by: Most helpful
Most helpful Newest Oldest
  1. svijay-MSFT 5,226 Reputation points Microsoft Employee
    2022-01-25T14:04:30.99+00:00

    Hello @DLPDev ,

    Thanks for the question and using MS Q&A platform.

    There could be a possibility that are comma (,) in between the quoted texts. If this is your case, you could also try changing the delimiter to alternative character.

    168328-image.png

    Retain the setting Escape Character and Quote Character to none but it doesn't seem to make a difference.

    If this is not your case, can you please provide additional information on Source Datatype & Source Configuration.

    Hope this will help. Please let us know if any further queries.

    ------------------------------

    • Please don't forget to click on 130616-image.png or upvote 130671-image.png button whenever the information provided helps you. Original posters help the community find answers faster by identifying the correct answer. Here is how
    • Want a reminder to come back and check responses? Here is how to subscribe to a notification
    • If you are interested in joining the VM program and help shape the future of Q&A: Here is how you can be part of Q&A Volunteer Moderators