Data feild comma data impact to csv file creation issue

Mahesh Madhusanka 216 Reputation points
2020-06-19T17:49:07.423+00:00

Hi Team,

Currently i have setup a copy activity for a SQL query output .csv file create on the Data Lake destination, But in the one table address level details there have a comma (,) on the inside of the data fields, Due to the that reason, created .csv file data has been spitted as a abnormally and incorrectly, How can i sort out this issue? Could you please advise on this for your reference below have attached sample issue snap.

10358-database-feild-comma.jpg

10359-datalake-csv-output.jpg

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,161 questions
0 comments No comments
{count} votes

1 answer

Sort by: Most helpful
  1. MartinJaffer-MSFT 26,061 Reputation points
    2020-06-22T17:37:08.497+00:00

    Hello @Mahesh Madhusanka and thank you for your question.

    One solution would be adjusting your csv creation so it quotes the problematic field. Quoting a field helps recognize that any commas inside the quotes are part of the value, and not for separating the cells. Your values already have "quotes" in them, so a different character/symbol should be used. In the delimited text dataset you can specify what you use for the quote character. Whichever character you choose, it should not be found in any of your values.

    My personal favorite, is the control character "bell" .

    ----------

    Thank you

    Please do consider to click on "Accept Answer" and "Upvote" on the post that helps you, as it can be beneficial to other community members.