Is there any way to strip out commas in an ADF Pipeline from a created CSV file? urgent also

Mike Kiser 1,531 Reputation points
2021-06-28T19:17:35.743+00:00

Hi @Nasreen Akter @MartinJaffer-MSFT @KranthiPakala-MSFT

I have an output of a Pipeline which is a CSV file containing commas; I could not figure out a way in ADF to remove those commas, so I had to use a Logic App called by the pipeline just for this. Is there anyway in ADF to remove commas in a CSV file?

Thanks!
Mike

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
9,444 questions
{count} votes

Accepted answer
  1. ShaikMaheer-MSFT 37,656 Reputation points Microsoft Employee
    2021-07-06T07:51:55.4+00:00

    Hi @Mike Kiser ,

    Thank you for posting query in Microsoft Q&A Platform.

    We can use dataflows you achieve your requirement.

    Kindly check below detailed steps to understand better.

    Step1: Source Transformation.
    112009-source.gif

    Step2: Derived Column Transformation to generate a new column all columns merged in it.
    112102-derviedcol.gif

    Step3: Select Transformation to take only merged column.
    112111-select.gif

    Step4: Sink Transformation to load data in to target

    Hope this will help. Thank you


    • Please accept an answer if correct. Original posters help the community find answers faster by identifying the correct answer. Here is how.
    • Want a reminder to come back and check responses? Here is how to subscribe to a notification.
    1 person found this answer helpful.

0 additional answers

Sort by: Most helpful