Is there any way to strip out commas in an ADF Pipeline from a created CSV file? urgent also

Mike Kiser 1,531

Hi @Nasreen Akter @MartinJaffer-MSFT @KranthiPakala-MSFT

I have an output of a Pipeline which is a CSV file containing commas; I could not figure out a way in ADF to remove those commas, so I had to use a Logic App called by the pipeline just for this. Is there anyway in ADF to remove commas in a CSV file?

Thanks!
Mike

MarkKromer-MSFT 5,186 Reputation points Microsoft Employee

2021-06-29T00:51:10.363+00:00

Are you trying to remove even the commas that are separating the values in your CSV?
Mike Kiser 1,531 Reputation points

2021-06-29T15:09:31.73+00:00

Yes, it's a strange report format that we have to follow...
Thanks,
Mike
ShaikMaheer-MSFT 38,046 Reputation points Microsoft Employee

2021-06-30T05:19:31.643+00:00
Hi @Mike Kiser ,

Thank you for posting query in Microsoft Q&A Platform.

Could you please confirm is my below understanding correct?

You have a csv file which has columns separated by commas(,) and you want to generate a file from it which should contain all data without commas? Is it correct ?

Kindly correct me if my understanding is wrong. That will help us to share detailed resolution. Thank you
ShaikMaheer-MSFT 38,046 Reputation points Microsoft Employee

2021-07-05T06:36:25.547+00:00

Hi @Mike Kiser ,

Did you get chance to look above comment to confirm is understanding correct? Kindly help us to confirm our understanding so that we will try to repro and share detailed answer. Thank you.
Mike Kiser 1,531 Reputation points

2021-07-06T01:05:50.973+00:00

@ShaikMaheer-MSFT ,

Yes, I am just trying to remove the commas separting the values in the CSV, but hoping I can do it in an ADF Pipeline...

Thanks!
Mike

Accepted answer

ShaikMaheer-MSFT 38,046 Reputation points Microsoft Employee

2021-07-06T07:51:55.4+00:00
Hi @Mike Kiser ,

Thank you for posting query in Microsoft Q&A Platform.

We can use dataflows you achieve your requirement.

Kindly check below detailed steps to understand better.

Step1: Source Transformation.

Step2: Derived Column Transformation to generate a new column all columns merged in it.

Step3: Select Transformation to take only merged column.

Step4: Sink Transformation to load data in to target

Hope this will help. Thank you

Please accept an answer if correct. Original posters help the community find answers faster by identifying the correct answer. Here is how.

Want a reminder to come back and check responses? Here is how to subscribe to a notification.
Please sign in to rate this answer.

1 person found this answer helpful.
Mike Kiser 1,531 Reputation points

2021-07-06T17:56:05.437+00:00

@ShaikMaheer-MSFT

Wow, thanks for the detailed reply!! That works great!!

Mike Kiser

ShaikMaheer-MSFT 38,046 Reputation points Microsoft Employee

2021-07-07T04:59:11.6+00:00

Hi @Mike Kiser ,

Glad to know that. Happy to help. Thank you.

Sharon Southwood 0 Reputation points

2024-01-26T13:23:19.8133333+00:00

Hi - your solution above will remove commas from all the rows, but we have to remove only extra comma on last row. How can this be done please?

Sharon Southwood 0 Reputation points

2024-01-26T13:25:01.06+00:00

Hi @ShaikMaheer-MSFT Your solution will remove commas from all the rows, but we have to remove only extra comma on last row - how is this possible please?
Sign in to comment

Is there any way to strip out commas in an ADF Pipeline from a created CSV file? urgent also

0 additional answers