azure data factory copy activity failing column delimiter

Question

I have a source csv file which i am loading to sql db using copy activity. In the 45th row i have a cell with this kind of data with unwanted characters.

Atualmente, as solicitações de faturamento manual de serviços de mobilidade de clientes da Região

I tried loading the file. Its throwing error at row 45 that it has more column count than expected. I tried removing unwanted characters from this text. Then the copy actvty got executed. In source my delimiter is set as , by default. How can I handle this situation. Source csv file is in UTF8 format. in sql db i have set every column to varchar(max).

Answer 1

Hi @Anonymous ,

Thankyou for using Microsoft Q&A platform and thanks for posting your question here.

As I understand your issue, you are trying to copy data from .csv file to sql db , however, you are facing issue because of row having unwanted characters. Please let me know if my understanding is incorrect.

Kindly select 'Skip incompatible rows' in the Fault tolerance option in copy activity settings tab. This will enable you to continue copying the rest of the data and skip the incompatible data. It would prevent the interruption from failure in the middle of data movement .

For more details, kindly check : Fault tolerance of copy activity in Azure Data Factory and Synapse Analytics pipelines
How to Redirect Bad Records in Copy Activity in Azure Data Factory

Hope this will help. Please let us know if any further queries.

------------------------------

• Please don't forget to click on or upvote button whenever the information provided helps you.
  Original posters help the community find answers faster by identifying the correct answer. Here is how
• Want a reminder to come back and check responses? Here is how to subscribe to a notification
• If you are interested in joining the VM program and help shape the future of Q&A: Here is how you can be part of Q&A Volunteer Moderators