This browser is no longer supported.
Upgrade to Microsoft Edge to take advantage of the latest features, security updates, and technical support.
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(262.40000000000003, 50%, 35%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EBS%3C/text%3E%3C/svg%3E)
I am new to ADF and the soloution is likely simple but I have not been able to find it anywhere.
I am attempting to copy csv files from a SFTP server to an Azure container. I am using the "additional columns" feature in the copy activity to add the name of the source files as well as the load date (using the system variable @pipeline().TriggerTime). The first row is used as a header in both source and sink datasets. I am getting an error for "more columns than expected" upon execution. The pipeline runs fine without the additional columns. What am I missing?
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(134.4, 9%, 23%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EKM%3C/text%3E%3C/svg%3E)
Hello @b-sherbert ,
Just checking in to see if the below guidance provided by @Nasreen Akter was helpful to resolve your issue. If it answers your query, do click Accept Answer and Up-Vote for the same. And, if you have any further query do let us know.
Thank you
Hi @b-sherbert ,
Thank you for the ask. I was wondering about the schema you have for the SINK dataset. Did you set a schema for the SFTP_to_DW dataset. If you have, please add the two columns in your SINK-Schema. Hope that helps, thanks!
Thank you for the response. I had left the schema for the sink dataset blank at the time since the copy is creating a new csv file in the sink destination folder. I now have tried both with and without the schema (including the additional column) for csv files and for a different sink table in Azure SQL DB. with each attempt I get the same error. Any other ideas on what the issue could be?
Hi @b-sherbert , you can enable CopyActivity --> Settings --> Fault Tolerance >> Skip incompatible rows and log the rows to check if the Source Data is correct.