Copy Data Activity - Additional Columns - More Columns Than Expected

b-sherbert 1 Reputation point

I am new to ADF and the soloution is likely simple but I have not been able to find it anywhere.

I am attempting to copy csv files from a SFTP server to an Azure container. I am using the "additional columns" feature in the copy activity to add the name of the source files as well as the load date (using the system variable @pipeline().TriggerTime). The first row is used as a header in both source and sink datasets. I am getting an error for "more columns than expected" upon execution. The pipeline runs fine without the additional columns. What am I missing?


Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
7,174 questions
{count} votes

1 answer

Sort by: Most helpful
  1. Nasreen Akter 10,656 Reputation points

    Hi @b-sherbert ,

    Thank you for the ask. I was wondering about the schema you have for the SINK dataset. Did you set a schema for the SFTP_to_DW dataset. If you have, please add the two columns in your SINK-Schema. Hope that helps, thanks!