ADF copy activity logging changing order of CSV columns in OperationItem

Nicholas 96 Reputation points
2021-03-02T22:45:18.953+00:00

Trying to export all failed (incompatible) rows for an input CSV file and was hoping I could use the output found in OperationItem, but I have found that in my example file the last two columns are swapped and there is an extra comma at the end. I'm using the correct double quote escaping, it just looks like ADF is changing the order of the CSV columns. Is this a bug?

The setting are here:
73489-image.png

And I found it was the last two columns (could be others too).
Source file:
73509-image.png

Output from the logging when it skips incompatible rows:
73552-image.png

NOTE: The error is because a field in the CSV exceeds the size of a SQL column.

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
9,879 questions
{count} votes