Hello @Ryan Abbey ,
Thanks for the ask and using the Microsoft Q&A platform .
This is a very data-ecentric ask and without looking at the data its very difficult to help here . Do you think you can share the csv file ( may be the size of the file can be an issue ) ? If you think sharing the file here is an issue , you can email the file at email@example.com .
One thing which you can try ( if possible ) , ingest the csv file to a sql table . But make sure that you choose the auto create table option . I am assuming with that option set the ADF will not complain about the mismath and will create 51st column and then you can query on that table do find that row .
Please do let me know how it goes .
I've also found the same issue. Fault tolerance throws a single line, which is a merger of two lines separated correctly.
This only happens when using ZipDeflate and bulk insert from within a copy activity within an ADF.
Using PolyBase with staging loads successfully.