SSIS Flat File Connector truncates DT_TEXT data

Question

What do we have:
CSV file with long rows, around 6m symbols
DTSX Package with DT_TEXT data type and Flat File Connector
ssis 2008 on windows 2008
ssis 2016(RTM, but also tested on SP3) on window 2019

Issue:
Package reads well all 100 rows using 2008 SSIS
It reads 30/100 rows on 2016 SSIS via , package is green, but the 30th row is truncated.

Tested cases:

1. this case removes option that we have wrong data
   If I move this 30th row to any other position in the files(1st or 100th), It will read all 100 rows without any data truncation.

Existed solution:
If I avoid Flat File Connector and use Script Task as a source - it works.

Now I understand that all my 2016 DTSX packages with DT_TEXT can have such problem and I just have not caught them yet.

So, what is the problem in 2016 Flat File Connector, which doesn't exists in 2008?
Could it be related to different Windows version?
I want to use Flat File Connector, but I need to be sure that it works properly.

I found related case:
https://social.msdn.microsoft.com/Forums/en-US/c1eb58ce-696e-42ef-9fe2-fc299e0b6be4/flat-file-source-truncates-data?forum=sqlintegrationservices
But there is no answer regarding the root of the issue.

Answer 1

Hi @Artem O ,

Could you please help check if you use SSIS2017 or higher version, will the issue occur or not?

As you said that there is no weird characters in the file, have you found any other files which would truncate the row in flat file connector?

If the issue still occurs, I recommend you to submit your issue to the Microsoft feedback at this link https://feedback.azure.com/d365community/forum/04fe6ee0-3b25-ec11-b6e6-000d3a4f0da0 . This site will serve as a connecting point between you and Microsoft, and ultimately the large community for you and Microsoft to interact with. Your feedback enables Microsoft to offer the best software and deliver superior services, meanwhile you can learn more about and contribute to the exciting projects on Microsoft feedback.

Regards，

Zoe

---

If the answer is the right solution, please click "Accept Answer" and kindly upvote it. If you have extra questions about this answer, please click "Comment".

Note: Please follow the steps in our documentation to enable e-mail notifications if you want to receive the related email notification for this thread.

Answer 2

Hi @Artem O ,

You didn't specify your SSIS process in details.
Please try to use SSIS Bulk Insert Task in a Control Flow without DFT.
Useful link: bulk-insert-task-in-ssis