Error while loading csv file

San 161 Reputation points
2021-07-26T10:10:21.87+00:00

Hi Experts,

I am trying to load multiple csv files. I am getting this error (below). unable to figure out what causing this error

Error: A buffer failed while allocating 10477584 bytes.
Error: The system reports 62 percent memory load. There are 16961986560 bytes of physical memory with 6404182016 bytes free. There are 4294836224 bytes of virtual memory with 429740032 bytes free. The paging file has 19512123392 bytes with 3860078592 bytes free.

[FFT_SRC [11]] Error: The attempt to add a row to the Data Flow task buffer failed with error code 0x8007000E.
[SSIS.Pipeline] Error: SSIS Error Code DTS_E_PRIMEOUTPUTFAILED. The PrimeOutput method on FFT_SRC returned error code 0xC02020C4. The component returned a failure code when the pipeline engine called PrimeOutput(). The meaning of the failure code is defined by the component, but the error is fatal and the pipeline stopped executing. There may be error messages posted before this with more information about the failure.

Much appreciated for your help

SQL Server Integration Services
SQL Server Integration Services
A Microsoft platform for building enterprise-level data integration and data transformations solutions.
2,460 questions

2 answers

Sort by: Most helpful
Most helpful Newest Oldest
  1. Yitzhak Khabinsky 25,116 Reputation points
    2021-07-26T14:18:52.893+00:00

    Hi @San ,

    You can test/analyze your *.csv files in SSMS via the following methods:

    1. SELECT ... FROM OPENROWSET(BULK 'E:\Temp\fileName.csv' ...
    2. BULK INSERT dbo.tbl FROM 'E:\Temp\fileName.csv'
    0 comments
  2. ZoeHui-MSFT 33,296 Reputation points
    2021-07-27T02:33:07.993+00:00

    Hi @San ,

    This error means your system is running out of memory before the buffer pool has reached it's limit. There are two data flow properties you want to look at:

    DefaultMaxBufferSize - Sets the maximum memory usage for buffer
    DefaultBufferMaxRows - Sets the maximum rows to buffer

    You may also have a try to run 64 bit mode.

    Details you may refer:
    https://www.sqlservercentral.com/articles/the-defaultbuffermaxrows-and-defaultbuffersize-properties-in-ssis

    Regards，

    Zoe

    If the answer is helpful, please click "Accept Answer" and upvote it.

    Note: Please follow the steps in our documentation to enable e-mail notifications if you want to receive the related email notification for this thread.
    Hot issues October

    0 comments