Error while loading csv file

Question

Hi Experts,

I am trying to load multiple csv files. I am getting this error (below). unable to figure out what causing this error

Error: A buffer failed while allocating 10477584 bytes.
Error: The system reports 62 percent memory load. There are 16961986560 bytes of physical memory with 6404182016 bytes free. There are 4294836224 bytes of virtual memory with 429740032 bytes free. The paging file has 19512123392 bytes with 3860078592 bytes free.

[FFT_SRC [11]] Error: The attempt to add a row to the Data Flow task buffer failed with error code 0x8007000E.
[SSIS.Pipeline] Error: SSIS Error Code DTS_E_PRIMEOUTPUTFAILED. The PrimeOutput method on FFT_SRC returned error code 0xC02020C4. The component returned a failure code when the pipeline engine called PrimeOutput(). The meaning of the failure code is defined by the component, but the error is fatal and the pipeline stopped executing. There may be error messages posted before this with more information about the failure.

Much appreciated for your help

Answer 1

Hi @San ,

You can test/analyze your *.csv files in SSMS via the following methods:

1. SELECT ... FROM OPENROWSET(BULK 'E:\Temp\fileName.csv' ...
2. BULK INSERT dbo.tbl FROM 'E:\Temp\fileName.csv'

Answer 2

Hi @San ,

This error means your system is running out of memory before the buffer pool has reached it's limit. There are two data flow properties you want to look at:

DefaultMaxBufferSize - Sets the maximum memory usage for buffer
DefaultBufferMaxRows - Sets the maximum rows to buffer

You may also have a try to run 64 bit mode.

Details you may refer:
https://www.sqlservercentral.com/articles/the-defaultbuffermaxrows-and-defaultbuffersize-properties-in-ssis

Regards，

Zoe

---

If the answer is helpful, please click "Accept Answer" and upvote it.

Note: Please follow the steps in our documentation to enable e-mail notifications if you want to receive the related email notification for this thread.
Hot issues October