SSIS batch processing

  • Hi everyone,

    I have a table that consists of BLOB data. I need to load this to another table. When I tried loading it, I got the following errors:

    1. The buffer manager could not get a temporary file name. The call to GetTempFileName failed.

    2. The buffer manager could not create a temporary file on the path "Path". The path will not be considered for temporary storage again

    3. The buffer manager cannot create a file to spool a long object on the directories named in the BLOBTempStoragePath property. Either an incorrect file name was provided, or there are no permissions.

    4. Long data was retrieved for a column but cannot be added to the Data Flow task buffer.

    I tried increasing DefaultBufferSize and decreasing DefaultBufferMaxRows, but of no use.

    Please suggest some way so that I can process some 1000 rows at a time, load it to destination and the next 1000 rows and so on.

    Thanks in advance,

    Preethi

  • You're running out of memory. Is there any value in the BLOBTempStoragePath property of the data flow task? If not then try to add one with adequate storage - this won't result in the fastest performance but when the memory runs out the BLOB data will "spill" to disk in the location specified.

    Have a read of the following document to see if it gives you any ideas in how you can streamline your package:

    https://technet.microsoft.com/library/Cc966529

    Without knowing the exact details of your SSIS package it's difficult to ascertain where this memory pressure is coming from. Like I said though, that link may provide answers.


    I'm on LinkedIn

Viewing 2 posts - 1 through 1 (of 1 total)

You must be logged in to reply to this topic. Login to reply