Here's my issue, I have a lot of small files in a medium sized database that are binary blobs.
Their filenames and work order numbers are stored in seperate columns, and it seemed pretty cut and dry to me, use SSIS, Create a derived column to split off the filename and then an export column to export the binary data to disk. It works (mostly)! except the binary data is exported as garbage. For example filename.xls won't open in excel, and when opened in a text editor is basically garbage that looks like this:
begin 660 so80236.xls
It goes on for pages of course.
from what I can see there are .jpg's and .txt files as well as lot's of other stuff in here too.
Also, I am getting this error over and over again:
Information: The buffer manager detected that the system was low on virtual memory, but was unable to swap out any buffers. 4 buffers were considered and 4 were locked. Either not enough memory is available to the pipeline because not enough is installed, other processes are using it, or too many buffers are locked.
I increased my paging file to 5.1gb then monitored it during a run and it never came close to using it so I'm confused as to why it's throwing this error.
Rest of the stats:
4gb ram 64-bit server 2003 with sql server 2005 (64-bit)