July 21, 2009 at 1:02 pm
I created a SSIS package to loop through a particular folder and import the text contained in the text files in this directory into one field in a SQL table and the name of the file into another field in the table. The package runs for a little over an hour, imports 16,000 of 25,000 files and then the application crashes and shuts down. In the Event Viewer log I get this error:
EventType clr20r3, P1 devenv.exe, P2 9.0.30729.1, P3 488f2b50, P4 mscorlib, P5 2.0.0.0, P6 492b834a, P7 42be, P8 0, P9 system.outofmemoryexception, P10 NIL.
Any ideas? The largest text file is 15KB and I have 4GB of memory.
Thank you
June 14, 2010 at 8:51 am
Hi jdurgin1,
Did you ever find a solution to this? I have encountered the same problem while trying to load in files the same way you mention in your post. My initial check on the web brought up some notes from people that Visual Studio has a 2GB max memory capacity, so it is the software not your actual machine that is limiting it, but I am still looking for the best solution to get around this. I found a blog post referencing a sort of hack that will allow you to increase this limit to 3GB, but am not sure I want to go that route without checking for other options.
I would appreciate any thoughts if you have made progress on this.
Regards,
Chris
Viewing 2 posts - 1 through 1 (of 1 total)
You must be logged in to reply to this topic. Login to reply