Click here to monitor SSC
SQLServerCentral is supported by Red Gate Software Ltd.
 
Log in  ::  Register  ::  Not logged in
 
 
 
        
Home       Members    Calendar    Who's On


Add to briefcase

SSIS (Visual Studio 08) Crash Expand / Collapse
Author
Message
Posted Tuesday, July 21, 2009 1:02 PM
Forum Newbie

Forum NewbieForum NewbieForum NewbieForum NewbieForum NewbieForum NewbieForum NewbieForum Newbie

Group: General Forum Members
Last Login: Tuesday, June 25, 2013 10:25 AM
Points: 1, Visits: 14
I created a SSIS package to loop through a particular folder and import the text contained in the text files in this directory into one field in a SQL table and the name of the file into another field in the table. The package runs for a little over an hour, imports 16,000 of 25,000 files and then the application crashes and shuts down. In the Event Viewer log I get this error:

EventType clr20r3, P1 devenv.exe, P2 9.0.30729.1, P3 488f2b50, P4 mscorlib, P5 2.0.0.0, P6 492b834a, P7 42be, P8 0, P9 system.outofmemoryexception, P10 NIL.

Any ideas? The largest text file is 15KB and I have 4GB of memory.

Thank you
Post #756888
Posted Monday, June 14, 2010 8:51 AM
Grasshopper

GrasshopperGrasshopperGrasshopperGrasshopperGrasshopperGrasshopperGrasshopperGrasshopper

Group: General Forum Members
Last Login: Tuesday, March 13, 2012 9:05 AM
Points: 24, Visits: 40
Hi jdurgin1,

Did you ever find a solution to this? I have encountered the same problem while trying to load in files the same way you mention in your post. My initial check on the web brought up some notes from people that Visual Studio has a 2GB max memory capacity, so it is the software not your actual machine that is limiting it, but I am still looking for the best solution to get around this. I found a blog post referencing a sort of hack that will allow you to increase this limit to 3GB, but am not sure I want to go that route without checking for other options.

I would appreciate any thoughts if you have made progress on this.

Regards,
Chris
Post #936903
« Prev Topic | Next Topic »

Add to briefcase

Permissions Expand / Collapse