SQL Clone
SQLServerCentral is supported by Redgate
 
Log in  ::  Register  ::  Not logged in
 
 
 


SSIS (Visual Studio 08) Crash


SSIS (Visual Studio 08) Crash

Author
Message
jdurgin1
jdurgin1
Forum Newbie
Forum Newbie (7 reputation)Forum Newbie (7 reputation)Forum Newbie (7 reputation)Forum Newbie (7 reputation)Forum Newbie (7 reputation)Forum Newbie (7 reputation)Forum Newbie (7 reputation)Forum Newbie (7 reputation)

Group: General Forum Members
Points: 7 Visits: 14
I created a SSIS package to loop through a particular folder and import the text contained in the text files in this directory into one field in a SQL table and the name of the file into another field in the table. The package runs for a little over an hour, imports 16,000 of 25,000 files and then the application crashes and shuts down. In the Event Viewer log I get this error:

EventType clr20r3, P1 devenv.exe, P2 9.0.30729.1, P3 488f2b50, P4 mscorlib, P5 2.0.0.0, P6 492b834a, P7 42be, P8 0, P9 system.outofmemoryexception, P10 NIL.

Any ideas? The largest text file is 15KB and I have 4GB of memory.

Thank you
chrismalone1
chrismalone1
SSC-Enthusiastic
SSC-Enthusiastic (126 reputation)SSC-Enthusiastic (126 reputation)SSC-Enthusiastic (126 reputation)SSC-Enthusiastic (126 reputation)SSC-Enthusiastic (126 reputation)SSC-Enthusiastic (126 reputation)SSC-Enthusiastic (126 reputation)SSC-Enthusiastic (126 reputation)

Group: General Forum Members
Points: 126 Visits: 40
Hi jdurgin1,

Did you ever find a solution to this? I have encountered the same problem while trying to load in files the same way you mention in your post. My initial check on the web brought up some notes from people that Visual Studio has a 2GB max memory capacity, so it is the software not your actual machine that is limiting it, but I am still looking for the best solution to get around this. I found a blog post referencing a sort of hack that will allow you to increase this limit to 3GB, but am not sure I want to go that route without checking for other options.

I would appreciate any thoughts if you have made progress on this.

Regards,
Chris
Go


Permissions

You can't post new topics.
You can't post topic replies.
You can't post new polls.
You can't post replies to polls.
You can't edit your own topics.
You can't delete your own topics.
You can't edit other topics.
You can't delete other topics.
You can't edit your own posts.
You can't edit other posts.
You can't delete your own posts.
You can't delete other posts.
You can't post events.
You can't edit your own events.
You can't edit other events.
You can't delete your own events.
You can't delete other events.
You can't send private messages.
You can't send emails.
You can read topics.
You can't vote in polls.
You can't upload attachments.
You can download attachments.
You can't post HTML code.
You can't edit HTML code.
You can't post IFCode.
You can't post JavaScript.
You can post emoticons.
You can't post or upload images.

Select a forum

































































































































































SQLServerCentral


Search