I created a SSIS package to loop through a particular folder and import the text contained in the text files in this directory into one field in a SQL table and the name of the file into another field in the table. The package runs for a little over an hour, imports 16,000 of 25,000 files and then the application crashes and shuts down. In the Event Viewer log I get this error:
EventType clr20r3, P1 devenv.exe, P2 9.0.30729.1, P3 488f2b50, P4 mscorlib, P5 18.104.22.168, P6 492b834a, P7 42be, P8 0, P9 system.outofmemoryexception, P10 NIL.
Any ideas? The largest text file is 15KB and I have 4GB of memory.