Click here to monitor SSC
SQLServerCentral is supported by Red Gate Software Ltd.
 
Log in  ::  Register  ::  Not logged in
 
 
 
        
Home       Members    Calendar    Who's On


Add to briefcase

Large flat file exception issue Expand / Collapse
Author
Message
Posted Thursday, July 31, 2014 1:36 PM
Grasshopper

GrasshopperGrasshopperGrasshopperGrasshopperGrasshopperGrasshopperGrasshopperGrasshopper

Group: General Forum Members
Last Login: Saturday, August 16, 2014 11:13 AM
Points: 23, Visits: 111
Hi All, I have a script task and I used Visual Basic 2010 code to change the delimiters inside a flat file (.txt) and write to another file.

This is working perfect with a file has 2 million rows and 800 MB in size. But when I have a flat file has 19 million rows and which is of 4 GB file size is throwing the below error.

Error: Exception has been thrown by the target of an invocation.

Suggestions are greatly appreciated
Thank you
Post #1598463
Posted Wednesday, August 6, 2014 9:09 AM


SSC-Addicted

SSC-AddictedSSC-AddictedSSC-AddictedSSC-AddictedSSC-AddictedSSC-AddictedSSC-AddictedSSC-Addicted

Group: General Forum Members
Last Login: Yesterday @ 8:29 AM
Points: 408, Visits: 971
First try to get more error info, maybe turn on some logging to get the low level message.

How are you processing the file? What does it mean that you are changing the delimiters how exactly are you doing this? If you could post some code regarding the opening and reading of the file that may help, also for a larger file you may need to read it in chunks.
Post #1600274
« Prev Topic | Next Topic »

Add to briefcase

Permissions Expand / Collapse