Jeff Moden (7/23/2014)

---

halifaxdal (7/22/2014)

---

For the 400M file, I remove the first two rows (non data), I also added BULKSIZE = 200 to the Bulk Insert, and I was able to load all the data until it hits the last row which is also not a data row.

But I can use UltraEdit to open the 400M data file and remove the first two rows, I don't want to try to open the 4G data, I can imagine the system will hang there forever. I believe the bcp or Bulk Insert must be able to handle situations like this.

And sorry I can't upload the data file anywhere: 1. it is against my company's policy; 2. it is too big

Thank you, any clue is appreciated.

I'm just not feeling the love here. You COULD modify the file you provided so that it contains the exact anomalies you spoke of, right? That would do two things... it would help me help you because I wouldn't have to take the time to create the data you need help on and it would take all of the guesswork out of the problem because I don't actually know what the anomalies in the data look like. You know how to use Ultra Edit.. modify the file you've already provided.