I have a daily file that I need to consume that has 10,000,000+ rows; it is a human readable report. The reason it needs to stay in order is there are multiple rows for each record. I have the code written that parses the file; as a work around during testing I used Ultra Edit to add a row number before bulk insert.
Eventually I'm planning on using SSIS to process this file. I believe there is something in SSIS that can add a row number? Seems like at a previous employer the programmers used C# code to insert a row number before import on the files where row order needed to be retained; I'm not sure though had the luxury there of some great programmers.
I'd appreciate suggestions, thanks.