Chris,

Turn that SELECT into a CTE instead of using a table variable...

Heh... I love it, Serqiy... thanks for the great laugh

Dang... I still don't have access to SQL Server 2005 ... I love the CTE's that use that wonderful Rownumber Over Partition...

Antonio... can you tell us how long that took...

I did read that post... pretty well thought out and glad to be part of those thoughts.  You covered a good number of the points that I was trying to...

Heh... wise old fellow once said "To measure something is to change its state."  No exception with SQL... sometimes, ya just gotta bite the bullet to find out what's going...

Heh... I'm all for that especially with present company

What did you end up with, David?

Tomm's code for an upsert is good... think I'd do it in a stored procedure rather than DTS, but it'll do the trick either way.

I still use BULK INSERT and...

Heh... you're welcome, Chris...

But that's just step one... (make it work)

Here's the code to generate a million row test table for step two... (make it work fast)

Absolutely agree with that!

Now, wouldn't it be an absolute hoot if they were looking at the MSDE box in Query Analyzer or EM thinking that it was the production box?  Not so uncommon a...

Concur... that's just about the same as what I use for header info.  And I document any parameters where such documentation belongs... next to the parameters in the code

Heh... cursors... gotta love 'em.

How much disk space do you have... 300 gig?  500 gig?  Why are you worried about a 9 or 10 gig TempDB?  Shoot... we preset ours...