That would have been my preferred method as well. But the project has been going on for a few years and this is what has been followed historically, even...

The filenames are named with the groups there are in - Filename1_Group1.csv, Filename2_Group1.CSV, Filename3_Group1.csv; Filename1_Group2.csv, Filename2_Group2.CSV, Filename3_Group2.csv, and so on

When I create the dataflow task, I add the name...

An experienced developer complained to me that until SQL has a date, and a time, datatype, it will never be a very good database.  This person has been writing...

I have to admit that I've never done a SUBSTRING on a NULL directly as in the question.  I've not seen anyone even try to do such a thing in...

Ok... here's one for you that a whole lot of people don't understand (borrowing a part of a quote from the article)...

"Don't try to learn T-SQL. Try to learn to...

That's almost exactly what I suggested in the other post.  You ARE trying to delete 41% of the table.  After doing that (deletes), you're  going to have to rebuild all...

Avoiding a join here is a mistake, IMHO, especially if the hash-code is going to be used for "verification".

Ah... there's that word... "verification".  By itself it can mean so many...

• This reply was modified 4 years, 4 months ago by Jeff Moden. Reason: Corrected a mistake. I original posted an incorrect length and also made an assumption that the data was a simple hash... it's way to big for that
• This reply was modified 4 years, 4 months ago by Jeff Moden. Reason: One more correction... at 64 Bytes, these can be valid hashes using SHA2_512 hashing algorithm

As a bit of a sidebar, one does have to wonder what the word "efficient" in the post title actually means because, IMHO, you selected to go with the least...

What are you currently using?

You're way too humble.  Of course, that's also a part of what makes you so good. 😀  Thanks for what you and the other heavy hitters do.

One of the things that I'm most thankful for is the community that has grown around SQL Server Central.  I don't know where I'd be without this hub of knowledgeable...

Likewise, you and Phil are the only ones on this thread that I've not yet met in person.  Brent did a presentation for us several years back and a couple...

Heh.  Thanks for the notice, Aaron, but those points are a bit bogus and a left over from times long gone when LIKEs and other forms of upvotes just seemed...

Man, I thought we might have had it with the RCSI thing.  You've answered all the other questions with the graphics.  I see absolutely nothing in any of that that...

At least it's...