If you go the HASHBYTES method (which I too have used in the past for large-scale data loading processes), consider using SHA or SHA1 instead of MD5 for a bit better hash: http://kejser.org/exploring-hash-functions-in-sql-server/