How about "cleaning" all address into another table with a pointer back to the original "unclean" address.

You can than compare the clean addresses to identify duplicates.