I've found the easy way to remove duplicates is with the UNION statement:

select * into aTempTable

from SourceTable

UNION

select * from SourceTable

GO

truncate table SourceTable

insert into SourceTable

select * from aTempTable

GO

Does this work for you?