If you know that there will be no more dups added then a quick way to temporarily fix this is to create a single column called [old_data] or something. Write a query to identify the old dups and then any query can using where [old_data] is null will filter out this data. Means you are not removing the data, just tagging it which is less risk.