The easiest solution is going to be deleting from the combined table, before the final upload. You could dump them in the load from the vendor-specific tables, but that's going to be much more complex.
My usual solution for deleting duplicates is to use a CTE and the Row_Number() function.
;with Products (ID, Row) as
(select ID, row_number() over (partition by ProductID order by Price)
from dbo.CombinedTable)
delete from Products
where Row > 1
I'm guessing on your table structure, name, etc., but that's the basic code.
Does that help?
- Gus "GSquared", RSVP, OODA, MAP, NMVP, FAQ, SAT, SQL, DNA, RNA, UOI, IOU, AM, PM, AD, BC, BCE, USA, UN, CF, ROFL, LOL, ETC
Property of The Thread
"Nobody knows the age of the human race, but everyone agrees it's old enough to know better." - Anon