DTS Import - skip duplicates

  • Hi All,

    I'm a newbie so please forgive my lack of understanding in this topic. 🙂

    I have a SQL table of names and ID numbers and I would like to update it from an Excel file which has duplicates.  I'm fine with importing the file using DTS, but how can I use DTS transformation, to have it  skip or ignore the duplicate records from the source file based on ID number?  Both the table and source file have the ID# field named the same.

     

    TIA,

    Julianne

  • You can either use a Data Driven Query task to compare the data as it's imported or import the data from Excel to staging tables and use T-SQL code in an Execute SQL task to see if the data already exists in the destination table.  I prefer to use staging tables and T-SQL because the DDQ task processes the data row by row, which can really slow things down if you're importing a lot of data.

    Greg

    Greg

Viewing 2 posts - 1 through 2 (of 2 total)

You must be logged in to reply to this topic. Login to reply