implement SCD type 1

• abhas

  SSCarpal Tunnel

  Points: 4681

  More actions

  November 21, 2013 at 12:17 am

  #395873

  Hi,

  I want to load target table with full data from source as it is and after every 1 hour i want refresh target data based on source data.

  i.e. if new record inserted then i want to add that record or if any existing record is updated then i want to update that record in target as well.

  i dont want history in the target table just update the record which is updated in the source.

  how can i do this?

  Thanks

  Abhas.

• Koen Verbeeck

  SSC Guru

  Points: 259085

  More actions

  November 21, 2013 at 12:39 am

  #1668035

  Read this excellent SSIS design pattern by Andy Leonard:

  SSIS Design Pattern - Incremental Loads

  One improvement you must do though:

  replace the OLE DB Command to do the update with an OLE DB Destination to write the updates to a staging table.

  After the data flow, use an Execute SQL Task with a regular UPDATE statement to do the updates. This will be much faster.

  Need an answer? No, you need a question
  My blog at https://sqlkover.com.
  MCSE Business Intelligence - Microsoft Data Platform MVP