Home Forums Data Warehousing Integration Services What happens if new records are inserted in a source table during a package execution? RE: What happens if new records are inserted in a source table during a package execution?

  • Thanks so much for your answers,

    Thanks to the opc answer I could learn about SPIDs, Wait Types, Packet Size, etc.

    I have already implemented the IDENTITY column (Idx) in the staging table. After a record is successfully imported in the CRM I write the CRM uniqueidentifier back in the table together with the datetime of the update in a column called UpdateDT.

    Then, I create a second package to execute this package. I pass the number of records to load as a parameter, and I query the MAX(Idx), then I have something like this in the source query:

    Where Idx > MAX(Idx) and Idx<MAX(Idx)+RowsToLoad

    Of course, I’m using some variables and other names.

    I created a loop that keep the loading process active until there are no more records to load. At the moment is still running since monday (4 days) and 1.3 million of customers out of 2.2 are already imported.

    Kind Regards,

    Paul Hernández