Home Forums SQL Server 2008 SQL Server 2008 - General How to do incremental loading without date filters RE: How to do incremental loading without date filters

  • August 22, 2017 at 9:16 am

    #1956189

    upendar.dilytics - Tuesday, August 22, 2017 6:39 AM

    We need to load the data which is inserted or updated in last four days in a source to staging and then to fact by incremental loading by using SSIS packages, but the problem is we don't have any date columns in source or fact tables.

    Source to stage is full load and stage to fact is an incremental load. How can we achieve this?

    Any suggestions regarding this issue will be greatly appreciated.

    Thanks in advance.

    What is/are the PK column(s) of the Fact table and does that information appear in the source tables?

    Also, if the data doesn't have some date/time column and the source tables aren't named with some sort of temporal indicator and there's no ever increasing integer value in all 4 tables, there might still be a way to pull this off..  IF the source tables where created in the correct temporal order for the incremental data, then you could use the table creation date to drive the correct order of the incremental load.

    --Jeff Moden

    RBAR is pronounced "ree-bar" and is a "Modenism" for Row-By-Agonizing-Row.
    First step towards the paradigm shift of writing Set Based code:
    ________Stop thinking about what you want to do to a ROW... think, instead, of what you want to do to a COLUMN.

    Change is inevitable... Change for the better is not.

    Helpful Links:
    How to post code problems
    How to Post Performance Problems
    Create a Tally Function (fnTally)