Home Forums SQL Server 2005 Business Intelligence Incemental Load and Full Fresh Load Both RE: Incemental Load and Full Fresh Load Both

  • November 11, 2015 at 11:32 pm

    #1839264

    hegdesuchi (10/2/2015)

    Hi,

    I have a requirement where I have to design the SSIS package for both Incremental and Full Load. If I am instructed to run the package as incremental then I run with incremental Load and If I am instructed to load full fresh I have to Load full fresh. I want to make this change(full fresh or incremental Load) dynamic. Here source we use is Eloqua connection manager and cannot do any filtering with source task.

    I added a conditional Split after source which filters data based on date. We have 32 tables and need to add this for all 32 tables. this change would be for incremental load. IF I want Full fresh I have to remove all conditional split from 32 objects,.

    Can any one of you suggest better way of handling this type of scenario?

    regards,

    Sushe

    Create a conditional split everywhere. Make it based on the datetime parameter. Condition is "datetime on 32 tables > @parameter".

    Set the @parameter to the actual latest datetime stamp you need for the incremental load, and set it to '1901-01-01' for the full load.

    Another less preferred way - create two versions of the SSIS packages, one with the condition the other without.

    M.Sc.IT, M.B.A, MCTS BI 2008, MCITP BI 2008, MCTS SQL Dev, CSM, CDVDM