pls help: how to backfill the data since some day

  • hello,

    I am very new to SSIS. I just want write a IS package that can integrate the data from source since the date in the destination table. For example, if the latest data date is today-9, then it will integrate the data from today-9 from source table to the destination. What should I do, please guide me in detail steps. I had figured out a data flow task that can integrate all data from OLE source to dest.

    thanks

    Liu

  • I can think of two approaches.

    First come up with a process to test the target for the last date loaded and then use that information to query the source appropriately.

    Second build a logging mechanism that records the date(s) used in the last run. Then use that information to adjust your date (range) for the next load. Personally I like the logging approach for a variety of reasons.

    --Only one or two rows to query to get your date range instead of an entire table.

    --Logging can be useful for a lot of things outside of determining the next date range to use. Audits, results reporting, etc.

  • There's a great answer in this thread:

    http://social.msdn.microsoft.com/Forums/sqlserver/en-US/6c7a482a-59fc-4cc8-b8cf-fc02e7c79174/pls-help-how-to-backfill-the-data-since-some-day

    😉

    Need an answer? No, you need a question
    My blog at https://sqlkover.com.
    MCSE Business Intelligence - Microsoft Data Platform MVP

Viewing 3 posts - 1 through 2 (of 2 total)

You must be logged in to reply to this topic. Login to reply