October 13, 2020 at 12:00 am
Comments posted to this topic are about the item Incremental Data loading through ADF using Change Tracking
November 17, 2020 at 10:54 am
Hello Sucharita Das,
I went through your blog which talks about incremental data load with Change Tracking. In the blog its only implemented for one table. I am trying to modify the query for multiple tables but facing some issues, how can we modify this to implement for multiple tables.
Thanks,
Gauri Pawse
November 27, 2020 at 4:40 am
Some minor changes are required to handle multiple tables. I will try to write an article on this.
August 19, 2021 at 11:39 am
Hi Sucharita Das,
It will be good to understand how the same pipeline can be configured to handle incremental load for multiple tables using change tracking.
Thanks!
August 20, 2021 at 6:04 am
Can you explain for Multiple tables
October 6, 2021 at 11:48 am
Hi,
As far as I've understood, this solution requires enabling change tracking in SOURCE Database. Right?
If so, unfortunately it is in most scenarios not applicable and therefore this pattern will be useless. In serious environments one can just forget modifying ERP (or any other heavy OLTP Datasource) tables and set the change tracking on. In such cases, the classical anchor based incremental loading pattern is still the best way.
Thanks for the information anyway.
Onur
Ps: For whom wants to learn more on Change Tracking, here are also two good articles from Tim Mitchell
- https://www.timmitchell.net/post/2016/01/18/getting-started-with-change-tracking-in-sql-server/
- https://www.timmitchell.net/post/2016/01/20/using-sql-server-change-tracking-for-incremental-loads/
Viewing 6 posts - 1 through 5 (of 5 total)
You must be logged in to reply to this topic. Login to reply