Level 3 of the Stairway to Integration Services - Adding Rows in Incremental Loads

SQLServerCentral is supported by Red Gate Software Ltd.

Popular Topics

Home

Members

Calendar

Who's On

Home » Article Discussions » Article Discussions by Author » Discuss Content Posted by Andy Leonard » Level 3 of the Stairway to Integration...

18 posts, Page 1 of 2

1 2 »»

Level 3 of the Stairway to Integration Services - Adding Rows in Incremental Loads

Rate Topic

Display Mode

Topic Options

Author

Message

Andy Leonard

Posted Saturday, August 20, 2011 8:29 PM

Old Hand

Group: General Forum Members
Last Login: Monday, May 13, 2013 2:53 PM
Points: 375, Visits: 947

Comments posted to this topic are about the item Level 3 of the Stairway to Integration Services - Adding Rows in Incremental Loads

Andy Leonard
CSO, Linchpin People
Follow me on Twitter: @AndyLeonard

Post #1162939

raghav.kaura

Posted Thursday, September 15, 2011 10:56 PM

Forum Newbie

Group: General Forum Members
Last Login: Tuesday, December 11, 2012 6:25 PM
Points: 1, Visits: 57

How do you handle a scenario when data exists in the target table but has been deleted from the source table. Also how will this handle the load in case email id gets updated in the source.

Post #1176191

Samuel Vella

Posted Friday, September 16, 2011 3:54 AM

Old Hand

Group: General Forum Members
Last Login: 2 days ago @ 2:22 AM
Points: 328, Visits: 1,852

raghav.kaura (9/15/2011)

Also how will this handle the load in case email id gets updated in the source.

If your source system uses an attribute like email as a key column and that attribute can be changed then you have a very bad source system or you're using the wrong column as a key onto the source data.

Post #1176273

NYSystemsAnalyst

Posted Friday, September 16, 2011 6:45 AM

Grasshopper

Group: General Forum Members
Last Login: Tuesday, May 21, 2013 1:27 PM
Points: 13, Visits: 104

Below figure 20, there is a statement that reads, "In SSIS 2008 and SSIS 2008 R2, the Lookup Transformation provides this built-in output to catch records in the Lookup table (the dbo.Contact destination table, in this case) that do not exist in the source (the Person.Contact table) - it's the Lookup No Match Output."

Shouldn't this be the other way around? " In SSIS 2008 and SSIS 2008 R2, the Lookup Transformation provides this built-in output to catch records in the Source table (the dbo.Contact destination table, in this case) that do not exist in the lookup (the Person.Contact table) - it's the Lookup No Match Output."

Post #1176350

S Paquin

Posted Friday, September 16, 2011 9:00 AM

Forum Newbie

Group: General Forum Members
Last Login: Friday, May 03, 2013 8:20 AM
Points: 5, Visits: 82

I just finished reading your SSIS articles and they are an excellent introduction. I just can not wait to see other articles to handle updates an deletes. I hope I will not have to wait too long...

Is there any way to simulate the same as Replication and keep a log of insert, update and deletes in the source so that only those manipulations are handled in the destination ? It seems to me it is a waste of resources to have to do lookups periodically to detect changes between source and destination when SQLServer already does that job of tracking changes. Any suggestions?

Keep the good work.
Stephane

Post #1176457

Andy Leonard

Posted Friday, September 16, 2011 9:40 AM

Old Hand

Group: General Forum Members
Last Login: Monday, May 13, 2013 2:53 PM
Points: 375, Visits: 947

Hi Raghav,

You're getting ahead of me. Step 5...

:{>

Andy Leonard
CSO, Linchpin People
Follow me on Twitter: @AndyLeonard

Post #1176491

Andy Leonard

Posted Friday, September 16, 2011 9:42 AM

Old Hand

Group: General Forum Members
Last Login: Monday, May 13, 2013 2:53 PM
Points: 375, Visits: 947

Hi NYSystemAnalyst,

That's a poorly-worded sentence. My apologies. The No Match output exists in 2008 and R2.

:{>

Andy Leonard
CSO, Linchpin People
Follow me on Twitter: @AndyLeonard

Post #1176495

NYSystemsAnalyst

Posted Friday, September 16, 2011 9:45 AM

Grasshopper

Group: General Forum Members
Last Login: Tuesday, May 21, 2013 1:27 PM
Points: 13, Visits: 104

Thanks. This is a great series of articles and look forward to reading more.

Post #1176497

Andy Leonard

Posted Friday, September 16, 2011 9:48 AM

Old Hand

Group: General Forum Members
Last Login: Monday, May 13, 2013 2:53 PM
Points: 375, Visits: 947

Thanks Stephane,

There is a way to create audit trails of record states, but that topicis beyond the scope of this series. I can get you started offline. Email me at andy.leonard@gmail.com.

:{>

Andy Leonard
CSO, Linchpin People
Follow me on Twitter: @AndyLeonard

Post #1176502

ajenawsu

Posted Monday, September 19, 2011 12:17 PM

Grasshopper

Group: General Forum Members
Last Login: Wednesday, May 22, 2013 1:20 PM
Points: 14, Visits: 95

This is a great (and timely) article. I'm looking forward to the next installment. I watched your SQL Lunch presentation on re-executable T-sql and it has changed my life. Thanks.

Post #1177401

« Prev Topic | Next Topic »

18 posts, Page 1 of 2

1 2 »»

Permissions