Click here to monitor SSC
SQLServerCentral is supported by Red Gate Software Ltd.
 
Log in  ::  Register  ::  Not logged in
 
 
 
        
Home       Members    Calendar    Who's On


Add to briefcase «««34567

Speeding Up Incremental ETL Proceses in SSIS by Using MD5 Hashes Expand / Collapse
Author
Message
Posted Tuesday, October 30, 2012 9:11 AM
Grasshopper

GrasshopperGrasshopperGrasshopperGrasshopperGrasshopperGrasshopperGrasshopperGrasshopper

Group: General Forum Members
Last Login: Wednesday, May 22, 2013 9:24 AM
Points: 10, Visits: 51
I have implemented the code suggested and I am running into some trouble where every 3rd or 4th time I run the package, I get the same hash for columns that have not changed. Shouldn't I get the same hash "every" time I run the package if the columns have not changed?

These tables outside of any OLTP environment so there is no change in the source data.

I appreciate any help.
Post #1378840
Posted Sunday, June 09, 2013 8:23 AM
Forum Newbie

Forum NewbieForum NewbieForum NewbieForum NewbieForum NewbieForum NewbieForum NewbieForum Newbie

Group: General Forum Members
Last Login: Sunday, June 09, 2013 8:15 AM
Points: 1, Visits: 7
Good and very clear article. But described solution - to "speed up" ETL - is like shooting mosquito from cannon ball. Much more faster is using HASHBYTES sql server native function. And for Goodness sake, dont recommend using OLEDB Command to speed up anything. Use data sets and staging tables.
Post #1461338
« Prev Topic | Next Topic »

Add to briefcase «««34567

Permissions Expand / Collapse