Thanks, i had to add the linked server prefix as well. Moreover, i also had to add square brackets for some reason for it to finally work...

[server].[database].[owner].

With regards to the...

Thanks!! I get what you are saying, however there are 9 customer tables and the only attribute i could use to join with the Dim table would be the customerID....

I have thought of another solution...

The initial problem occured when i tried to join data across 9 different customer tables(on the customer id)

For some reason...duplicates were created of each and...

I'm not really sure how to identify duplicates without using the group by clause.

Secondly, to really identify the duplicates, it would have to sort through the entire set of data...

Im trying to deduplicate data from the customers table----

1] if a match on firstname. lastname, email then it is a duplicate---delete duplicates

2]If match cannot be found on first name, last...

Thanks again!

The expectation for me is currently in a couple of months. I'm not sure if it would be realistic expectation and how to convince others the same

Getting back...

Thanks for your reply,

What i meant was that, i have imported and loaded data into the staging area. I am deduplicating the data. It takes so long though when there...

would an update table statement do the trick, however is it possible to update a column of one table to a column from another??(which is referenced in the join)

No, not overwritten. Just wanto add the address and SSN column from table A onto table B..where there is a join on the id's of the two tables. So for...

I've deduped data, but only manually(pressed for time..).

I would like to use SSIS for its really meant for then....

Thanks Journeyman

That made sense! Just wondering though.....

IF for table A- that has the duplicates...i just run a distinct query that returns only one record of the duplicate(based on name,...

I think im getting closer, it would be easy to write to query to delete duplicate record

Someone posted a nice deduplicating query.....

DELETE

FROM Table

WHERE ID NOT IN

(SELECT MAX(ID)

...

You bet! almost 3 years worth of it...anyways i get what you're saying, select all duplicates into a new table..

And then do a sort(or do you mean fuzzy lookup) on...

Hey thanks for the post, it helps to know that someone is facing the same problem.

Now the issue here is deduplication of records. A 140 million rows of data. Just...

Anyone, any tips on how to optimize the buffer storage.

Here is the deal, aprrox 50 gigs of data from the source DB, (about 140 mil rows) causes it to use...