Click here to monitor SSC
SQLServerCentral is supported by Red Gate Software Ltd.
 
Log in  ::  Register  ::  Not logged in
 
 
 
        
Home       Members    Calendar    Who's On


Add to briefcase

Best Way to Migrate Data from Different DB SQL Servers Expand / Collapse
Author
Message
Posted Monday, November 26, 2012 2:10 PM
Forum Newbie

Forum NewbieForum NewbieForum NewbieForum NewbieForum NewbieForum NewbieForum NewbieForum Newbie

Group: General Forum Members
Last Login: Tuesday, September 10, 2013 12:20 PM
Points: 3, Visits: 154
have data like the following:
:

PK Desc InsertedByUserID UpdatedByUserID

1 Johnny 13 90

2 Frankie 34 75

3 Brenda 75 90

4 Scott 25 14

The data is being moved into a new app. The userid will be changed in the new app. The initial migration of data is converting the old users to a new id. So I have no issues with the loading the new User table. The old id is being retained. Every row of data in the database has an InsertedByUserID and a UpdatedByUserID column. I have been trying to do the migration of data using a lookup of the old user id to the new user id. I am getting memory errors . I did also try a merge join of old to new on the insert id and another merge join for UpdatedBy id. Seems a bit complicated. Is there a better way? I cannot use staging tables for the migration. I cannot use linked servers either. Sometimes there could be a few more ids in the data columns.

So what is the best way? Please offer suggestions.......

Post #1388842
Posted Monday, November 26, 2012 11:38 PM


SSChampion

SSChampionSSChampionSSChampionSSChampionSSChampionSSChampionSSChampionSSChampionSSChampionSSChampion

Group: General Forum Members
Last Login: Today @ 1:52 PM
Points: 13,368, Visits: 11,148
How many users are there?
How did you configure the lookup?




How to post forum questions.
Need an answer? No, you need a question.
What’s the deal with Excel & SSIS?

Member of LinkedIn. My blog at LessThanDot.

MCSA SQL Server 2012 - MCSE Business Intelligence
Post #1388969
Posted Tuesday, November 27, 2012 6:34 AM


Mr or Mrs. 500

Mr or Mrs. 500Mr or Mrs. 500Mr or Mrs. 500Mr or Mrs. 500Mr or Mrs. 500Mr or Mrs. 500Mr or Mrs. 500Mr or Mrs. 500

Group: General Forum Members
Last Login: Thursday, July 24, 2014 1:50 PM
Points: 531, Visits: 448
Just a thought. Try pulling over the old data, as it is, into the new db. From there, use the old data in the new location as the source for your package. See if that helps to alleviate your issue.

Lookups can be very memory intensive, as my limited experience has shown me.
Post #1389151
« Prev Topic | Next Topic »

Add to briefcase

Permissions Expand / Collapse