Dynamic Destination Field/Column Mapping

SQLServerCentral is supported by Red Gate Software Ltd.

Popular Topics

Home

Members

Calendar

Who's On

Home » SQL Server 2005 » Business Intelligence » Dynamic Destination Field/Column Mapping

Dynamic Destination Field/Column Mapping

Rate Topic

Display Mode

Topic Options

Author

Message

SSIS Newbie

Posted Tuesday, August 04, 2009 3:52 AM

Forum Newbie

Group: General Forum Members
Last Login: Monday, September 28, 2009 1:30 AM
Points: 3, Visits: 41

Hi,

Hope somebody can help or point me in the right direction.
I would like to know if it is possible to map destination columns dynamically.
Let me explain:
I have several files to upload with different formats

e.g.
abc.xls as 5 columns (version 1 of the import file)
col1,col2,col3,col4,col5
01/07/2009,Product 1,123.00,12.00,135.00
02/07/2009,Product 2,125.00,13.00,138.00

abc1.xls has 7 columns (version 2 of the import file)
col1,col2,col3,col4,col5,col6,col7
01/07/2009,Product 1,123.00,12.00,1.00,2.00,135.00
02/07/2009,Product 2,125.00,13.00,1.00,2.00,138.00

The destination for both files go to the same table (Table 1) with columns:
Date
Description
Amount
Tax
TotalAmount
RateAmount1
RateAmount2

I have a table that maps the columns with the 2 versions of these files
File OldHeader Index New Header
abc.xls col1 1 Date
abc.xls col2 2 Description
abc.xls col3 3 Amount
abc.xls col4 4 Tax
abc.xls col5 5 TotalAmount
abc1.xls col1 1 Date
abc1.xls col2 2 Description
abc1.xls col3 3 Amount
abc1.xls col4 4 Tax
abc1.xls col5 5 RateAmount1
abc1.xls col6 6 RateAmount2
abc1.xls col7 7 TotalAmount

How can I map the input columns to the output columns
e.g.
col5 destination column is TotalAmount (abc.xls)
col5 destination column is RateAmount1 (abc1.xls)

I know how to get these values, but how do you map them to the destination table?
Is this possible or is it possible to map using the Index column?

Hope this is clear?
Thanks
SSIS Newbie

Post #764685

drew.allen

Posted Tuesday, August 04, 2009 9:16 AM

Ten Centuries

Group: General Forum Members
Last Login: Thursday, May 02, 2013 1:20 PM
Points: 1,235, Visits: 5,389

If you can get those values, then probably the easiest thing to do is to create two calculated columns: one for Total Amount and one for Rate Amount. Populate whichever calculated column is appropriate and have the other be zero (or nothing).

Drew

J. Drew Allen
Business Intelligence Analyst
Philadelphia, PA

Post #764904

stevefromOZ

Posted Tuesday, August 04, 2009 10:14 AM

SSCommitted

Group: Moderators
Last Login: Friday, June 14, 2013 10:58 AM
Points: 1,764, Visits: 3,199

Another approach would be to use a for-each loop over the files. Within this you have a dataflow, and within the dataflow you have an excel connection (source) and sql connection (destination). Set the Excel connection to be an expression, also use an expression to set the query from the excel. I'd prob look to alias the column names in that query to the true names in the destination. Doing this, you should get an automapping of columns to the target, by name.

Steve.

Post #764961

SSIS Newbie

Posted Wednesday, August 05, 2009 2:43 AM

Forum Newbie

Group: General Forum Members
Last Login: Monday, September 28, 2009 1:30 AM
Points: 3, Visits: 41

Thanks Steve.

Can the mapping of the columns (alias) be done dynamically via a script or Transformation?
Reason been is that I would be processing lots of different files with different formats.
E.g. abc.xls has 5 col going to SQL table (A), abc1.xls has 7 col going to SQL table (A), bbb.xls has 3 col going to SQL table (B) etc.
I can get the destination into a variable, can I get the alias column names into a variables?

Thanks again.

Post #765293

stevefromOZ

Posted Wednesday, August 05, 2009 8:04 AM

SSCommitted

Group: Moderators
Last Login: Friday, June 14, 2013 10:58 AM
Points: 1,764, Visits: 3,199

Do you have *any* column names? ie is Col1 a cloumn name that exists in the data, or more a way t convey to use it's the first column?

If you do have column names, then you can use an expression to set the query against the excel spreadsheet, and of course, an expression can be a concatenation of variable values.

Steve.

Post #765475

kranthi_kk1

Posted Wednesday, October 12, 2011 5:35 AM

Forum Newbie

Group: General Forum Members
Last Login: Tuesday, May 14, 2013 7:36 AM
Points: 2, Visits: 64

Hi,

Could you send me the files and let me try...

Post #1189032

« Prev Topic | Next Topic »

Permissions