Click here to monitor SSC
SQLServerCentral is supported by Red Gate Software Ltd.
 
Log in  ::  Register  ::  Not logged in
 
 
 
        
Home       Members    Calendar    Who's On


Add to briefcase

Data flow mapping - ETL Expand / Collapse
Author
Message
Posted Monday, February 25, 2013 11:09 PM
Forum Newbie

Forum NewbieForum NewbieForum NewbieForum NewbieForum NewbieForum NewbieForum NewbieForum Newbie

Group: General Forum Members
Last Login: Tuesday, August 19, 2014 1:17 AM
Points: 5, Visits: 63
Hi,
I was wondering what do you guys use to map the data flow in ETL. I am looking at the field level flow of data. By this, I mean a document that can be passed on to the ETL developers which maps source table.column to destination table.column and the transformation logic between source and destination. This is also handy on the reporting side to map out the fields and logic in report.

Currently we use a mix of excel and word to map this. I was wondering whether there is a better way/tool to do this?

Thanks in advance
Post #1423884
Posted Wednesday, February 27, 2013 2:54 PM
Ten Centuries

Ten CenturiesTen CenturiesTen CenturiesTen CenturiesTen CenturiesTen CenturiesTen CenturiesTen Centuries

Group: General Forum Members
Last Login: Friday, July 31, 2015 8:28 AM
Points: 1,270, Visits: 1,338
chess-288252 (2/25/2013)
Hi,
I was wondering what do you guys use to map the data flow in ETL. I am looking at the field level flow of data. By this, I mean a document that can be passed on to the ETL developers which maps source table.column to destination table.column and the transformation logic between source and destination. This is also handy on the reporting side to map out the fields and logic in report.

Currently we use a mix of excel and word to map this. I was wondering whether there is a better way/tool to do this?

On Ralph Kimball's website, there is a MS Excel spreadsheet under the tools/resources for the 'Microsoft Data Warehouse Toolkit' book that we use. It's probably pretty similar to what you've developed.

http://www.kimballgroup.com/wp-content/uploads/2012/07/Ch02_MDWToolkit_Datamodel_Spreadsheet_4.0_2008R2.zip

HTH,
Rob
Post #1424772
Posted Wednesday, February 27, 2013 9:44 PM
Forum Newbie

Forum NewbieForum NewbieForum NewbieForum NewbieForum NewbieForum NewbieForum NewbieForum Newbie

Group: General Forum Members
Last Login: Tuesday, August 19, 2014 1:17 AM
Points: 5, Visits: 63
It is quite similar to what we are using now but I can certainly pick up some bits from this and put it in our template.

Looks like excel is the tool for this! I was hoping there would be some other tool custom built for this.

Thanks for the info.
Post #1424886
Posted Thursday, February 26, 2015 8:05 AM


Forum Newbie

Forum NewbieForum NewbieForum NewbieForum NewbieForum NewbieForum NewbieForum NewbieForum Newbie

Group: General Forum Members
Last Login: Thursday, February 26, 2015 8:22 AM
Points: 1, Visits: 3
Excel is a popular choice because there have not been many alternatives if any - you need to have a look at Analytixds.com. A purpose built solution for mapping at an enterprise level, that allows you to generate SSIS packages from the mappings... a ton of other features that are miles ahead of excel, and robust metadata features as well (impact analysis, lineage, truncation alerts driven off the mappings). Have a look. Excel is only the answer if you don't know about this tool - there is a wealth of information on the site, and you can get an evaluation license for free.

Sam Benedict, VP Strategic Accounts
Analytix Data Services - Mapping, Code-gen Platform for SSIS/All ETL Brands
sam.benedict@analytixds.com
www.analytixds.com
Post #1663833
Posted Tuesday, July 7, 2015 7:44 AM
Forum Newbie

Forum NewbieForum NewbieForum NewbieForum NewbieForum NewbieForum NewbieForum NewbieForum Newbie

Group: General Forum Members
Last Login: Tuesday, July 28, 2015 3:50 PM
Points: 3, Visits: 29
I think you are looking for a Source To Target (STT matrix) solution.

Several vendors (include some open-source) delivers this concept for ETL documenting and forward engineering.

Give it a search.
Post #1700768
« Prev Topic | Next Topic »

Add to briefcase

Permissions Expand / Collapse