ETL Testing Tools

SQLServerCentral is supported by Red Gate Software Ltd.

Popular Topics

Home

Members

Calendar

Who's On

Home » Programming » Testing » ETL Testing Tools

ETL Testing Tools

Rate Topic

Display Mode

Topic Options

Author

Message

vick12

Posted Tuesday, October 23, 2012 7:48 AM

SSC Rookie

Group: General Forum Members
Last Login: Tuesday, November 20, 2012 9:04 PM
Points: 28, Visits: 86

Hi All,

I need to know if there is any tool which can be used to for post migration ETL testing? The ETL has been written using sql scripts to move the data from Legacy database to a new database and both have different database structures We need to test the tranformed data for accuracy and check for data quality and quantity after the ETL process is executed.
I have questions about the following:
1.what should be the best approach/ best practices to test the data in the new database after transformation?
2. I would like to know if there is any tool which can be used to compare the data in old vs new database (both having different structures) ? Thanks.

Post #1376052

FREDERICK

Posted Saturday, February 09, 2013 12:20 PM

Forum Newbie

Group: General Forum Members
Last Login: Saturday, February 09, 2013 12:21 PM
Points: 4, Visits: 24

Hello

You may want to check out
tSQLt – The Database Unit Testing Framework for SQL Server
http://tsqlt.org/

Tests are automatically run within transactions – this keeps tests independent and reduces any cleanup work you need

* Tests can be grouped together within a schema – allowing you to organize your tests and use common setup methods

* Output can be generated in plain text or XML – making it easier to integrate with a continuous integration tool

* Provides the ability to fake tables and views, and to create stored procedure spies – allowing you to isolate the code which you are testing

FRED

Post #1418041

opc.three

Posted Saturday, February 09, 2013 2:02 PM

SSCertifiable

Group: General Forum Members
Last Login: Today @ 7:33 AM
Points: 6,696, Visits: 11,713

If you're moving to a different structure then I would not trust anything to validate that anyhow. Chances are you will need custom methods to validate your custom transformations. Common methods are reconciling row counts between systems and picking (or conjuring) a row on the source that should exercise all parts of a given transformation, e.g. 1 row on source becomes three rows on destination, and validating that you see the expected result on the destination.

__________________________________________________________________________________________________
There are no special teachers of virtue, because virtue is taught by the whole community. --Plato

Believe you can and you're halfway there. --Theodore Roosevelt

Everything Should Be Made as Simple as Possible, But Not Simpler --Albert Einstein

The significant problems we face cannot be solved at the same level of thinking we were at when we created them. --Albert Einstein

1 apple is not exactly 1/8 of 8 apples. Because there are no absolutely identical apples. --Giordy

Post #1418048

« Prev Topic | Next Topic »

Permissions