How to test an ETL process ?

  • Is there a set of guidelines and tools which can be used for testing if your ETL process does its job correctly ?

    I was thinking in terms of unit testing, test driven development which is used in programming languages.

    Thanks.

  • What kind of testing are you planning? Is the agenda for the testing related to data correctness or performance related?

    Raunak J

  • well,,,, in your source ,u may check whether u are able to pick all the records that are provided in ur Data source.

    if using transformation, then u may test if it is falling under ur test cases,

    and destination is having required output.

    Rest,, u please elaborate what u actually want to achieve .?

  • etl.laptop (9/26/2013)


    Is there a set of guidelines and tools which can be used for testing if your ETL process does its job correctly ?

    I was thinking in terms of unit testing, test driven development which is used in programming languages.

    Thanks.

    There are no testing tools provided with SSIS. There might be some 3rd parties out there who offer this though.

    Basically it boils down to this: run the package on test data. Does it crash? No? Good. Yes? Fix errors and try again.

    Need an answer? No, you need a question
    My blog at https://sqlkover.com.
    MCSE Business Intelligence - Microsoft Data Platform MVP

  • Raunak Jhawar (9/30/2013)


    What kind of testing are you planning? Is the agenda for the testing related to data correctness or performance related?

    I want my data to be correct. Now that you mentioned it, I am also interested in performance testing. I did not know about that before your post. Can you suggest some books, guidelines etc. ?

    Thanks.

Viewing 5 posts - 1 through 4 (of 4 total)

You must be logged in to reply to this topic. Login to reply