Ed Elliott

How to test ETL Processes in production

This is the final part in the four-part series into testing ETL pipelines, how exciting!
Part 1 - Unit Testing https://the.agilesql.club/2019/07/how-do-we-test-etl-pipelines-part-one-unit-tests/ Part 2 - Integration Testing https://the.agilesql.club/2019/08/how-do-we-prove-our-etl-processes-are-correct-how-do-we-make-sure-upstream-changes-dont-break-our-processes-and-break-our-beautiful-data/ Part 3...

2019-10-02

11 reads

How do test the upstream data is good in an etl process (etl testing part 3)?

In the first two parts of this series (https://the.agilesql.club/2019/07/how-do-we-test-etl-pipelines-part-one-unit-tests/ and https://the.agilesql.club/2019/08/how-do-we-prove-our-etl-processes-are-correct-how-do-we-make-sure-upstream-changes-dont-break-our-processes-and-break-our-beautiful-data/), I talked about how to unit test your business logic and integration test your ETL infrastructure code. Having...

2019-09-30

3 reads

Blogs

Azure SQL Database – Error Logs?

By

Ok, so Azure SQL doesn’t really have its own error log based somewhere on...

Pluralsight Free April

By

It’s a few days into April, but not too late I hope to mention...

Daily Coping 7 Apr 2020

By

I’ve started to add a daily coping tip to the SQLServerCentral newsletter, which is...

Read the latest Blogs

Forums

For loop in C# script component

By rohitkocharda

Hi Everyone,I have a script task calling a sequence container. What i would like...

More Time to Certify

By Steve Jones - SSC Editor

Comments posted to this topic are about the item More Time to Certify

Difference Between Lists

By BTylerWhite

Comments posted to this topic are about the item Difference Between Lists

Visit the forum

Ask SSC

SQL Server Q&A from the SQLServerCentral community

Get answers