Ed Elliott

How to test ETL Processes in production

This is the final part in the four-part series into testing ETL pipelines, how exciting!
Part 1 - Unit Testing https://the.agilesql.club/2019/07/how-do-we-test-etl-pipelines-part-one-unit-tests/ Part 2 - Integration Testing https://the.agilesql.club/2019/08/how-do-we-prove-our-etl-processes-are-correct-how-do-we-make-sure-upstream-changes-dont-break-our-processes-and-break-our-beautiful-data/ Part 3...

2019-10-02

6 reads

How do test the upstream data is good in an etl process (etl testing part 3)?

In the first two parts of this series (https://the.agilesql.club/2019/07/how-do-we-test-etl-pipelines-part-one-unit-tests/ and https://the.agilesql.club/2019/08/how-do-we-prove-our-etl-processes-are-correct-how-do-we-make-sure-upstream-changes-dont-break-our-processes-and-break-our-beautiful-data/), I talked about how to unit test your business logic and integration test your ETL infrastructure code. Having...

2019-09-30

2 reads

Blogs

How I passed the 70-761 certification exam

By

FUN FACT: I have been a Microsoft Certified Professional for SQL Server for over...

Azure Storage tips

By

As a followup to my blog post Azure Data Lake Store Gen2 is GA,...

Managing Agent Jobs on Availability Group Servers

By

As always, the scripts in this post can also be found on our Git...

Read the latest Blogs

Forums

how about explaining your RegEx logic?

By jeffrey yao

RegEx is always tough to digest (without referring to document), so it would be...

Relatively easy query assistance - datediff

By morkal

Hi all, I have a question since I'm new to SQL: I have a...

Mirroring alerts

By kilein

Hi, In one of our customers the database mirroring was already configured. After long...

Visit the forum

Ask SSC

SQL Server Q&A from the SQLServerCentral community

Get answers