Ed Elliott's Sql Developer Blog

How to test ETL Processes in production

This is the final part in the four-part series into testing ETL pipelines, how exciting!
Part 1 - Unit Testing https://the.agilesql.club/2019/07/how-do-we-test-etl-pipelines-part-one-unit-tests/ Part 2 - Integration Testing https://the.agilesql.club/2019/08/how-do-we-prove-our-etl-processes-are-correct-how-do-we-make-sure-upstream-changes-dont-break-our-processes-and-break-our-beautiful-data/ Part 3...

2019-10-02

1 reads

How do test the upstream data is good in an etl process (etl testing part 3)?

In the first two parts of this series (https://the.agilesql.club/2019/07/how-do-we-test-etl-pipelines-part-one-unit-tests/ and https://the.agilesql.club/2019/08/how-do-we-prove-our-etl-processes-are-correct-how-do-we-make-sure-upstream-changes-dont-break-our-processes-and-break-our-beautiful-data/), I talked about how to unit test your business logic and integration test your ETL infrastructure code. Having...

2019-09-30

Blogs

GotoWebinar (and Teams) won’t screen share after macOS update to Catalina (10.15)

By

This blog post is about the situation where after upgrading to the latest macOS...

Improving TweetDeck with Better TweetDeck

By

If you are at involved with the #sqlfamily, you are bound to hear about...

Interview with Bob Ward

By

This is the eight interview we have done. This time our guest is the...

Read the latest Blogs

Forums

Protecting Data from the Inside

By Phil Factor

Comments posted to this topic are about the item Protecting Data from the Inside

Remove the middle of a string between wildcards

By ncraigg

I have a field called 'jsonpayload' in a table called 'auditlog' that is populated...

Is SSIS really that bad?

By Rod at work

Today we had our weekly team meeting. Part of my team is working on...

Visit the forum

Ask SSC

SQL Server Q&A from the SQLServerCentral community

Get answers