Ed Elliott

How to test ETL Processes in production

This is the final part in the four-part series into testing ETL pipelines, how exciting!
Part 1 - Unit Testing https://the.agilesql.club/2019/07/how-do-we-test-etl-pipelines-part-one-unit-tests/ Part 2 - Integration Testing https://the.agilesql.club/2019/08/how-do-we-prove-our-etl-processes-are-correct-how-do-we-make-sure-upstream-changes-dont-break-our-processes-and-break-our-beautiful-data/ Part 3...

2019-10-02

4 reads

How do test the upstream data is good in an etl process (etl testing part 3)?

In the first two parts of this series (https://the.agilesql.club/2019/07/how-do-we-test-etl-pipelines-part-one-unit-tests/ and https://the.agilesql.club/2019/08/how-do-we-prove-our-etl-processes-are-correct-how-do-we-make-sure-upstream-changes-dont-break-our-processes-and-break-our-beautiful-data/), I talked about how to unit test your business logic and integration test your ETL infrastructure code. Having...

2019-09-30

2 reads

Blogs

Installing SQL Server on Windows? Don’t forget these two useful switches

By

A few days ago on Twitter I wrote: Couldn’t connect to new SQL Server...

Upgrading SQL Server 2017 Containers to 2019 non-root Containers with Data Volumes

By

Recently Microsoft released a Non-Root SQL Server 2019 container and that’s the default if...

DBA Myths: Is an identity column always unique, in order, and without gaps?

By

Identity columns are all over the place. Probably 80-90% of the tables I see...

Read the latest Blogs

Forums

Numeric and Decimal

By Steve Jones - SSC Editor

Comments posted to this topic are about the item Numeric and Decimal, which is...

power shell script for add datetime to file

By adisql

Hi, i would like to generate csv file with datetime  through sql job with...

NOT Operator and NULLs

By kuopaz

--test data declare @T table(a int null, b int null) insert @T(a, b) select...

Visit the forum

Ask SSC

SQL Server Q&A from the SQLServerCentral community

Get answers

Question of the Day

Missing Data

See possible answers