ETL Antipattern: Skipping The Documentation
Documentation is an asset that is both loathed and loved. Creating technical and business documentation is often looked upon as a tedious chore, something that really ought to be...
2020-12-20
1 reads
Tim Mitchell
- Interests: SQL Server, Data Warehousing, ETL, Data Architecture, Python, Dbt
- Website: https://www.TimMitchell.net
- Bluesky: tmitch.net
ETL Antipattern: Load Processes that Don’t Scale
One of the most significant design considerations in ETL process development is the volume of data to be processed. Most ETL processes have time constraints that require them to...
2020-12-19
256 reads
ETL Antipattern: Load Processes that Don’t Scale
One of the most significant design considerations in ETL process development is the volume of data to be processed. Most ETL processes have time constraints that require them to...
2020-12-19
2 reads
ETL Antipattern: Failure to Test and Validate
“If it compiles, it works.” – An unemployed developer Building ETL processes is quite easy. Building ETL processes that deliver accurate results as quickly as possible is substantially more...
2020-12-18
10 reads
ETL Antipattern: Failure to Test and Validate
“If it compiles, it works.” – An unemployed developer Building ETL processes is quite easy. Building ETL processes that deliver accurate results as quickly as possible is substantially more...
2020-12-18
3 reads
ETL Antipattern: Failing to Treat ETL Logic as Source Code
In most data projects, building the extract-transform-load (ETL) logic takes a significant amount of time. Enterprise ETL processes must do several things well: retrieve enough data to satisfy the...
2020-12-17
10 reads
ETL Antipattern: Failing to Treat ETL Logic as Source Code
In most data projects, building the extract-transform-load (ETL) logic takes a significant amount of time. Enterprise ETL processes must do several things well: retrieve enough data to satisfy the...
2020-12-17
4 reads
ETL Antipattern: No Error Handling Logic
I usually avoid talking about technology in absolutes, but here’s one that I can share without reservation: On a long enough timeline, every single ETL process will eventually fail....
2020-12-16
7 reads
ETL Antipattern: Lazy Metadata
If data is a train, then metadata is the track on which it travels. A good metadata definition in ETL processes will help to ensure that the flow of...
2020-12-15
10 reads
ETL Antipattern: Performing Full Loads Instead of Incremental Loads
In my last post in the ETL Antipatterns series, I wrote about the common antipattern of ingesting or loading more data than necessary. This brief post covers one specific...
2020-12-14
35 reads
Blogs
What’s new in SQL Server 2025 CTP 2.0
Three years ago, when the first public preview of SQL Server 2022 (CTP 2.0)...
Monday Monitor Tips: Beyond SQL Server
By Steve Jones
Redgate Monitor works with more than SQL Server. Some big changes were announced recently,...
T-SQL REST API Integration in SQL Server 2025: Streamlining T-SQL Snapshot Backups
In this post, I’ll walk you through a T-SQL script that creates application-consistent snapshots...
Forums
Connect tabular model to excel via Power BI semantic model
I have a tabular cube, with myself included in one of the roles. I...
New lightweight pure‑T‑SQL unit‑testing framework (T‑TEST) — feedback welcome
Hi all, I’ve just open‑sourced T‑TEST, a tiny alternative to tSQLt that lives...
Helpful Management Studio Settings and Features
Comments posted to this topic are about the item Helpful Management Studio Settings and...
Question of the Day
The Minimal Linked Server
What is the minimal number of parameters to add a linked server with sp_addlinkedserver?
See possible answers