In my last post in the ETL Antipatterns series, I wrote about the common antipattern of ingesting or loading more data than necessary. This brief post covers one specific...
2020-12-14
36 reads
In my continuing series on ETL Antipatterns, I’ll discuss the problem of loading too much data in extract-transform-load processes. ETL Antipattern: processing too much data A common design flaw...
2020-12-13
10 reads
In this first post in my series on ETL Antipatterns, I’m going to discuss one of the most common missteps when building an extract-transform-load (ETL) process: jumping straight into...
2020-12-12
25 reads
We’re rounding the corner to the second half of December, which means it’s time for my favorite holiday: Festivus! Like many of you, I enjoy gathering around the Festivus...
2020-12-12
3 reads
Azure Data Factory has grown in both popularity and utility in the past several years. It has evolved beyond its significant limitations in its initial version, and is quickly...
2020-09-08 (first published: 2020-08-28)
499 reads
Those of us who write technical articles and deliver technical presentations are always on the lookout for the perfect data set for demonstration and testing. Microsoft has done a...
2020-08-17 (first published: 2020-08-06)
653 reads
When moving data in an extraction, transformation, and loading (ETL) process, the most efficient design pattern is to touch only the data you must, copying just the data that...
2020-08-05 (first published: 2020-07-23)
557 reads
A few years back, I wrote a blog post about using an SSIS object variable as a data flow source. In that post, I described how you could load...
2020-07-30
236 reads
For the better part of 15 years, SQL Server Integration Services (SSIS) has been the go-to enterprise extract-transform-load (ETL) tool for shops running on Microsoft SQL Server. More recently,...
2020-07-28 (first published: 2020-07-16)
723 reads
SSIS parameters help to ease the process of passing runtime values to SSIS packages. For values that can change over time, using parameters in SSIS is an ideal means...
2020-07-14 (first published: 2020-07-02)
478 reads
By Steve Jones
Recently I was working in VS Code and I saw a walkthrough for the...
By alevyinroc
In the blink of an eye, summer has passed. I don’t know about you,...
By Chris Yates
In today’s digital landscape, data is both a strategic asset and a potential liability....
Comments posted to this topic are about the item Change Tracking Data Retention Options
Comments posted to this topic are about the item Requiring Technical Debt Payments
Comments posted to this topic are about the item Using the FP-Growth Algorithm to...
If I am running this code:
ALTER DATABASE AdventureWorks2017 SET CHANGE_TRACKING = ON (CHANGE_RETENTION=4 xxx);What are the possible choices for xxx? See possible answers