Designing SQL Server ETL Pipelines That Don't Break at Scale
A few lessons learned in building ETL pipelines and tricks to ensure you can easily maintain these over time.
2026-05-15
91 reads
A few lessons learned in building ETL pipelines and tricks to ensure you can easily maintain these over time.
2026-05-15
91 reads
2026-05-15 (first published: 2026-05-06)
1,012 reads
LLMs should be used in data pipelines for unstructured text, semantic search, and natural language queries – but avoided for deterministic, high-volume, or regulated tasks. Drawing on my real-world experience building large-scale ML systems, in this guide I’ll explain exactly where LLMs belong in your data pipeline and, just as importantly, where they don’t.
2026-05-15
In theory, SQL Server performance monitoring is pretty simple: 1. Review the server’s top wait types, 2. Find the queries causing those wait types, 3. Fix those queries, or improve the way the server reacts to them (indexes, settings, etc.). But in practice, step 2 is awful because:
2026-05-13
SQL Server 2025 shipped without SSRS. If you're managing paginated reports, your options just narrowed; but they're not what most people think. I evaluated all 10 realistic migration paths. Here's an honest comparison, including the one I built.
2026-05-11
13,190 reads
Explore the mechanics of the SOFTMAX function in SQL Server. Transform scores into probabilities with this essential tool.
2026-05-11
Learn a quick way to calculate distances without resorting to spatial calculations.
2026-05-08
1,913 reads
Learn how to split strings efficiently in T-SQL using STRING_SPLIT and the REGEXP_SPLIT_TO_TABLE function in SQL Server 2025.
2026-05-08
2026-05-06 (first published: 2025-04-16)
1,682 reads
Learn how table valued parameter joins in SQL Server stored procedures can negatively impact query performance.
2026-05-06
By Brian Kelley
If you are considering any of the ISACA AI certs like the Advanced Artificial...
By ChrisJenkins
Are you currently using Microsoft Fabric or considering migrating to it? If so, there...
By SQLPals
Track SQL Server Configuration Changes Using the Error Log If you...
Comments posted to this topic are about the item Designing SQL Server ETL Pipelines...
Comments posted to this topic are about the item Detecting Deadlocks Quickly
We have a SQL Server installed. We have a 500GB drive for the database....
In the Database Engine, when a deadlock is detected, what does the detection interval shrink to (in time)?
See possible answers