Designing SQL Server ETL Pipelines That Don't Break at Scale
A few lessons learned in building ETL pipelines and tricks to ensure you can easily maintain these over time.
2026-05-15
1,550 reads
A few lessons learned in building ETL pipelines and tricks to ensure you can easily maintain these over time.
2026-05-15
1,550 reads
2026-05-15 (first published: 2026-05-06)
1,415 reads
LLMs should be used in data pipelines for unstructured text, semantic search, and natural language queries – but avoided for deterministic, high-volume, or regulated tasks. Drawing on my real-world experience building large-scale ML systems, in this guide I’ll explain exactly where LLMs belong in your data pipeline and, just as importantly, where they don’t.
2026-05-15
In theory, SQL Server performance monitoring is pretty simple: 1. Review the server’s top wait types, 2. Find the queries causing those wait types, 3. Fix those queries, or improve the way the server reacts to them (indexes, settings, etc.). But in practice, step 2 is awful because:
2026-05-13
SQL Server 2025 shipped without SSRS. If you're managing paginated reports, your options just narrowed; but they're not what most people think. I evaluated all 10 realistic migration paths. Here's an honest comparison, including the one I built.
2026-05-11
13,497 reads
Explore the mechanics of the SOFTMAX function in SQL Server. Transform scores into probabilities with this essential tool.
2026-05-11
Learn a quick way to calculate distances without resorting to spatial calculations.
2026-05-08
1,932 reads
Learn how to split strings efficiently in T-SQL using STRING_SPLIT and the REGEXP_SPLIT_TO_TABLE function in SQL Server 2025.
2026-05-08
2026-05-06 (first published: 2025-04-16)
1,684 reads
Learn how table valued parameter joins in SQL Server stored procedures can negatively impact query performance.
2026-05-06
By Brian Kelley
If you are considering any of the ISACA AI certs like the Advanced Artificial...
By ChrisJenkins
Are you currently using Microsoft Fabric or considering migrating to it? If so, there...
By SQLPals
Track SQL Server Configuration Changes Using the Error Log If you...
Artificial intelligence tools are quickly becoming part of daily business operations, from document analysis...
Comments posted to this topic are about the item Designing SQL Server ETL Pipelines...
Comments posted to this topic are about the item Detecting Deadlocks Quickly
In the Database Engine, when a deadlock is detected, what does the detection interval shrink to (in time)?
See possible answers