ETL ( Extract, transform, load) doesn't have to be like a spell on hell. To make a success of ETL systems, you need the freedom and ability to make graceful U-turns when you detect a mistake in architecture or configuration: to fix the root problem rather than to merely tackle the symptoms. Feodor lists the eight most common root causes of failure in ETL systems, and how to fix them.
2015-01-30
13,243 reads
For loading text, CSV or XML files into SQL Server, the Log Parser utility, with its amazing SQL engine, is likely to be the obvious choice. Although initially developed purely for converting IIS logs, the Log Parser can turn its hand to a range of formats including even event logs or the Windows registry.
2013-11-27
3,565 reads
For loading text, CSV or XML files into SQL Server, the Log Parser utility, with its amazing SQL engine, is likely to be the obvious choice. Although initially developed purely for converting IIS logs, the Log Parser can turn its hand to a range of formats including even event logs or the Windows registry.
2013-11-20
2,923 reads
Too often, the batch systems that underlie a lot of database processing just grow without conscious design. When runs start to extend beyond their allotted time, and tuning no longer solves the problem, it is often discovered that batches are run in series, with draconian error handling. It is time to impose some rational design, and Nigel is a seasoned healer of batch processes.
2013-10-30
3,753 reads
Here's a great method for managing ETL for data marts and small data warehouses with just T-SQL.
2012-12-27
5,056 reads
Recently while working on a project to import data from an Excel worksheet using SSIS, I realized that sometimes the SSIS Package failed even though when there were no changes in the structure/schema of the Excel worksheet. I investigated it and I noticed that the SSIS Package succeeded for some set of files, but for others it failed. I found that the structure/schema of the worksheet from both these sets of Excel files were the same, the data was the only difference. How come just changing the data can make an SSIS Package fail? What actually causes this failure? What can we do to fix it?
2012-10-08
3,887 reads
Managing Data removal During ETL. First of Comprehensive tools designed for ease of use especially in enterprise Projects.
2011-09-13
4,513 reads
Learn how to dynamically load data from ETL load files using SSIS as a shell. The code downloads files from FTP, parses them and loads them into the database.
2013-05-03 (first published: 2010-10-19)
28,086 reads
A Technique to deal with moving data from multiple schemas into one table
2010-08-09
6,428 reads
Extract-load-transform integration can offer performance and cost advantages over ETL. Here's how to pick the right approach.
2010-07-14
4,934 reads
By Steve Jones
I was looking over the CHOOSE() function while editing an article at SQL Server...
By Brian Kelley
Here is another short video (~ 15 minutes). This is by the author of...
By Steve Jones
I had a briefing for the 2026 PASS Data Community Summit, which is just...
Comments posted to this topic are about the item SQL Server 2025 Server-level Roles
Comments posted to this topic are about the item Stairway to DAX and Power...
Comments posted to this topic are about the item AI Is Improving Security
In SQL Server 2022+, what does the ##MS_DatabaseConnector## role allow?
See possible answers