ETL ( Extract, transform, load) doesn't have to be like a spell on hell. To make a success of ETL systems, you need the freedom and ability to make graceful U-turns when you detect a mistake in architecture or configuration: to fix the root problem rather than to merely tackle the symptoms. Feodor lists the eight most common root causes of failure in ETL systems, and how to fix them.
2015-01-30
13,243 reads
For loading text, CSV or XML files into SQL Server, the Log Parser utility, with its amazing SQL engine, is likely to be the obvious choice. Although initially developed purely for converting IIS logs, the Log Parser can turn its hand to a range of formats including even event logs or the Windows registry.
2013-11-27
3,565 reads
For loading text, CSV or XML files into SQL Server, the Log Parser utility, with its amazing SQL engine, is likely to be the obvious choice. Although initially developed purely for converting IIS logs, the Log Parser can turn its hand to a range of formats including even event logs or the Windows registry.
2013-11-20
2,923 reads
Too often, the batch systems that underlie a lot of database processing just grow without conscious design. When runs start to extend beyond their allotted time, and tuning no longer solves the problem, it is often discovered that batches are run in series, with draconian error handling. It is time to impose some rational design, and Nigel is a seasoned healer of batch processes.
2013-10-30
3,753 reads
Here's a great method for managing ETL for data marts and small data warehouses with just T-SQL.
2012-12-27
5,013 reads
Recently while working on a project to import data from an Excel worksheet using SSIS, I realized that sometimes the SSIS Package failed even though when there were no changes in the structure/schema of the Excel worksheet. I investigated it and I noticed that the SSIS Package succeeded for some set of files, but for others it failed. I found that the structure/schema of the worksheet from both these sets of Excel files were the same, the data was the only difference. How come just changing the data can make an SSIS Package fail? What actually causes this failure? What can we do to fix it?
2012-10-08
3,887 reads
Managing Data removal During ETL. First of Comprehensive tools designed for ease of use especially in enterprise Projects.
2011-09-13
4,481 reads
Learn how to dynamically load data from ETL load files using SSIS as a shell. The code downloads files from FTP, parses them and loads them into the database.
2013-05-03 (first published: 2010-10-19)
27,887 reads
A Technique to deal with moving data from multiple schemas into one table
2010-08-09
6,405 reads
Extract-load-transform integration can offer performance and cost advantages over ETL. Here's how to pick the right approach.
2010-07-14
4,934 reads
By Steve Jones
One of the things I’ve been requesting for a number of years is cost...
By Steve Jones
“Don’t aim to have others like you; aim to have them respect you.” –...
Many years ago, before I joined Oracle, I was working on a major modernisation...
Comments posted to this topic are about the item SQL Art, Part 4: Happy...
Comments posted to this topic are about the item SQL Server Still Wins
Comments posted to this topic are about the item DBCC CHECKDB Limits I
When running DBCC CHECKDB on SQL Server 2025, can I include the Resource Database?
See possible answers