ETL ( Extract, transform, load) doesn't have to be like a spell on hell. To make a success of ETL systems, you need the freedom and ability to make graceful U-turns when you detect a mistake in architecture or configuration: to fix the root problem rather than to merely tackle the symptoms. Feodor lists the eight most common root causes of failure in ETL systems, and how to fix them.
2015-01-30
13,243 reads
For loading text, CSV or XML files into SQL Server, the Log Parser utility, with its amazing SQL engine, is likely to be the obvious choice. Although initially developed purely for converting IIS logs, the Log Parser can turn its hand to a range of formats including even event logs or the Windows registry.
2013-11-27
3,565 reads
For loading text, CSV or XML files into SQL Server, the Log Parser utility, with its amazing SQL engine, is likely to be the obvious choice. Although initially developed purely for converting IIS logs, the Log Parser can turn its hand to a range of formats including even event logs or the Windows registry.
2013-11-20
2,923 reads
Too often, the batch systems that underlie a lot of database processing just grow without conscious design. When runs start to extend beyond their allotted time, and tuning no longer solves the problem, it is often discovered that batches are run in series, with draconian error handling. It is time to impose some rational design, and Nigel is a seasoned healer of batch processes.
2013-10-30
3,753 reads
Here's a great method for managing ETL for data marts and small data warehouses with just T-SQL.
2012-12-27
5,046 reads
Recently while working on a project to import data from an Excel worksheet using SSIS, I realized that sometimes the SSIS Package failed even though when there were no changes in the structure/schema of the Excel worksheet. I investigated it and I noticed that the SSIS Package succeeded for some set of files, but for others it failed. I found that the structure/schema of the worksheet from both these sets of Excel files were the same, the data was the only difference. How come just changing the data can make an SSIS Package fail? What actually causes this failure? What can we do to fix it?
2012-10-08
3,887 reads
Managing Data removal During ETL. First of Comprehensive tools designed for ease of use especially in enterprise Projects.
2011-09-13
4,502 reads
Learn how to dynamically load data from ETL load files using SSIS as a shell. The code downloads files from FTP, parses them and loads them into the database.
2013-05-03 (first published: 2010-10-19)
28,042 reads
A Technique to deal with moving data from multiple schemas into one table
2010-08-09
6,423 reads
Extract-load-transform integration can offer performance and cost advantages over ETL. Here's how to pick the right approach.
2010-07-14
4,934 reads
By Steve Jones
No, I’m not quitting or retiring. Just going on vacation, but I leave tonight...
By Steve Jones
I caught this interesting item over on Pinal Dave’s blog: Eleven Interview Questions that...
Comments posted to this topic are about the item Let's Talk Certifications, which is...
Comments posted to this topic are about the item Building a SQL Server Fleet...
Comments posted to this topic are about the item Smart AI Agents and Data...
I have this data in a table in a SQL Server 2025 database:
EmailAddressID EmailAddress 7 dylan0@ADVENTURE-WORKS.COM 8 Diane1@ADVENTURE-WORKS.COMIf I run this query, which row(s) are returned?
SELECT top 10 * FROM person.EmailAddress WHERE REGEXP_LIKE(EmailAddress, '^D', 'i') AND BusinessEntityID IN (7,8)See possible answers