ETL (Extract Transform and Load)

How to get ETL Horribly Wrong

  • Article

ETL ( Extract, transform, load) doesn't have to be like a spell on hell. To make a success of ETL systems, you need the freedom and ability to make graceful U-turns when you detect a mistake in architecture or configuration: to fix the root problem rather than to merely tackle the symptoms. Feodor lists the eight most common root causes of failure in ETL systems, and how to fix them.

2015-01-30

13,243 reads

The ETL from Hell - Diagnosing Batch System Performance Issues

  • Article

Too often, the batch systems that underlie a lot of database processing just grow without conscious design. When runs start to extend beyond their allotted time, and tuning no longer solves the problem, it is often discovered that batches are run in series, with draconian error handling. It is time to impose some rational design, and Nigel is a seasoned healer of batch processes.

2013-10-30

3,753 reads

Importing Data From Excel Using SSIS - Part 1

  • Article

Recently while working on a project to import data from an Excel worksheet using SSIS, I realized that sometimes the SSIS Package failed even though when there were no changes in the structure/schema of the Excel worksheet. I investigated it and I noticed that the SSIS Package succeeded for some set of files, but for others it failed. I found that the structure/schema of the worksheet from both these sets of Excel files were the same, the data was the only difference. How come just changing the data can make an SSIS Package fail? What actually causes this failure? What can we do to fix it?

2012-10-08

3,887 reads

Blogs

Migrating SSIS to Azure – Slidedeck (Techorama 2019)

By

Techorama 2019 is over and it was a blast, as usual. Neatly organised, great...

Containers: Create a Custom Container

By

Creating a custom container is where things get truly exciting. There’s actually a ton...

Mini-Rant: Spoofed Phone Numbers and Trust

By

I’ve seen this more and more over the last year: I receive a phone...

Read the latest Blogs

Forums

The Change Failure Rate

By Steve Jones - SSC Editor

Comments posted to this topic are about the item The Change Failure Rate

Function Issues

By MattNorman88

I have created the following function which is to be used for a check...

SQL Server health check

By 892717952

If I want to do a SQL Server health check, which aspects should be...

Visit the forum

Ask SSC

SQL Server Q&A from the SQLServerCentral community

Get answers