Extract, Transform, Load (ETL)

Parallel Processing of Large Volume ETL Jobs

  • Article

ETL processing, generally involves copying/moving, transforming, cleaning the records/transactions from one or multiple sources. Most of the batch processing or warehousing projects involve such data processing in millions on daily/weekly basis. Typically, there is a Staging area and production area. Records are cleaned, transformed, filtered and verified from staging to production area. This demands SQL Set theory based queries, parallel processing with multiple processors/CPU. The article focuses on need of SQL Set theory approach and parallel processing while processing large volume of ETL records using programming approach.

2.44 (9)


5,024 reads


Undercover Catalogue 0.2 Hox Fix 2 and SQL2008r2/2008/possibly 2005 Compatibility Patch RELEASED


Undercover Catalogue 0.2.2 It looks like a bug has crept it’s way into the...

Just a Week to SQL Sat Pensacola


One of my favorite events, in a wonderful place to spend the weekend. I’ve...

Job History – Back to Basics


An important part of any DBAs job is to ensure database related jobs are...

Read the latest Blogs


Statistics Profile Results

By Steve Jones - SSC Editor

Comments posted to this topic are about the item Statistics Profile Results

Plan to migrate to new SQL server...

By cphite

I've been tasked with moving our production SQL databases to a new server, and...

SQL Server Agent - Scheduled Jobs Log

By rjjh78

Hello, Is there a SQL log somewhere that tracks date and changes made to...

Visit the forum


SQL Server Q&A from the SQLServerCentral community

Get answers