Raghavendra Narayana


SQLServerCentral Article

Parallel Processing of Large Volume ETL Jobs

ETL processing, generally involves copying/moving, transforming, cleaning the records/transactions from one or multiple sources. Most of the batch processing or warehousing projects involve such data processing in millions on daily/weekly basis. Typically, there is a Staging area and production area. Records are cleaned, transformed, filtered and verified from staging to production area. This demands SQL Set theory based queries, parallel processing with multiple processors/CPU. The article focuses on need of SQL Set theory approach and parallel processing while processing large volume of ETL records using programming approach.

2.44 (9)

You rated this post out of 5. Change rating

2007-11-08

6,763 reads

Blogs

Penetration Testing your SQL Server, Part 1 – The Recon Mission

By

Since witnessing a rather nasty cyber attack around a year ago, I’ve been thinking...

SQL Saturday Denver 2023–VCS Primer for the Database slides

By

My slides are here: VCS Primer Denver 2023 This was an overview of what...

Future Data Driven 2023 is This Week

By

The Future Data Driven 2023 virtual conference is coming on Wednesday, September 27. Register...

Read the latest Blogs

Forums

WickrMe: hanselplug | Wire: hanselplug | ketamine for sale in Australia, Armidal

By ketamineforsale

WireID: hanselplug WickrID: hanselplug Buy ketamine online, buy vitamine k online, buy special k...

Running a Service

By Steve Jones - SSC Editor

Comments posted to this topic are about the item Running a Service

Creating Two Keys

By Steve Jones - SSC Editor

Comments posted to this topic are about the item Creating Two Keys

Visit the forum

Ask SSC Logo Ask SSC

SQL Server Q&A from the SQLServerCentral community

Get answers