SQLServerCentral Article

Parallel Processing of Large Volume ETL Jobs

ETL processing, generally involves copying/moving, transforming, cleaning the records/transactions from one or multiple sources. Most of the batch processing or warehousing projects involve such data processing in millions on daily/weekly basis. Typically, there is a Staging area and production area. Records are cleaned, transformed, filtered and verified from staging to production area. This demands SQL Set theory based queries, parallel processing with multiple processors/CPU. The article focuses on need of SQL Set theory approach and parallel processing while processing large volume of ETL records using programming approach.

Blogs

Monday Monitor Tips: The Jobs Report

By

A customer wanted a report they could email to their boss about jobs, something...

Automating SQL Maintenance: How DevOps Principles Reduce Downtime

By

In the world of modern data infrastructure, SQL databases remain the backbone of enterprise...

From Couch-Potato to Triathlete – and What This Means for Your SQL Server

By

Do you know if your SQL Server is really running at its best? To...

Read the latest Blogs

Forums

Find Invalid Objects in SQL Server

By Nisarg Upadhyay

Comments posted to this topic are about the item Find Invalid Objects in SQL...

Single User SQL Server on Linux

By Steve Jones - SSC Editor

Comments posted to this topic are about the item Single User SQL Server on...

All the Costs of Downtime

By Steve Jones - SSC Editor

Comments posted to this topic are about the item All the Costs of Downtime

Visit the forum

Question of the Day

Single User SQL Server on Linux

How can I start SQL Server on Linux in single-user mode to restore the master database?

See possible answers