SQLServerCentral Article

Sponsored Content

SQLServerCentral.com is always looking for ways that we can provide you with better, more useful content to help you learn about SQL Server. We've got a new idea and we're looking for feedback.

SQLServerCentral Article

Parallel Processing of Large Volume ETL Jobs

ETL processing, generally involves copying/moving, transforming, cleaning the records/transactions from one or multiple sources. Most of the batch processing or warehousing projects involve such data processing in millions on daily/weekly basis. Typically, there is a Staging area and production area. Records are cleaned, transformed, filtered and verified from staging to production area. This demands SQL Set theory based queries, parallel processing with multiple processors/CPU. The article focuses on need of SQL Set theory approach and parallel processing while processing large volume of ETL records using programming approach.

Blogs

The 2026 Redgate Summit in New York City

By

We’re coming back to New York, which is exciting for me. I love NYC....

Monitoring Fabric Mirroring for SQL 2025

By

I previously wrote about how the underlying technology for Fabric mirroring changed with SQL...

Monday Monitor Tips: Intelligent Alert Thresholds

By

At the recent Redgate Summit in Chicago, I demo’d (lightly) the ML based Alert...

Read the latest Blogs

Forums

Seeding a Fabric Warehouse with dbt for Visual Studio Code: The Fabric Modern Data Platform

By John Miner

Comments posted to this topic are about the item Seeding a Fabric Warehouse with...

Seeding a Fabric Warehouse with dbt for Visual Studio Code: The Fabric Modern Data Platform

By Steve Jones - SSC Editor

Comments posted to this topic are about the item Seeding a Fabric Warehouse with...

Doing the Little Things

By Steve Jones - SSC Editor

Comments posted to this topic are about the item Doing the Little Things

Visit the forum

Question of the Day

Historical Data Tracking

If I want to track historical data values, which mechanism should I use?

See possible answers