Parallel Processing of Large Volume ETL Jobs
ETL processing, generally involves copying/moving, transforming, cleaning the records/transactions from one or multiple sources. Most of the batch processing or warehousing projects involve such data processing in millions on daily/weekly basis. Typically, there is a Staging area and production area. Records are cleaned, transformed, filtered and verified from staging to production area. This demands SQL Set theory based queries, parallel processing with multiple processors/CPU. The article focuses on need of SQL Set theory approach and parallel processing while processing large volume of ETL records using programming approach.
Importing Poorly Formatted Text Files using SSIS
Importing text files is a common task for DBA's and Developers, but what happens when the text file is not properly formatted?
SQL Puzzle 7
After a gap of sixteen months, Lionel Clarke, the creator of the only 3-D maze game to be written in TSQL, returns with a new SQL puzzle. It is very simple. You have to move as much of the data as you can from the source tables to the destination tables.
Using SQL Server 2008's MERGE statement
SQL Server 2008's new MERGE statement allows you to insert, update, or delete data based on certain join conditions in the same statement.
Which Platform Do You Work On?
The growth of SQL Server's subsystems leaves Steve Jones wondering how should we be thinking about the product.
XML Workshop X - Working with namespaces
With the tenth installment of his series on XML, Jacob Sebastian turns his attention to the art of namespaces and how you can avoid ambiguity in interpreting various elements.
Optimize tempdb in SQL Server by Striping and Splitting
Find pointers to optimize tempdb performance in SQL Server by striping and splitting across multiple files in SQL Server 2005.
The Baker's Dozen: 13 Productivity Tips for Transact-SQL 2005
SQL Server 2005 offers T-SQL language features that can improve your productivity.
PC Energy Use
Spreadsheet to calculate a reasonably accurate picture of energy use of PCs and peripherals in your company.
Blogs
Overcoming Imposter Syndrome: A Plan
By Brian Kelley
My most recent bout with imposter syndrome was with ISACA’s Digital Trust Ecosystem Framework...
Advice I Like: Celebrate Success
By Steve Jones
“On the way to a grand goal, celebrate the smallest victories as if each...
Programmatically Retrieving MLV Lineage and Refresh Times
Materialized lake views (MLVs) in Microsoft Fabric are an effective way to implement medallion...
Forums
BCA KCP Morowali Telp:Cs.08216977726
Whatsapp:08216977726 Jl. Trans Sulawesi, Keurea, Kec. Bahodopi, Kabupaten Morowali, Sulawesi Tengah 94974
BCA KCP Kertopaten Telpon. 083135766741
WhatsApp 083135766741 Jl. Pegirian No.114, RT.007/RW.10, Sidodadi, Kec. Simokerto, Surabaya, Jawa Timur 60145
BCA KCP Kas Palu Barat Telp:Cs.083831618816
Whatsapp:083831618816 Jl. Sungai Malei No.35, Ujuna, Kec. Palu Bar., Kota Palu, Sulawesi Tengah 94111
Question of the Day
Increase Deadlock Detection
How can I alter the deadlock detection interval to 2 seconds instead of 5 seconds on my SQL Server 2025 instance?
See possible answers