How Effective Is Your Data Load Monitoring in SQL and Python?
Learn how you can use monitor your data warehouse load process with Python code and a structured process.
2023-10-06 (first published: 2023-09-20)
1,989 reads
Extract, Transform, Load (ETL)
The Art of Data Ingestion - Part 1
Data movement is a fundamental piece of a data engineer’s duties, and recently I’ve been thinking about the art of data movement. What are some of the most important pieces that a data engineer needs to think about when confronted with data ingestion? There is of course data exporting as well, and in that case, […]
2022-11-11
6,018 reads
2021-04-16
549 reads
Function to find non-printable characters
The function is used to find non-printable ASCII characters in an input string.
2009-05-21 (first published: 2009-04-24)
2,766 reads
Kimball ETL Part 1 – Data Profiling via SSIS Data Flow
A new series sponsored by Actuality Business Intelligence on data warehousing. In part 1, the data flow in SSIS packages are used to profile the source data and determine how it should be handled in the process.
2008-07-23
9,900 reads
ETL for Free-Form Data
This article demonstrates how to extract, transform and load free-form data into a structured form like a staging table by way of XML conversions.
2008-03-20
5,567 reads
2008-01-22
2,960 reads
2007-12-10
3,002 reads
Importing Text-based data: Workbench
Robyn and Phil return with some fresh ideas about how to import text files into SQL Server, without resorting to DTS or SSIS scripting. They go on to show how much can be done in TSQL
2007-11-19
4,235 reads
Parallel Processing of Large Volume ETL Jobs
ETL processing, generally involves copying/moving, transforming, cleaning the records/transactions from one or multiple sources. Most of the batch processing or warehousing projects involve such data processing in millions on daily/weekly basis. Typically, there is a Staging area and production area. Records are cleaned, transformed, filtered and verified from staging to production area. This demands SQL Set theory based queries, parallel processing with multiple processors/CPU. The article focuses on need of SQL Set theory approach and parallel processing while processing large volume of ETL records using programming approach.
2007-11-08
7,086 reads
Blogs
Modify Power BI page visibility and active status with Semantic Link Labs
Setting page visibility and the active page are often overlooked last steps when publishing...
T-SQL Tuesday #190–Mastering a New Technical Skill
By Steve Jones
It’s time for T-SQL Tuesday again and this time Todd Kleinhans has a great...
Getting Started with the MSSQL AI Agent in VS Code
By Steve Jones
Recently I was working in VS Code and I saw a walkthrough for the...
Forums
Password Guidance
Comments posted to this topic are about the item Password Guidance
Using table variables in T-SQL
Comments posted to this topic are about the item Using table variables in T-SQL
Azure elastic query credential question
I am trying to check out elastic query between two test instances we have...
Question of the Day
Using table variables in T-SQL
What happens if you run the following code in SQL Server 2022+?
declare @t1 table (id int); insert into @t1 (id) values (NULL), (1), (2), (3); select count(*) from @t1 where @t1.id is distinct from NULL;See possible answers