Data Warehouse Considerations - SCD Type 2 vs Overwrite Dimension Tables
How we handle data warehousing updates to dimension tables is crucial and this article covers Slowly Changing Dimensions versus overwriting tables.
2024-12-20
Data Warehouse
The Load of Real Time Data Warehouses
How much load do real time updates place on a data warehouse? Steve has a few thoughts on the analysis of the Amazon Redshift dataset, Redset.
2024-10-07
228 reads
Dimensional Modelling Case Study Part 1 - Age Group
Learn how you can handle dimensional modeling in a data warehouse when your data uses different categorization for ages.
2024-01-12
2,926 reads
Time-Series Data Analysis with Apache Druid
Learn the basics of Apache Druid and how it can be used to ingest data into a data lake.
2023-11-10
14,589 reads
Upserts in Amazon Redshift
This article discusses different approaches of Upserts (update+inserts) in Amazon Redshift
2023-08-09
30,242 reads
A Overview of Amazon Redshift
This article gives an overview of Amazon Redshift, the cloud data warehouse in AWS.
2023-07-24
25,602 reads
How do you secure sensitive data in a modern Data Warehouse?
In 2019 Canadian Broadcasting Corporation (CBC) news reported a massive data breach at the Desjardins Group, which is a Canadian financial service cooperative and the largest federation of credit unions in North America. The report indicated, a "malicious" employee copied sensitive personal information collected by Desjardins from their data warehouse. The data breach compromised the […]
2022-03-30
3,147 reads
Infrastructure Planning for a SQL Server Data Warehouse
In this tip we look at some things you should think about when planning for a SQL Server data warehouse.
2019-02-12
2,879 reads
Modern Data Warehouse Design Pattern – Part I
The modern data warehouse design helps in building a hub for all types of data to initiate integrated and transformative solutions. To achieve these goals and to support modern designs, Microsoft has introduced a set of fully managed, cloud-based services that not only support modern data warehouse design patterns but also provide the advantages of inbuilt scalability, high availability, good performance, and flexibility.
2018-09-04
3,797 reads
Using the DbFit Framework for Data Warehouse Regression Testing
It is ironic that the users of database application need to rely on the very technologists that created the system to then devise and run their acceptance tests. Surely someone has devised a test system for databases that is simple enough for ordinary tech-savvy people to use and for them to create the tests? Yes they have. Fitnesse DbFit is a mature product that can, and does, test SQL Server databases, and Nat Sundar explains how to set it up and do it.
2017-05-18
3,142 reads
Blogs
AI: Blog a Day – Day 6: Embeddings – How AI Understands
By Vinay Thakur
Continuing from Day 5 where we covered notebooks, HuggingFace and fine tuning AI now...
The Book of Redgate: Mistakes
By Steve Jones
This is kind of a funny page to look at. The next page has...
ADF Pipeline Debugging Fails with BadRequest – The Sequel
A while ago I blogged about a use case where a pipeline fails during...
Forums
Dynamic Unpivot
I have a table I didn't design that has tons of repeating groups in...
Writing as an Art and a Job
Comments posted to this topic are about the item Writing as an Art and...
String Similarity II
Comments posted to this topic are about the item String Similarity II
Question of the Day
String Similarity II
What is the range for the result from the EDIT_DISTANCE_SIMILARITY() function in SQL Server 2025?
See possible answers