Data Warehouse Considerations - SCD Type 2 vs Overwrite Dimension Tables
How we handle data warehousing updates to dimension tables is crucial and this article covers Slowly Changing Dimensions versus overwriting tables.
2024-12-20
Data Warehouse
The Load of Real Time Data Warehouses
How much load do real time updates place on a data warehouse? Steve has a few thoughts on the analysis of the Amazon Redshift dataset, Redset.
2024-10-07
230 reads
Dimensional Modelling Case Study Part 1 - Age Group
Learn how you can handle dimensional modeling in a data warehouse when your data uses different categorization for ages.
2024-01-12
2,958 reads
Time-Series Data Analysis with Apache Druid
Learn the basics of Apache Druid and how it can be used to ingest data into a data lake.
2023-11-10
14,607 reads
Upserts in Amazon Redshift
This article discusses different approaches of Upserts (update+inserts) in Amazon Redshift
2023-08-09
30,381 reads
A Overview of Amazon Redshift
This article gives an overview of Amazon Redshift, the cloud data warehouse in AWS.
2023-07-24
25,621 reads
How do you secure sensitive data in a modern Data Warehouse?
In 2019 Canadian Broadcasting Corporation (CBC) news reported a massive data breach at the Desjardins Group, which is a Canadian financial service cooperative and the largest federation of credit unions in North America. The report indicated, a "malicious" employee copied sensitive personal information collected by Desjardins from their data warehouse. The data breach compromised the […]
2022-03-30
3,149 reads
Infrastructure Planning for a SQL Server Data Warehouse
In this tip we look at some things you should think about when planning for a SQL Server data warehouse.
2019-02-12
2,879 reads
Modern Data Warehouse Design Pattern – Part I
The modern data warehouse design helps in building a hub for all types of data to initiate integrated and transformative solutions. To achieve these goals and to support modern designs, Microsoft has introduced a set of fully managed, cloud-based services that not only support modern data warehouse design patterns but also provide the advantages of inbuilt scalability, high availability, good performance, and flexibility.
2018-09-04
3,797 reads
Using the DbFit Framework for Data Warehouse Regression Testing
It is ironic that the users of database application need to rely on the very technologists that created the system to then devise and run their acceptance tests. Surely someone has devised a test system for databases that is simple enough for ordinary tech-savvy people to use and for them to create the tests? Yes they have. Fitnesse DbFit is a mature product that can, and does, test SQL Server databases, and Nat Sundar explains how to set it up and do it.
2017-05-18
3,142 reads
Blogs
Microsoft Purview data governance best practices
By James Serra
Microsoft Purview can be the best data governance tool in the world, but it...
Crash-Consistent MongoDB Snapshot and Restore with Everpure Fusion
I’ve been working on a project that combines two things I spend a lot...
AI and Data Engineering on the Edge: The Good, the Bad, and the Overhyped
Running AI and data pipelines on the edge instead of the cloud has gone...
Forums
PolyBase Trace Flags
Are there any good articles on all the trace flags that are enabled on...
Replacing Maintenance tasks now using SSMS 22 - what to do with File operations
Unfortunately I'm using SSMS 22. It didn't come with maintenance plans by default. I...
Secure Cached Plans
Comments posted to this topic are about the item Secure Cached Plans
Question of the Day
Secure Cached Plans
The DMV, sys.dm_exec_cached_plans, contains rows for each cached plan on an instance. In Azure SQL Database, not every used has rights to every database, as there does exist an instance behind each database. How is security handled for this DMV in Azure?
See possible answers