Data Warehousing

SQLServerCentral Article

How do you secure sensitive data in a modern Data Warehouse?

  • Article

In 2019 Canadian Broadcasting Corporation (CBC) news reported a massive data breach at the Desjardins Group, which is a Canadian financial service cooperative and the largest federation of credit unions in North America. The report indicated, a "malicious" employee copied sensitive personal information collected by Desjardins from their data warehouse. The data breach compromised the […]

4 (2)

2022-03-30

2,377 reads

External Article

Scaling Up Your Data Warehouse with SQL Server 2008 R2

  • Article

SQL Server 2008 introduced many new functional and performance improvements for data warehousing, and SQL Server 2008 R2 includes all these and more. This paper discusses how to use SQL Server 2008 R2 to get great performance as your data warehouse scales up. We present lessons learned during extensive internal data warehouse testing on a 64-core HP Integrity Superdome during the development of the SQL Server 2008 release, and via production experience with large-scale SQL Server customers. Our testing indicates that many customers can expect their performance to nearly double on the same hardware they are currently using, merely by upgrading to SQL Server 2008 R2 from SQL Server 2005 or earlier, and compressing their fact tables. We cover techniques to improve manageability and performance at high-scale, encompassing data loading (extract, transform, load), query processing, partitioning, index maintenance, indexed view (aggregate) management, and backup and restore.

2011-05-19

5,175 reads

Technical Article

Understanding and Controlling Parallel Query Processing in SQL Server

  • Article

Data warehousing and general reporting applications tend to be CPU intensive because they need to read and process a large number of rows. To facilitate quick data processing for queries that touch a large amount of data, Microsoft SQL Server exploits the power of multiple logical processors to provide parallel query processing operations such as parallel scans. Through extensive testing, we have learned that, for most large queries that are executed in a parallel fashion, SQL Server can deliver linear or nearly linear response time speedup as the number of logical processors increases. However, some queries in high parallelism scenarios perform suboptimally. There are also some parallelism issues that can occur in a multi-user parallel query workload. This white paper describes parallel performance problems you might encounter when you run such queries and workloads, and it explains why these issues occur. In addition, it presents how data warehouse developers can detect these issues, and how they can work around them or mitigate them.

2010-12-10

4,645 reads

External Article

Building a Data Warehouse Blueprint for Success

  • Article

One of the most integral components and critical success factors of any enterprise data warehousing initiative is the Solutions Architecture document, a high-level conceptual model of a data warehousing solution. Learn why this collaborative effort that addresses the needs of all major stakeholders, including both the business units and Information Technology (IT), is essential.

2010-07-09

2,224 reads

Blogs

Honored to be a Microsoft MVP Again

By

I was renewed this week as a Microsoft MVP. This is my 15th award...

Thank You Kevin!

By

I don’t think I’m going too far out on a limb to call Kevin...

Daily Coping 6 Jul 2022

By

I started to add a daily coping tip to the SQLServerCentral newsletter and to...

Read the latest Blogs

Forums

Establishing a Connection to PostgreSQL with GoLang

By sabyda

Comments posted to this topic are about the item Establishing a Connection to PostgreSQL...

SSIS - Name of Excel Sheet - How to Clear Dropdown List?

By AMCiti

I am trying to create an SSIS package inside Visual Studio 2019.  This package...

How to create a linked service to a VM where I will copy files from Blob storage

By dndaughtery

I have files in Blob Storage that I'd like to copy over to a...

Visit the forum

Ask SSC Logo Ask SSC

SQL Server Q&A from the SQLServerCentral community

Get answers