Data Warehousing

Technical Article

Scaling Up Your Data Warehouse with SQL Server 2008 R2

  • Article

SQL Server 2008 introduced many new functional and performance improvements for data warehousing, and SQL Server 2008 R2 includes all these and more. This paper discusses how to use SQL Server 2008 R2 to get great performance as your data warehouse scales up. We present lessons learned during extensive internal data warehouse testing on a 64-core HP Integrity Superdome during the development of the SQL Server 2008 release, and via production experience with large-scale SQL Server customers. Our testing indicates that many customers can expect their performance to nearly double on the same hardware they are currently using, merely by upgrading to SQL Server 2008 R2 from SQL Server 2005 or earlier, and compressing their fact tables. We cover techniques to improve manageability and performance at high-scale, encompassing data loading (extract, transform, load), query processing, partitioning, index maintenance, indexed view (aggregate) management, and backup and restore.

★ ★ ★ ★ ★ ★ ★ ★ ★ ★

(1)

You rated this post out of 5. Change rating

2011-05-19

5,175 reads

Technical Article

Understanding and Controlling Parallel Query Processing in SQL Server

  • Article

Data warehousing and general reporting applications tend to be CPU intensive because they need to read and process a large number of rows. To facilitate quick data processing for queries that touch a large amount of data, Microsoft SQL Server exploits the power of multiple logical processors to provide parallel query processing operations such as parallel scans. Through extensive testing, we have learned that, for most large queries that are executed in a parallel fashion, SQL Server can deliver linear or nearly linear response time speedup as the number of logical processors increases. However, some queries in high parallelism scenarios perform suboptimally. There are also some parallelism issues that can occur in a multi-user parallel query workload. This white paper describes parallel performance problems you might encounter when you run such queries and workloads, and it explains why these issues occur. In addition, it presents how data warehouse developers can detect these issues, and how they can work around them or mitigate them.

★ ★ ★ ★ ★ ★ ★ ★ ★ ★

(1)

You rated this post out of 5. Change rating

2010-12-10

4,645 reads

Technical Article

3 Fundamental Questions about Data Marts...and Their Answers

  • Article

A data mart provides the primary access to the data stored in the data warehouse or operational data store. It is a subset of data sourced from the data warehouse or operational data store specifically focused on a business function or set of related business functions. Read on to learn the answers to fundamental questions about data marts.

★ ★ ★ ★ ★ ★ ★ ★ ★ ★

You rated this post out of 5. Change rating

2010-12-03

5,164 reads

Technical Article

Building a Data Warehouse Blueprint for Success

  • Article

One of the most integral components and critical success factors of any enterprise data warehousing initiative is the Solutions Architecture document, a high-level conceptual model of a data warehousing solution. Learn why this collaborative effort that addresses the needs of all major stakeholders, including both the business units and Information Technology (IT), is essential.

★ ★ ★ ★ ★ ★ ★ ★ ★ ★

You rated this post out of 5. Change rating

2010-07-09

2,224 reads

Technical Article

Data Warehousing Architecture - Designing the Data Staging Area

  • Article

The staging area tends to be one of the more overlooked components of a data warehouse architecture, and yet it is an integral part of the ETL component design. Learn why it is best to design the staging layer right the first time, enabling support of various ETL processes and related methodology, recoverability and scalability.

★ ★ ★ ★ ★ ★ ★ ★ ★ ★

(2)

You rated this post out of 5. Change rating

2010-07-07

6,197 reads

Technical Article

How to Conduct Effective Data Warehouse and Business Intelligence Software Evaluations

  • Article

Denise Rogers discusses the essential tasks in conducting effective software evaluations revolving around data warehousing and business intellegence. Each step has a dependency on the previous one, starting with establishing the framework of the evaluation and adding progressively elaborate data that facilitates a decision making process that is resolute.

★ ★ ★ ★ ★ ★ ★ ★ ★ ★

You rated this post out of 5. Change rating

2010-06-11

4,369 reads

Blogs

Flyway Tips: More Object History

By

I wrote about Flyway Desktop Object History in a previous tip. This feature has...

Why Ai Agents need an eval framework

By

AgentDBA (the database agent I have been building) has more than 1000 automated tests,...

A New Word: Semaphorism

By

semaphorism – n. a conversational hint that you have something personal to say on...

Read the latest Blogs

Forums

Server-level Roles

By Steve Jones - SSC Editor

Comments posted to this topic are about the item Server-level Roles

Pay for Performance

By Steve Jones - SSC Editor

Comments posted to this topic are about the item Pay for Performance

Tracking Inserted, Updated, and Deleted Rows with SQL Server OUTPUT

By Imran2629

Comments posted to this topic are about the item Tracking Inserted, Updated, and Deleted...

Visit the forum

Question of the Day

Server-level Roles

In SQL Server 2025, can I alter a fixed server role?

See possible answers