Click here to monitor SSC
SQLServerCentral is supported by Red Gate Software Ltd.
 
Log in  ::  Register  ::  Not logged in
 
 
 
        
Home       Members    Calendar    Who's On


Add to briefcase

More Problems with Data Warehousing Expand / Collapse
Author
Message
Posted Monday, March 12, 2007 10:38 AM
SSC Veteran

SSC VeteranSSC VeteranSSC VeteranSSC VeteranSSC VeteranSSC VeteranSSC VeteranSSC Veteran

Group: General Forum Members
Last Login: Thursday, April 17, 2014 3:29 AM
Points: 229, Visits: 421
Comments posted here are about the content posted at http://www.sqlservercentral.com/columnists/rgardner/2913.asp
Post #350796
Posted Tuesday, March 20, 2007 7:00 AM
SSC Eights!

SSC Eights!SSC Eights!SSC Eights!SSC Eights!SSC Eights!SSC Eights!SSC Eights!SSC Eights!

Group: General Forum Members
Last Login: Today @ 7:02 AM
Points: 817, Visits: 2,048

I disagree that you can't reach 100% accuracy of the known data.  If the bottom line of the data warehouse doesn't match the inputing systems, then the data warehouse creator needs to be able to explain why.  Every possible permutation can't be checked, but a good sampling can be, and should be. 

We had a consultant who built us a warehouse and said that the data shouldn't be expected to match completely.  After some investigation, however, it was discovered that he had violated the "level of granularity" rule which is crucial.  In this case the data didn't match because of a flaw in the data warehouse.

Data warehouse designers should consider stored procedure groups to self-document the steps.  They can only be created and edited in the analyzer (at least in 2K and earlier) but hopefully if someone is building a dw using the analyzer is not a big issue.




Post #352634
Posted Tuesday, March 20, 2007 12:04 PM
Grasshopper

GrasshopperGrasshopperGrasshopperGrasshopperGrasshopperGrasshopperGrasshopperGrasshopper

Group: General Forum Members
Last Login: Thursday, January 8, 2009 7:22 PM
Points: 14, Visits: 115

This article hit the nail on its head.  Data quality was the number one problem when we were building our data warehouse.  I agree that your data warehouse can reach 100% accuracy of the known data (assume you meant user entries).  But if the known data is not accurate, your reports are still off.

 

Post #352761
Posted Tuesday, March 20, 2007 2:55 PM
SSCrazy

SSCrazySSCrazySSCrazySSCrazySSCrazySSCrazySSCrazySSCrazy

Group: General Forum Members
Last Login: Thursday, September 11, 2014 10:39 AM
Points: 2,803, Visits: 3,068

I did wrote an article about data quality before I wrote the article Problems with data warehouse.  But you are right, data quality is number one problem in building data warehouse.  Nice Article.

http://www.sqlservercentral.com/columnists/jchan/2593.asp

Janet

 

Post #352814
« Prev Topic | Next Topic »

Add to briefcase

Permissions Expand / Collapse