Click here to monitor SSC
SQLServerCentral is supported by Redgate
 
Log in  ::  Register  ::  Not logged in
 
 
 


Build datawarehouse from scratch


Build datawarehouse from scratch

Author
Message
a2zwd
a2zwd
SSC-Enthusiastic
SSC-Enthusiastic (118 reputation)SSC-Enthusiastic (118 reputation)SSC-Enthusiastic (118 reputation)SSC-Enthusiastic (118 reputation)SSC-Enthusiastic (118 reputation)SSC-Enthusiastic (118 reputation)SSC-Enthusiastic (118 reputation)SSC-Enthusiastic (118 reputation)

Group: General Forum Members
Points: 118 Visits: 392
Hi friends,

I have couple of questions.

I have experience working in datawarehouse projects but I am not sure how do you build a datawarehouse from scratch.

What factors need to consider?
What tools are used? (in Sql server)
How to decide whether a dimension table or fact table?

Please reply.

thanks
Raj
Stewart "Arturius" Campbell
Stewart "Arturius" Campbell
SSCertifiable
SSCertifiable (5.8K reputation)SSCertifiable (5.8K reputation)SSCertifiable (5.8K reputation)SSCertifiable (5.8K reputation)SSCertifiable (5.8K reputation)SSCertifiable (5.8K reputation)SSCertifiable (5.8K reputation)SSCertifiable (5.8K reputation)

Group: General Forum Members
Points: 5812 Visits: 7140
First off, ask what each data mart must measure.
Once you have identified the relevant measures, identify all those dimensions that will be used in support of the opted facts (i.e. how would the data need to be sliced and diced)

In case of doubt, refer to Ralph Kimball's book, "The Data Warehouse Toolkit, 2nd Edition"

____________________________________________
Space, the final frontier? not any more...
All limits henceforth are self-imposed.
“libera tute vulgaris ex”
TheSQLGuru
TheSQLGuru
SSCertifiable
SSCertifiable (6K reputation)SSCertifiable (6K reputation)SSCertifiable (6K reputation)SSCertifiable (6K reputation)SSCertifiable (6K reputation)SSCertifiable (6K reputation)SSCertifiable (6K reputation)SSCertifiable (6K reputation)

Group: General Forum Members
Points: 6002 Visits: 8314
I too will recommend Kimball.

I will also add that I have been pulled into numerous DW projects as a consultant that were near or complete failures, in an effort to get them back on track or be successful. I have heard the same from others and from articles I have read in trade journals. Most companies that attempt data warehousing think they can just slap something together and it is a disaster. The best way to have a successful DW project is to engage with a consulting firm that has significant experience in doing it - there are SOOO many ways things can go south!! Note I say firm because data warehousing encompasses multiple disciplines and I don't believe there is a single person out there that can provide all the services you would need to make the project a success.

Best,

Kevin G. Boles
SQL Server Consultant
SQL MVP 2007-2012
TheSQLGuru at GMail
Stewart "Arturius" Campbell
Stewart "Arturius" Campbell
SSCertifiable
SSCertifiable (5.8K reputation)SSCertifiable (5.8K reputation)SSCertifiable (5.8K reputation)SSCertifiable (5.8K reputation)SSCertifiable (5.8K reputation)SSCertifiable (5.8K reputation)SSCertifiable (5.8K reputation)SSCertifiable (5.8K reputation)

Group: General Forum Members
Points: 5812 Visits: 7140
TheSQLGuru (9/20/2013)
I too will recommend Kimball.

I will also add that I have been pulled into numerous DW projects as a consultant that were near or complete failures, in an effort to get them back on track or be successful. I have heard the same from others and from articles I have read in trade journals. Most companies that attempt data warehousing think they can just slap something together and it is a disaster. The best way to have a successful DW project is to engage with a consulting firm that has significant experience in doing it - there are SOOO many ways things can go south!! Note I say firm because data warehousing encompasses multiple disciplines and I don't believe there is a single person out there that can provide all the services you would need to make the project a success.

that is the truth.
I am currently busy with one such company.
the previous person made it so extremely complex that it became totally useless to business and impossible to maintain by any bi team.
this has become a total rework case.

My company specialises in bi

____________________________________________
Space, the final frontier? not any more...
All limits henceforth are self-imposed.
“libera tute vulgaris ex”
a2zwd
a2zwd
SSC-Enthusiastic
SSC-Enthusiastic (118 reputation)SSC-Enthusiastic (118 reputation)SSC-Enthusiastic (118 reputation)SSC-Enthusiastic (118 reputation)SSC-Enthusiastic (118 reputation)SSC-Enthusiastic (118 reputation)SSC-Enthusiastic (118 reputation)SSC-Enthusiastic (118 reputation)

Group: General Forum Members
Points: 118 Visits: 392
Hi all,

Thanks you very much.
a2zwd
a2zwd
SSC-Enthusiastic
SSC-Enthusiastic (118 reputation)SSC-Enthusiastic (118 reputation)SSC-Enthusiastic (118 reputation)SSC-Enthusiastic (118 reputation)SSC-Enthusiastic (118 reputation)SSC-Enthusiastic (118 reputation)SSC-Enthusiastic (118 reputation)SSC-Enthusiastic (118 reputation)

Group: General Forum Members
Points: 118 Visits: 392
Hi All,

A quick question. I was told to develop data structures for the new datawarehouse. Which tools I can use?

What is the process?
TheSQLGuru
TheSQLGuru
SSCertifiable
SSCertifiable (6K reputation)SSCertifiable (6K reputation)SSCertifiable (6K reputation)SSCertifiable (6K reputation)SSCertifiable (6K reputation)SSCertifiable (6K reputation)SSCertifiable (6K reputation)SSCertifiable (6K reputation)

Group: General Forum Members
Points: 6002 Visits: 8314
A text editor is the minimum you need to create a new schema (CREATE TABLE abc ...). :-)

SSMS has a totally crappy ability to do this graphically (see the Database Diagram's functionality in BOL and the folder in SSMS).

Visio Professional can do database schemas.

My preferred tool BY FAR though is Embarcadero's ERStudio.

Best,

Kevin G. Boles
SQL Server Consultant
SQL MVP 2007-2012
TheSQLGuru at GMail
a2zwd
a2zwd
SSC-Enthusiastic
SSC-Enthusiastic (118 reputation)SSC-Enthusiastic (118 reputation)SSC-Enthusiastic (118 reputation)SSC-Enthusiastic (118 reputation)SSC-Enthusiastic (118 reputation)SSC-Enthusiastic (118 reputation)SSC-Enthusiastic (118 reputation)SSC-Enthusiastic (118 reputation)

Group: General Forum Members
Points: 118 Visits: 392
Hi Kevin,

Thanks for the reply.

What are technical analyst's roles and responsibilities.

Thanks
Tulla_123
Tulla_123
Forum Newbie
Forum Newbie (3 reputation)Forum Newbie (3 reputation)Forum Newbie (3 reputation)Forum Newbie (3 reputation)Forum Newbie (3 reputation)Forum Newbie (3 reputation)Forum Newbie (3 reputation)Forum Newbie (3 reputation)

Group: General Forum Members
Points: 3 Visits: 20
I am in the process of introducing a BI platform where I am currently based. I do not believe a datawarehouse is simply all to consider these days.
You need to consider the overall process, from data sources, ETL, data access, data visualisation, data architecture, data modelling/warehouse.

Look at 2012 and the BI edition. Lots of tools available to assist you in creating an enterprise solution. Pay attention to SSIS, SSAS, SSRS, and PowerView.
You might need some additional third party tool on top of that to access the data and to collect data for analysis.

Single individual components with an agile development methodology should make it efficient and adaptable.
lshanahan
lshanahan
SSC Veteran
SSC Veteran (284 reputation)SSC Veteran (284 reputation)SSC Veteran (284 reputation)SSC Veteran (284 reputation)SSC Veteran (284 reputation)SSC Veteran (284 reputation)SSC Veteran (284 reputation)SSC Veteran (284 reputation)

Group: General Forum Members
Points: 284 Visits: 436
Stewart "Arturius" Campbell (9/20/2013)
In case of doubt, refer to Ralph Kimball's book, "The Data Warehouse Toolkit, 2nd Edition"


Just FYI - Kimball is up to third edition now. I haven't read it (yet), but from the reviews, it appears they've re-worked some of the material a bit and added more real-world examples.

____________
Just my $0.02 from over here in the cheap seats of the peanut gallery - please adjust for inflation and/or your local currency.
Go


Permissions

You can't post new topics.
You can't post topic replies.
You can't post new polls.
You can't post replies to polls.
You can't edit your own topics.
You can't delete your own topics.
You can't edit other topics.
You can't delete other topics.
You can't edit your own posts.
You can't edit other posts.
You can't delete your own posts.
You can't delete other posts.
You can't post events.
You can't edit your own events.
You can't edit other events.
You can't delete your own events.
You can't delete other events.
You can't send private messages.
You can't send emails.
You can read topics.
You can't vote in polls.
You can't upload attachments.
You can download attachments.
You can't post HTML code.
You can't edit HTML code.
You can't post IFCode.
You can't post JavaScript.
You can post emoticons.
You can't post or upload images.

Select a forum

































































































































































SQLServerCentral


Search