Click here to monitor SSC
SQLServerCentral is supported by Red Gate Software Ltd.
 
Log in  ::  Register  ::  Not logged in
 
 
 
        
Home       Members    Calendar    Who's On


Add to briefcase

Build datawarehouse from scratch Expand / Collapse
Author
Message
Posted Friday, September 20, 2013 6:47 AM
SSC-Enthusiastic

SSC-EnthusiasticSSC-EnthusiasticSSC-EnthusiasticSSC-EnthusiasticSSC-EnthusiasticSSC-EnthusiasticSSC-EnthusiasticSSC-Enthusiastic

Group: General Forum Members
Last Login: Thursday, September 25, 2014 9:44 AM
Points: 114, Visits: 353
Hi friends,

I have couple of questions.

I have experience working in datawarehouse projects but I am not sure how do you build a datawarehouse from scratch.

What factors need to consider?
What tools are used? (in Sql server)
How to decide whether a dimension table or fact table?

Please reply.

thanks
Raj
Post #1496856
Posted Friday, September 20, 2013 8:02 AM


Hall of Fame

Hall of FameHall of FameHall of FameHall of FameHall of FameHall of FameHall of FameHall of FameHall of Fame

Group: General Forum Members
Last Login: Today @ 1:05 PM
Points: 3,984, Visits: 5,237
First off, ask what each data mart must measure.
Once you have identified the relevant measures, identify all those dimensions that will be used in support of the opted facts (i.e. how would the data need to be sliced and diced)

In case of doubt, refer to Ralph Kimball's book, "The Data Warehouse Toolkit, 2nd Edition"


____________________________________________
Space, the final frontier? not any more...
All limits henceforth are self-imposed.
“libera tute vulgaris ex”
Post #1496903
Posted Friday, September 20, 2013 9:38 AM


SSCarpal Tunnel

SSCarpal TunnelSSCarpal TunnelSSCarpal TunnelSSCarpal TunnelSSCarpal TunnelSSCarpal TunnelSSCarpal TunnelSSCarpal TunnelSSCarpal Tunnel

Group: General Forum Members
Last Login: Today @ 1:11 PM
Points: 4,368, Visits: 6,208
I too will recommend Kimball.

I will also add that I have been pulled into numerous DW projects as a consultant that were near or complete failures, in an effort to get them back on track or be successful. I have heard the same from others and from articles I have read in trade journals. Most companies that attempt data warehousing think they can just slap something together and it is a disaster. The best way to have a successful DW project is to engage with a consulting firm that has significant experience in doing it - there are SOOO many ways things can go south!! Note I say firm because data warehousing encompasses multiple disciplines and I don't believe there is a single person out there that can provide all the services you would need to make the project a success.


Best,

Kevin G. Boles
SQL Server Consultant
SQL MVP 2007-2012
TheSQLGuru at GMail
Post #1496938
Posted Friday, September 20, 2013 10:00 AM


Hall of Fame

Hall of FameHall of FameHall of FameHall of FameHall of FameHall of FameHall of FameHall of FameHall of Fame

Group: General Forum Members
Last Login: Today @ 1:05 PM
Points: 3,984, Visits: 5,237
TheSQLGuru (9/20/2013)
I too will recommend Kimball.

I will also add that I have been pulled into numerous DW projects as a consultant that were near or complete failures, in an effort to get them back on track or be successful. I have heard the same from others and from articles I have read in trade journals. Most companies that attempt data warehousing think they can just slap something together and it is a disaster. The best way to have a successful DW project is to engage with a consulting firm that has significant experience in doing it - there are SOOO many ways things can go south!! Note I say firm because data warehousing encompasses multiple disciplines and I don't believe there is a single person out there that can provide all the services you would need to make the project a success.

that is the truth.
I am currently busy with one such company.
the previous person made it so extremely complex that it became totally useless to business and impossible to maintain by any bi team.
this has become a total rework case.

My company specialises in bi


____________________________________________
Space, the final frontier? not any more...
All limits henceforth are self-imposed.
“libera tute vulgaris ex”
Post #1496947
Posted Monday, September 23, 2013 1:24 AM
SSC-Enthusiastic

SSC-EnthusiasticSSC-EnthusiasticSSC-EnthusiasticSSC-EnthusiasticSSC-EnthusiasticSSC-EnthusiasticSSC-EnthusiasticSSC-Enthusiastic

Group: General Forum Members
Last Login: Thursday, September 25, 2014 9:44 AM
Points: 114, Visits: 353
Hi all,

Thanks you very much.

Post #1497283
Posted Monday, September 23, 2013 2:29 AM
SSC-Enthusiastic

SSC-EnthusiasticSSC-EnthusiasticSSC-EnthusiasticSSC-EnthusiasticSSC-EnthusiasticSSC-EnthusiasticSSC-EnthusiasticSSC-Enthusiastic

Group: General Forum Members
Last Login: Thursday, September 25, 2014 9:44 AM
Points: 114, Visits: 353
Hi All,

A quick question. I was told to develop data structures for the new datawarehouse. Which tools I can use?

What is the process?

Post #1497290
Posted Monday, September 23, 2013 10:08 AM


SSCarpal Tunnel

SSCarpal TunnelSSCarpal TunnelSSCarpal TunnelSSCarpal TunnelSSCarpal TunnelSSCarpal TunnelSSCarpal TunnelSSCarpal TunnelSSCarpal Tunnel

Group: General Forum Members
Last Login: Today @ 1:11 PM
Points: 4,368, Visits: 6,208
A text editor is the minimum you need to create a new schema (CREATE TABLE abc ...).

SSMS has a totally crappy ability to do this graphically (see the Database Diagram's functionality in BOL and the folder in SSMS).

Visio Professional can do database schemas.

My preferred tool BY FAR though is Embarcadero's ERStudio.


Best,

Kevin G. Boles
SQL Server Consultant
SQL MVP 2007-2012
TheSQLGuru at GMail
Post #1497457
Posted Wednesday, September 25, 2013 4:19 AM
SSC-Enthusiastic

SSC-EnthusiasticSSC-EnthusiasticSSC-EnthusiasticSSC-EnthusiasticSSC-EnthusiasticSSC-EnthusiasticSSC-EnthusiasticSSC-Enthusiastic

Group: General Forum Members
Last Login: Thursday, September 25, 2014 9:44 AM
Points: 114, Visits: 353
Hi Kevin,

Thanks for the reply.

What are technical analyst's roles and responsibilities.

Thanks
Post #1498230
Posted Thursday, September 26, 2013 8:31 AM
Forum Newbie

Forum NewbieForum NewbieForum NewbieForum NewbieForum NewbieForum NewbieForum NewbieForum Newbie

Group: General Forum Members
Last Login: Tuesday, May 20, 2014 3:34 AM
Points: 3, Visits: 20
I am in the process of introducing a BI platform where I am currently based. I do not believe a datawarehouse is simply all to consider these days.
You need to consider the overall process, from data sources, ETL, data access, data visualisation, data architecture, data modelling/warehouse.

Look at 2012 and the BI edition. Lots of tools available to assist you in creating an enterprise solution. Pay attention to SSIS, SSAS, SSRS, and PowerView.
You might need some additional third party tool on top of that to access the data and to collect data for analysis.

Single individual components with an agile development methodology should make it efficient and adaptable.
Post #1498885
Posted Friday, September 27, 2013 5:52 AM
SSC-Enthusiastic

SSC-EnthusiasticSSC-EnthusiasticSSC-EnthusiasticSSC-EnthusiasticSSC-EnthusiasticSSC-EnthusiasticSSC-EnthusiasticSSC-Enthusiastic

Group: General Forum Members
Last Login: Thursday, September 25, 2014 5:42 AM
Points: 136, Visits: 252
Stewart "Arturius" Campbell (9/20/2013)
In case of doubt, refer to Ralph Kimball's book, "The Data Warehouse Toolkit, 2nd Edition"


Just FYI - Kimball is up to third edition now. I haven't read it (yet), but from the reviews, it appears they've re-worked some of the material a bit and added more real-world examples.


____________
Just my $0.02 from over here in the cheap seats of the peanut gallery - please adjust for inflation and/or your local currency.
Post #1499329
« Prev Topic | Next Topic »

Add to briefcase

Permissions Expand / Collapse