Build datawarehouse from scratch

  • Hi friends,

    I have couple of questions.

    I have experience working in datawarehouse projects but I am not sure how do you build a datawarehouse from scratch.

    What factors need to consider?

    What tools are used? (in Sql server)

    How to decide whether a dimension table or fact table?

    Please reply.

    thanks

    Raj

  • This was removed by the editor as SPAM

  • I too will recommend Kimball.

    I will also add that I have been pulled into numerous DW projects as a consultant that were near or complete failures, in an effort to get them back on track or be successful. I have heard the same from others and from articles I have read in trade journals. Most companies that attempt data warehousing think they can just slap something together and it is a disaster. The best way to have a successful DW project is to engage with a consulting firm that has significant experience in doing it - there are SOOO many ways things can go south!! Note I say firm because data warehousing encompasses multiple disciplines and I don't believe there is a single person out there that can provide all the services you would need to make the project a success.

    Best,
    Kevin G. Boles
    SQL Server Consultant
    SQL MVP 2007-2012
    TheSQLGuru on googles mail service

  • This was removed by the editor as SPAM

  • Hi all,

    Thanks you very much.

  • Hi All,

    A quick question. I was told to develop data structures for the new datawarehouse. Which tools I can use?

    What is the process?

  • A text editor is the minimum you need to create a new schema (CREATE TABLE abc ...). 🙂

    SSMS has a totally crappy ability to do this graphically (see the Database Diagram's functionality in BOL and the folder in SSMS).

    Visio Professional can do database schemas.

    My preferred tool BY FAR though is Embarcadero's ERStudio.

    Best,
    Kevin G. Boles
    SQL Server Consultant
    SQL MVP 2007-2012
    TheSQLGuru on googles mail service

  • Hi Kevin,

    Thanks for the reply.

    What are technical analyst's roles and responsibilities.

    Thanks

  • I am in the process of introducing a BI platform where I am currently based. I do not believe a datawarehouse is simply all to consider these days.

    You need to consider the overall process, from data sources, ETL, data access, data visualisation, data architecture, data modelling/warehouse.

    Look at 2012 and the BI edition. Lots of tools available to assist you in creating an enterprise solution. Pay attention to SSIS, SSAS, SSRS, and PowerView.

    You might need some additional third party tool on top of that to access the data and to collect data for analysis.

    Single individual components with an agile development methodology should make it efficient and adaptable.

  • Stewart "Arturius" Campbell (9/20/2013)


    In case of doubt, refer to Ralph Kimball's book, "The Data Warehouse Toolkit, 2nd Edition"

    Just FYI - Kimball is up to third edition now. I haven't read it (yet), but from the reviews, it appears they've re-worked some of the material a bit and added more real-world examples.

    ____________
    Just my $0.02 from over here in the cheap seats of the peanut gallery - please adjust for inflation and/or your local currency.

Viewing 10 posts - 1 through 9 (of 9 total)

You must be logged in to reply to this topic. Login to reply