SQL Data Warehousing

  • Hi,
    What are the minimum components to bring a small on prem data warehouse to the Azure Cloud?

    Get CSV Data from FTP
    Data Cleansing
    Data Storage
    Data Modeling
    Data Analysis
    Data Visualization

    Only Structured Data, No Big Data, no Stream Data, only PaaS, start small with option to scale out
    Thanks
    Nicole 😉

  • info 58414 - Wednesday, July 11, 2018 7:52 AM

    Hi,
    What are the minimum components to bring a small on prem data warehouse to the Azure Cloud?

    Get CSV Data from FTP
    Data Cleansing
    Data Storage
    Data Modeling
    Data Analysis
    Data Visualization

    Only Structured Data, No Big Data, no Stream Data, only PaaS, start small with option to scale out
    Thanks
    Nicole 😉

    Really confusing question. The data warehouse for the most part is developed to become a central repositories of integrated data from one or more disparate sources. Note the centralized repository and integrated data portions of that definition. These are often solutions to use cases from the business such as needing a solution where the business can analyze and report on data. Therefore, the core components of needing a data warehouse rests fully on the use case.

    When it comes to what you need to make the centralized repository, integrated data, analyzation, and visualization work. That depends on you and the business. I wouldn't say there are not any minimal or maximum components you need to data warehouse or consider something a data warehouse. For example, if you have mostly unstructured data, that does not mean you can't build a data warehouse. The same applies with saying you must have only structured data. No, data warehousing often takes chaos (unstructured data) and structures it. 

    Sure, certain technologies can handle different types of data better than others. Unstructured may mean that it's consistent, but not in the structure you want. SQL Server may handle that well. In other cases, the data is not consistent (always changing) and in a difficult format. There are technologies that can handle that and help you get the final result into a data warehouse that is based on SQL Server.

    With something like Azure Data Warehouse you only need data, a means to get data into it, and $$$.

Viewing 2 posts - 1 through 1 (of 1 total)

You must be logged in to reply to this topic. Login to reply