Azure DWH part 14: PolyBase to access to non structured data

  • Daniel Calbimonte

    SSCarpal Tunnel

    Points: 4702

    Comments posted to this topic are about the item Azure DWH part 14: PolyBase to access to non structured data

  • xsevensinzx

    One Orange Chip

    Points: 25531

    What happens if the structure of the CSV file changes? Does it break the External Table? What happens if two files with two different structures exist in the same directory location? 

    How does this article help me with unstructured data?

  • Daniel Calbimonte

    SSCarpal Tunnel

    Points: 4702

    You will have errors if the structure change. The same with files with different format.
    This article will help with non relational data. We will update the tittle.

  • INCREDIBLEmouse

    SSC Eights!

    Points: 814

    My world is so different, in that all of our data must stay on premise, that all these articles that spend 99% of the space explaining azure wastes so much of my time. :{   I may be alone in this, or maybe not?

  • Daniel Calbimonte

    SSCarpal Tunnel

    Points: 4702

    Last year there were 120K new Azure Subscribers per month, 1.4 million of Azure SQL Databases, 5 million organizations using Azure AD, 4 million developers register with Visual Studio.
    The Microsoft Share Revenue is growing because of Azure.

  • INCREDIBLEmouse

    SSC Eights!

    Points: 814

    calbimonte.daniel - Monday, August 21, 2017 8:25 AM

    Last year there were 120K new Azure Subscribers per month, 1.4 million of Azure SQL Databases, 5 million organizations using Azure AD, 4 million developers register with Visual Studio.
    The Microsoft Share Revenue is growing because of Azure.

    More impressive than I would have guessed. How many developers/analysts have a local or local network access to a SQL Server 2016+ instance, that could bypass Azure?

  • xsevensinzx

    One Orange Chip

    Points: 25531

    INCREDIBLEmouse - Monday, August 21, 2017 9:21 AM

    calbimonte.daniel - Monday, August 21, 2017 8:25 AM

    Last year there were 120K new Azure Subscribers per month, 1.4 million of Azure SQL Databases, 5 million organizations using Azure AD, 4 million developers register with Visual Studio.
    The Microsoft Share Revenue is growing because of Azure.

    More impressive than I would have guessed. How many developers/analysts have a local or local network access to a SQL Server 2016+ instance, that could bypass Azure?

    I don't in my example. But that's not why I am using Azure (assuming you're referring to needing Polybase). I particularly use Azure for Data Warehousing and Data Science products. Data Warehousing for an example, grants me access to a MPP system versus an SMP system to where I can have a columnstore that scales out across dozens of virtual machines versus scaling up on one virtual machine. This is why articles like this are great for people like me. It means we also have the ability to take advantage of Polybase and connect multiple data sources from multiple source systems to a structured data model through external tables.

    It's just another tool in the toolbox, not a replacement for an existing tool such as SQL Server 2016.

  • MarkHinderliter

    SSC Rookie

    Points: 40

    Could use more info around this:

    "CREATE EXTERNAL TABLE prices(   Id int,  product VARCHAR(64),  price int) WITH (   LOCATION = '/',   DATA_SOURCE = prices,   FILE_FORMAT = sqlservercentralformat)"This, "LOCATION = '/', ", doesn't work.  I tried looking it up to see what the location should be and it's pretty cryptic.  I suspect this is a path with the container name, blob name, and file name, but when I put in the name of my folder and the file name, LOCATION = '/polybasetutorial/prices.csv', it doesn't work.

Viewing 8 posts - 1 through 8 (of 8 total)

You must be logged in to reply to this topic. Login to reply