Azure DWH part 14: PolyBase to access to Non relational data

Question

Azure DWH part 14: PolyBase to access to Non relational data

Daniel Calbimonte

SSCertifiable

Points: 6200
More actions
August 20, 2017 at 10:04 pm

#328040

Comments posted to this topic are about the item Azure DWH part 14: PolyBase to access to Non relational data

Viewing 8 posts - 1 through 7 (of 7 total)

You must be logged in to reply to this topic. Login to reply

xsevensinzx One Orange Chip Points: 25560 More actions · Answer 1

What happens if the structure of the CSV file changes? Does it break the External Table? What happens if two files with two different structures exist in the same directory location?

How does this article help me with unstructured data?

Daniel Calbimonte SSCertifiable Points: 6200 More actions · Answer 2

You will have errors if the structure change. The same with files with different format.
This article will help with non relational data. We will update the tittle.

INCREDIBLEmouse SSC Eights! Points: 835 More actions · Answer 3

My world is so different, in that all of our data must stay on premise, that all these articles that spend 99% of the space explaining azure wastes so much of my time. :{ I may be alone in this, or maybe not?

Daniel Calbimonte SSCertifiable Points: 6200 More actions · Answer 4

Last year there were 120K new Azure Subscribers per month, 1.4 million of Azure SQL Databases, 5 million organizations using Azure AD, 4 million developers register with Visual Studio.
The Microsoft Share Revenue is growing because of Azure.

INCREDIBLEmouse SSC Eights! Points: 835 More actions · Answer 5

calbimonte.daniel - Monday, August 21, 2017 8:25 AM
Last year there were 120K new Azure Subscribers per month, 1.4 million of Azure SQL Databases, 5 million organizations using Azure AD, 4 million developers register with Visual Studio.
The Microsoft Share Revenue is growing because of Azure.

More impressive than I would have guessed. How many developers/analysts have a local or local network access to a SQL Server 2016+ instance, that could bypass Azure?

xsevensinzx One Orange Chip Points: 25560 More actions · Answer 6

INCREDIBLEmouse - Monday, August 21, 2017 9:21 AM
calbimonte.daniel - Monday, August 21, 2017 8:25 AM
Last year there were 120K new Azure Subscribers per month, 1.4 million of Azure SQL Databases, 5 million organizations using Azure AD, 4 million developers register with Visual Studio.
The Microsoft Share Revenue is growing because of Azure.
More impressive than I would have guessed. How many developers/analysts have a local or local network access to a SQL Server 2016+ instance, that could bypass Azure?

I don't in my example. But that's not why I am using Azure (assuming you're referring to needing Polybase). I particularly use Azure for Data Warehousing and Data Science products. Data Warehousing for an example, grants me access to a MPP system versus an SMP system to where I can have a columnstore that scales out across dozens of virtual machines versus scaling up on one virtual machine. This is why articles like this are great for people like me. It means we also have the ability to take advantage of Polybase and connect multiple data sources from multiple source systems to a structured data model through external tables.

It's just another tool in the toolbox, not a replacement for an existing tool such as SQL Server 2016.

MarkHinderliter SSC Rookie Points: 40 More actions · Answer 7

Could use more info around this:

"CREATE EXTERNAL TABLE prices( Id int, product VARCHAR(64), price int) WITH ( LOCATION = '/', DATA_SOURCE = prices, FILE_FORMAT = sqlservercentralformat)"This, "LOCATION = '/', ", doesn't work. I tried looking it up to see what the location should be and it's pretty cryptic. I suspect this is a path with the container name, blob name, and file name, but when I put in the name of my folder and the file name, LOCATION = '/polybasetutorial/prices.csv', it doesn't work.