SQL Clone
SQLServerCentral is supported by Redgate
 
Log in  ::  Register  ::  Not logged in
 
 
 


The Ever Expanding Data Platform


The Ever Expanding Data Platform

Author
Message
Steve Jones
Steve Jones
SSC Guru
SSC Guru (602K reputation)SSC Guru (602K reputation)SSC Guru (602K reputation)SSC Guru (602K reputation)SSC Guru (602K reputation)SSC Guru (602K reputation)SSC Guru (602K reputation)SSC Guru (602K reputation)

Group: Administrators
Points: 602376 Visits: 21101
Comments posted to this topic are about the item The Ever Expanding Data Platform

Follow me on Twitter: @way0utwest
Forum Etiquette: How to post data/code on a forum to get the best help
My Blog: www.voiceofthedba.com
netmikem
netmikem
Hall of Fame
Hall of Fame (3.3K reputation)Hall of Fame (3.3K reputation)Hall of Fame (3.3K reputation)Hall of Fame (3.3K reputation)Hall of Fame (3.3K reputation)Hall of Fame (3.3K reputation)Hall of Fame (3.3K reputation)Hall of Fame (3.3K reputation)

Group: General Forum Members
Points: 3313 Visits: 384
Really enjoyed this editorial Steve so thanks for that.
I've only dabbled in Azure thus far but I think it's high time that I dive into it, starting with Azure Data Studio.
The breadth of the platform is certainly much more than what it used to be!
P.S. Good luck to your Rockies in the post season.



xsevensinzx
xsevensinzx
SSC-Insane
SSC-Insane (21K reputation)SSC-Insane (21K reputation)SSC-Insane (21K reputation)SSC-Insane (21K reputation)SSC-Insane (21K reputation)SSC-Insane (21K reputation)SSC-Insane (21K reputation)SSC-Insane (21K reputation)

Group: General Forum Members
Points: 21186 Visits: 5792
I for sure am loving the Azure platform. I've obviously mentioned it many times over in other threads, but just to emphasize some more, I've fully migrated to Azure Data Lake Store, Azure Data Lake Analytics and completely replaced my existing on-prem SQL Server with Azure Data Warehouse. All of this is working together and it's been a good experience. Now, I'm starting to branch out from keeping everything in the data warehouse and moving subsets of data to Azure DB.

The biggest surprises for me as someone coming from just relying on SQL Server so much is how powerful the data lake store and analytics products are. Loading a TB of data and being able to run a U-SQL query on the raw CSV files that JOIN and aggregate the data without indexes, statistics or anything is insanely good.

The biggest troubles for me with this new set of tools in this new data platform is trying to navigate all the "gotchas" with working with new tech. For example, string splitters and even UPDATE JOIN's were difficult in Azure Data Warehouse, encoding issues were issues with the data lake store, not reading the data more than you need and anything that uses the .NET libraries as a non-dot net developer was difficult with analytics.

But all-in-all, pretty excited for all the new stuff with Azure that has been announced or planned.
Steve Jones
Steve Jones
SSC Guru
SSC Guru (602K reputation)SSC Guru (602K reputation)SSC Guru (602K reputation)SSC Guru (602K reputation)SSC Guru (602K reputation)SSC Guru (602K reputation)SSC Guru (602K reputation)SSC Guru (602K reputation)

Group: Administrators
Points: 602376 Visits: 21101
netmikem - Sunday, September 30, 2018 5:43 PM
Really enjoyed this editorial Steve so thanks for that.
I've only dabbled in Azure thus far but I think it's high time that I dive into it, starting with Azure Data Studio.
The breadth of the platform is certainly much more than what it used to be!
P.S. Good luck to your Rockies in the post season.


Thanks, fingers crossed they make a win tonight and take the first division title and then at least have a good series. On Sept 1, they had like a 13% chance of making the playoffs, so I'm excited.

I might also recommend this book as an overview. It's free from MS: https://azure.microsoft.com/en-us/campaigns/developer-guide/?v=18.31
It's an overview of lots of their services. Easy to read, and gives you a good look at choices. It's still mostly relevant after last week's Ignite announcements.

Azure Data Studio, worth trying. Can't decide what I think, but welcome to see more thoughts from others.

Follow me on Twitter: @way0utwest
Forum Etiquette: How to post data/code on a forum to get the best help
My Blog: www.voiceofthedba.com
Steve Jones
Steve Jones
SSC Guru
SSC Guru (602K reputation)SSC Guru (602K reputation)SSC Guru (602K reputation)SSC Guru (602K reputation)SSC Guru (602K reputation)SSC Guru (602K reputation)SSC Guru (602K reputation)SSC Guru (602K reputation)

Group: Administrators
Points: 602376 Visits: 21101
xsevensinzx - Sunday, September 30, 2018 8:02 PM
I for sure am loving the Azure platform. I've obviously mentioned it many times over in other threads, but just to emphasize some more, I've fully migrated to Azure Data Lake Store, Azure Data Lake Analytics and completely replaced my existing on-prem SQL Server with Azure Data Warehouse. All of this is working together and it's been a good experience. Now, I'm starting to branch out from keeping everything in the data warehouse and moving subsets of data to Azure DB.

The biggest surprises for me as someone coming from just relying on SQL Server so much is how powerful the data lake store and analytics products are. Loading a TB of data and being able to run a U-SQL query on the raw CSV files that JOIN and aggregate the data without indexes, statistics or anything is insanely good.

The biggest troubles for me with this new set of tools in this new data platform is trying to navigate all the "gotchas" with working with new tech. For example, string splitters and even UPDATE JOIN's were difficult in Azure Data Warehouse, encoding issues were issues with the data lake store, not reading the data more than you need and anything that uses the .NET libraries as a non-dot net developer was difficult with analytics.

But all-in-all, pretty excited for all the new stuff with Azure that has been announced or planned.


I'd love some articles Wink, I think there is some amazing stuff in there, and despite the potential performance issues with Polybase, I think this is great technologies in spots, and with some development to limit ad hoc querying that might result in a poor experience for the end user.

Follow me on Twitter: @way0utwest
Forum Etiquette: How to post data/code on a forum to get the best help
My Blog: www.voiceofthedba.com
Go


Permissions

You can't post new topics.
You can't post topic replies.
You can't post new polls.
You can't post replies to polls.
You can't edit your own topics.
You can't delete your own topics.
You can't edit other topics.
You can't delete other topics.
You can't edit your own posts.
You can't edit other posts.
You can't delete your own posts.
You can't delete other posts.
You can't post events.
You can't edit your own events.
You can't edit other events.
You can't delete your own events.
You can't delete other events.
You can't send private messages.
You can't send emails.
You can read topics.
You can't vote in polls.
You can't upload attachments.
You can download attachments.
You can't post HTML code.
You can't edit HTML code.
You can't post IFCode.
You can't post JavaScript.
You can post emoticons.
You can't post or upload images.

Select a forum








































































































































































SQLServerCentral


Search