Yesterday was the Microsoft Data Amp event where a bunch of very exciting announcements were made:
- SQL Server vNext CTP 2.0 is now available and the product will be officially called SQL Server 2017:
- Runs on Linux and Docker
- Support for Graph queries. More info
- Support for R and now…
There are a number of options for using Azure for free. This is very useful for those of you who are not familiar with Azure and want to “play” with it:
- Create a free Azure account and get $200 in free credit: https://azure.microsoft.com/en-us/free/
- Eligible startups can join BizSpark and get…
The new buzzword in the industry is “Artificial Intelligence” (AI). But exactly what is AI and how does it compare to “machine learning” and “deep learning”? The best definitions I have seen come from the excellent article “Why Deep Learning is Suddenly Changing Your Life”:
So, AI is really… Read more
There are various Microsoft tools that you can use to help you migrate your database:
Data Migration Assistant (DMA) – enables you to upgrade to a modern data platform by detecting compatibility issues that can impact database functionality on your new version of SQL Server and Azure SQL Database. It… Read more
Azure Data Lake Analytics (ADLA) is a distributed analytics service built on Apache YARN that allows developers to be productive immediately on big data. This is accomplished by submitting a job to the service where the service will automatically run it in parallel in the cloud and scale to process… Read more
I previously talked about PolyBase and its enhancements (see PASS Summit Announcements: PolyBase enhancements). There is some confusion on PolyBase use cases as they are different depending on whether you are using PolyBase with Azure SQL Data Warehouse (SQL DW) or SQL Server 2016, as well as the sources… Read more
Azure SQL Database (SQL DB) has increased its max database size from 1TB to 4TB at no additional cost.
Customers using P11 and P15 premium performance levels can use up to 4 TB of included storage at no additional charge. This 4 TB option is currently in public preview in… Read more
Below I have attempted to list the various options for reporting off of Hadoop (HDInsight, HDP, Cloudera) using Power BI Desktop and Excel. Some of the data sources prompt you to choose the Data Connectivity mode of either Import or DirectQuery. For those that don’t you are limited to Import… Read more
I see a lot of confusion when it comes to Azure Data Factory (ADF) and how it compares to SSIS. It is not simply “SSIS in the cloud”. See What is Azure Data Factory? for an overview of ADF, and I’ll assume you know SSIS. So how are they… Read more
There can sometimes be confusion, in IoT scenarios, between IoT Hub and Event Hub, as they can both be valid choices for streaming data ingestion. My Microsoft colleague, Steve Busby, an IoT Technology Specialist, is here to clear up the confusion:
The majority of the time, if the data… Read more
Microsoft’s end goal is for Azure to become the best cloud platform for customers to run their data workloads. This means Microsoft will provide customers the best environment to run their big data/Hadoop as well as a place where Microsoft can offer services with our unique point-of-view. Specific decision points… Read more
In a perfect world a data warehouse would always return all queries very quickly, no matter what the size or complexity of the data warehouse. But the reality is that sometimes we won’t get the performance we need from the data warehouse, and the solution is to use a SQL… Read more
Microsoft has created data gateways as a way that cloud products such as Power BI and Azure Machine Learning can access on-prem data, often called a hybrid model. This is most useful for companies that do not want to put their data in the cloud, or there is simply too… Read more
I have been seeing the term “HTAP” mentioned a lot recently, and I thought I would briefly explain the term. HTAP stands for Hybrid Transactional and Analytical Processing.
For a long time clients would ask me how to determine the cost savings by migrating their applications and databases to Azure. I never had a good answer until now: The Total Cost of Ownership (TCO) Calculator. Now in preview, just provide a brief description of your on-premises environment… Read more
Azure Advisor is a really cool personalized recommendation engine that provides you with proactive best practices guidance on High Availability, Security, Performance and Cost when using Azure. It is in public preview. Learn more about Azure Advisor here.
Azure Advisor analyzes your resource configuration and usage telemetry to detect… Read more
Microsoft has a new release for the Analytics Platform System (APS). This appliance update is called APS 2016 and has been released to manufacturing and is now generally available. APS is Microsoft’s scale-out Massively Parallel Processing fully integrated system for data warehouse specific workloads.
This release is built on the… Read more
Microsoft usually has some interesting announcements at the PASS Summit, and this year was no exception. I’m writing a set of blogs covering the major announcements. Next up is the PolyBase enhancements.
PolyBase is a technology that accesses and combines both non-relational and relational data, all from within SQL… Read more
Microsoft Connect(); is a developer event from Nov 16-18, where plenty of announcements are made. Here is a summary of the data platform related announcements:
- Azure Data Lake Analytics is generally available in two datacenters in US (EMEA coming in Feb). Azure Data Lake Analytics is a cloud analytics service…
Microsoft usually has some interesting announcements at the PASS Summit, and this year was no exception. I’m writing a set of blogs covering the major announcements. Next up is the Microsoft Professional Program for Big Data.