Designing Delta Tables with Liquid Clustering: Real-World Patterns for Data Engineers
Get a short introduction to Liquid Clustering in Databricks.
2026-03-09
2,724 reads
Databricks
Data Streaming Databricks in Azure
The core functionality of Apache Spark has support for structured streaming using either a batch or a continuous method. The two most popular sources of input data are data lake files and Kafka events. Check point files in the data lake are used to keep track of what data has been processed to date.
2025-03-14
Engineering a Lakehouse with Azure Databricks with Spark Dataframes
How can we get familiar with Azure Databricks with Spark Dataframes?
2025-02-26
LangChain Prompt Templates with OpenAI LLMs
Learn how to get started with a few sample prompt templates by using the gpt-4 LLM within OpenAI and LangChain in a Databricks notebook.
2024-02-09
Azure Databricks Tables - Delta Lake, Hive Metastore, TempViews, Managed, External
Learn about the different tables that can be created using Azure Databricks with a dive deep into the importance of Delta Lake tables.
2023-10-20
What is Azure Databricks?
The goal of this article is to illuminate exactly what Azure Databricks is so that you can determine what parts of the platform might make sense to add to your organization's data stack.
2021-03-15
Fixing a connection issue with Azure Databricks in Power BI
Getting "Failed to load data model" for an Azure Databricks DirectQuery connection in Power BI? Adam hit it too and walks through how to fix it in Power BI...
2019-04-16
Blogs
AI and Data Engineering on the Edge: The Good, the Bad, and the Overhyped
Running AI and data pipelines on the edge instead of the cloud has gone...
UNION vs UNIONALL: #SQLNewBlogger
By Steve Jones
While writing another post I realized my UNION query didn’t work as one might...
Deciphering Data Architectures Is Now Available in Multiple Languages
By James Serra
Since the release of my book Deciphering Data Architectures: Choosing Between a Modern Data...
Forums
Secure Cached Plans
Comments posted to this topic are about the item Secure Cached Plans
Complex Data Processing with dbt Python Models: The Fabric Modern Data Platform
Comments posted to this topic are about the item Complex Data Processing with dbt...
Over or Under Provisioned
Comments posted to this topic are about the item Over or Under Provisioned
Question of the Day
Secure Cached Plans
The DMV, sys.dm_exec_cached_plans, contains rows for each cached plan on an instance. In Azure SQL Database, not every used has rights to every database, as there does exist an instance behind each database. How is security handled for this DMV in Azure?
See possible answers