The core functionality of Apache Spark has support for structured streaming using either a batch or a continuous method. The two most popular sources of input data are data lake files and Kafka events. Check point files in the data lake are used to keep track of what data has been processed to date.
2025-03-14
How can we get familiar with Azure Databricks with Spark Dataframes?
2025-02-26
Learn how to get started with a few sample prompt templates by using the gpt-4 LLM within OpenAI and LangChain in a Databricks notebook.
2024-02-09
Learn about the different tables that can be created using Azure Databricks with a dive deep into the importance of Delta Lake tables.
2023-10-20
The goal of this article is to illuminate exactly what Azure Databricks is so that you can determine what parts of the platform might make sense to add to your organization's data stack.
2021-03-15
Getting "Failed to load data model" for an Azure Databricks DirectQuery connection in Power BI? Adam hit it too and walks through how to fix it in Power BI...
2019-04-16
By Steve Jones
SQL Saturday Austin 2025 is in just a few days. I am honored to...
By Steve Jones
I’ve been using the SSMS preview for v21. This is the next evolution of...
In the blog post Call a Fabric REST API from Azure Data Factory I...
I have a query that is performing poorly It has a left join to...
Comments posted to this topic are about the item The Long Running Backup
Comments posted to this topic are about the item Interview Tips
I have a long running backup of the Sales database during a maintenance window that is going to take another 2 hours to complete on SQL Server 2022. I also need to perform some proactive work and add another file (ndf) to the Sales database to handle the expected growth of the next month. Can I do both simultaneously?
See possible answers