I recently encountered an interesting issue with ADF where the publish feature suddenly attempted to republish every single object, claiming they were new, despite having incrementally published changed objects...
2025-06-16 (first published: 2025-06-15)
11 reads
All Spark Connect Posts
Introduction There have been quite a few changes in the last couple of months and I just wanted to give a quick update on the current...
2024-11-16
14 reads
All Spark Connect Posts
I recently published the latest version of the Spark Connect Dotnet library which includes support for the new Variant data type in Apache Spark 4.0 here....
2024-10-12
15 reads
All Spark Connect Posts
Code
What to do? At some point we will want to do something with delta lake and so I wanted to explore the options. Before we do...
2024-02-17
3 reads
All Spark Connect Posts
Code
Goal of this post The goal of this post is to look at creating a SparkSession and a DataFrame that will wrap the Range relation and...
2024-02-10
34 reads
All Spark Connect Posts
Code
Goal of this post I wanted to explore what the Spark Connect API looked like from other languages, I am not a php developer - I...
2024-02-10
80 reads
All Spark Connect Posts
Code
Goal of this post So there are two goals of this post, the first is to take a look at Apache Arrow and how we can...
2024-02-05
71 reads
All Spark Connect Posts
Code
Goal of this post In this post we will continue looking at the gRPC API and the AnalyzePlan method which takes a plan and analyzes it....
2024-02-01
101 reads
All Spark Connect Posts
Code
Goal of this post In the first two posts, we looked at how to run some Spark code, firstly against a local Spark Connect server and...
2024-01-26
273 reads
All Spark Connect Posts
Goal of this post This post aims to show how we can create a .NET application, deploy it to Databricks, and then run a Databricks job...
2024-01-24 (first published: 2024-01-23)
69 reads
By Steve Jones
I had someone ask me about using triggers to detect changes in their tables....
By Kevin3NF
Things your cloud vendor may not tell you Here’s a common theme I...
By Rohit Garg
🎥 Columnstore Indexes in SQL Server – A Practical Guide with Real-World Examples 🔍...
I will have to test this next week, but will not have a chance...
I want to add a condition in the joining columns part of the merge...
Hi everyone SUM function has the option to select ROWS BETWEEN parameter to allow...
I have a table of products in SQL Server 2022. There are sequential items in the table with ProductIDs of 1, 2, 3, 4, 5, 6, 7, 8, 9, 10. If I run this code, how many rows are returned?
SELECT * FROM dbo.Products WHERE ProductID BETWEEN 4 AND 7;See possible answers