Delta Lake over Spark Connect
All Spark Connect Posts
I have just finished an update for the spark connect dotnet lib that contains the DeltaTable implementation so that we can now use .NET to maintain...
2025-06-20
13 reads
All Spark Connect Posts
I have just finished an update for the spark connect dotnet lib that contains the DeltaTable implementation so that we can now use .NET to maintain...
2025-06-20
13 reads
I recently encountered an interesting issue with ADF where the publish feature suddenly attempted to republish every single object, claiming they were new, despite having incrementally published changed objects...
2025-07-02 (first published: 2025-06-15)
180 reads
All Spark Connect Posts
Introduction There have been quite a few changes in the last couple of months and I just wanted to give a quick update on the current...
2024-11-16
26 reads
All Spark Connect Posts
I recently published the latest version of the Spark Connect Dotnet library which includes support for the new Variant data type in Apache Spark 4.0 here....
2024-10-12
16 reads
All Spark Connect Posts
Code
What to do? At some point we will want to do something with delta lake and so I wanted to explore the options. Before we do...
2024-02-17
3 reads
All Spark Connect Posts
Code
Goal of this post The goal of this post is to look at creating a SparkSession and a DataFrame that will wrap the Range relation and...
2024-02-10
35 reads
All Spark Connect Posts
Code
Goal of this post I wanted to explore what the Spark Connect API looked like from other languages, I am not a php developer - I...
2024-02-10
89 reads
All Spark Connect Posts
Code
Goal of this post So there are two goals of this post, the first is to take a look at Apache Arrow and how we can...
2024-02-05
71 reads
All Spark Connect Posts
Code
Goal of this post In this post we will continue looking at the gRPC API and the AnalyzePlan method which takes a plan and analyzes it....
2024-02-01
105 reads
All Spark Connect Posts
Code
Goal of this post In the first two posts, we looked at how to run some Spark code, firstly against a local Spark Connect server and...
2024-01-26
286 reads
By John
Failing to plan is planning to fail. When organizations first begin implementing Azure networking,...
By Steve Jones
As I use containers more and more to run various things, I decided I...
By Kevin3NF
Old Reliable Still Matters If you’ve been around SQL Server for a while, you’ve...
I maintain an application written years ago, where the database is on a Windows...
I’m working on a jewelry e-commerce project and need advice on designing an efficient...
Comments posted to this topic are about the item The Duplicate Cursor
Can I run this code:
DECLARE ANewTable CURSOR FOR SELECT * FROM ANewTableSee possible answers