Spark Connect Dotnet November 2024 Where are we?
All Spark Connect Posts
Introduction There have been quite a few changes in the last couple of months and I just wanted to give a quick update on the current...
2024-11-16
11 reads
All Spark Connect Posts
Introduction There have been quite a few changes in the last couple of months and I just wanted to give a quick update on the current...
2024-11-16
11 reads
All Spark Connect Posts
I recently published the latest version of the Spark Connect Dotnet library which includes support for the new Variant data type in Apache Spark 4.0 here....
2024-10-12
11 reads
All Spark Connect Posts
Code
What to do? At some point we will want to do something with delta lake and so I wanted to explore the options. Before we do...
2024-02-17
3 reads
All Spark Connect Posts
Code
Goal of this post I wanted to explore what the Spark Connect API looked like from other languages, I am not a php developer - I...
2024-02-10
67 reads
All Spark Connect Posts
Code
Goal of this post The goal of this post is to look at creating a SparkSession and a DataFrame that will wrap the Range relation and...
2024-02-10
33 reads
All Spark Connect Posts
Code
Goal of this post So there are two goals of this post, the first is to take a look at Apache Arrow and how we can...
2024-02-05
71 reads
All Spark Connect Posts
Code
Goal of this post In this post we will continue looking at the gRPC API and the AnalyzePlan method which takes a plan and analyzes it....
2024-02-01
101 reads
Introductory Ramble Spark Connect In July 2022, at the Data and AI summit, Apache Spark announced “Spark Connect,” which was a way of connecting to Apache Spark using the...
2024-01-31 (first published: 2024-01-17)
353 reads
All Spark Connect Posts
Code
Goal of this post In the first two posts, we looked at how to run some Spark code, firstly against a local Spark Connect server and...
2024-01-26
261 reads
All Spark Connect Posts
Goal of this post This post aims to show how we can create a .NET application, deploy it to Databricks, and then run a Databricks job...
2024-01-24 (first published: 2024-01-23)
64 reads
By Zikato
I’ll walk through the KDA UI and tackle the first challenge before diving into...
By Zikato
While I mostly write about SQL Server, I have a soft spot for Kusto....
By Steve Jones
Many organizations list customer testimonials and quotes on their websites or literature. It makes...
Comments posted to this topic are about the item Life Moves Pretty Fast
Hello SSC, Happy Friday! I have to optimize a process that uses dynamic SQL...
Comments posted to this topic are about the item 50 Years of Microsoft
Can I have a collation expression like this in SQL Server 2022?
... WHERE ColumnA = ( 'abc' COLLATE French_CI_AS) COLLATE French_CS_AS ...See possible answers