Spark Connect Dotnet First Major Milestone
All Spark Connect Posts
When I wrote the spark-connect-dotnet lib I didn’t envisage that I would implement every function, instead it would be a combination of implementing the most common...
2024-01-17
Ed Elliott's Sql Developer Blog
Spark Connect
Spark Connect References https://spark.apache.org/docs/latest/spark-connect-overview.html
https://www.databricks.com/blog/2022/07/07/introducing-spark-connect-the-power-of-apache-spark-everywhere.html
Reference Implementations Rust
GOLang
Source gRPC proto files https://github.com/apache/spark/tree/master/connector/connect/common/src/main/protobuf/spark/connect
Useful Videos If this doesn’t get you excited then nothing will it is, of course, suitable for work, it is...
2024-01-01
16 reads
ADF: Error trying to debug pipeline: BadRequest
I made a mistake recently when I was creating an ADF pipeline, annoyingly I made loads of changes and then clicked the debug button, when I pressed debug the...
2021-03-17 (first published: 2021-03-12)
826 reads
ADF: Error trying to debug pipeline: BadRequest
I made a mistake recently when I was creating an ADF pipeline, annoyingly I made loads of changes and then clicked the debug button, when I pressed debug the...
2021-03-12
9 reads
ADF: Querying JSON documents
In my previous blog post I talked about how to read from an XML Webervice and use xpath to query the XML on the expressions side of things. You...
2021-03-04 (first published: 2021-02-26)
435 reads
ADF: Querying JSON documents
In my previous blog post I talked about how to read from an XML Webervice and use xpath to query the XML on the expressions side of things. You...
2021-02-26
14 reads
ADF, XML objects and XPath in the expression language
When you use ADF, there are two sides to the coin. The first is the data itself that ADF does very well, from moving it from one site to...
2021-02-18 (first published: 2021-02-12)
425 reads
ADF, XML objects and XPath in the expression language
When you use ADF, there are two sides to the coin. The first is the data itself that ADF does very well, from moving it from one site to...
2021-02-12
14 reads
Synapse Analytics and .NET for Apache Spark Example 4 - JOINS
This is a bit of a longer one, a look at how to do all the different joins and the exciting thing for MSSQL developers is that we get...
2021-02-05 (first published: 2021-01-25)
147 reads
Synapse Analytics and .NET for Apache Spark Example 4 - JOINS
This is a bit of a longer one, a look at how to do all the different joins and the exciting thing for MSSQL developers is that we get...
2021-01-25
3 reads
Blogs
A New Word: Immerensis
By Steve Jones
immerensis – n. the maddening inability to understand the reasons why someone loves you...
Deploy a Dockerized Python TODO App to Azure Container Apps Using Pulumi and Azure Key Vault
In this post, I will guide you on how to deploy a dockerized simple...
Using a Local Large Language Model (LLM): Running Ollama on Your Laptop
You can now run powerful LLMs like Llama 3.1 directly on your laptop using...
Forums
SQL Server is terminating in response to a 'stop' request from Service error
Dear All, In one of the server its repeatedly restarting sqlserver services and not...
Understanding CROSS APPLY and OUTER APPLY in SQL Server
Comments posted to this topic are about the item Understanding CROSS APPLY and OUTER...
Database Files on Shares I
Comments posted to this topic are about the item Database Files on Shares I
Question of the Day
Database Files on Shares I
I want to store database files on a file share for a SQL Server 2017 instance. Can I use \\fileserver\D$ as a location?
See possible answers