Spark Connect Dotnet First Major Milestone
All Spark Connect Posts
When I wrote the spark-connect-dotnet lib I didn’t envisage that I would implement every function, instead it would be a combination of implementing the most common...
2024-01-17
All Spark Connect Posts
When I wrote the spark-connect-dotnet lib I didn’t envisage that I would implement every function, instead it would be a combination of implementing the most common...
2024-01-17
Spark Connect References https://spark.apache.org/docs/latest/spark-connect-overview.html
https://www.databricks.com/blog/2022/07/07/introducing-spark-connect-the-power-of-apache-spark-everywhere.html
Reference Implementations Rust
GOLang
Source gRPC proto files https://github.com/apache/spark/tree/master/connector/connect/common/src/main/protobuf/spark/connect
Useful Videos If this doesn’t get you excited then nothing will it is, of course, suitable for work, it is...
2024-01-01
15 reads
I made a mistake recently when I was creating an ADF pipeline, annoyingly I made loads of changes and then clicked the debug button, when I pressed debug the...
2021-03-17 (first published: 2021-03-12)
814 reads
I made a mistake recently when I was creating an ADF pipeline, annoyingly I made loads of changes and then clicked the debug button, when I pressed debug the...
2021-03-12
9 reads
In my previous blog post I talked about how to read from an XML Webervice and use xpath to query the XML on the expressions side of things. You...
2021-03-04 (first published: 2021-02-26)
433 reads
In my previous blog post I talked about how to read from an XML Webervice and use xpath to query the XML on the expressions side of things. You...
2021-02-26
14 reads
When you use ADF, there are two sides to the coin. The first is the data itself that ADF does very well, from moving it from one site to...
2021-02-18 (first published: 2021-02-12)
420 reads
When you use ADF, there are two sides to the coin. The first is the data itself that ADF does very well, from moving it from one site to...
2021-02-12
14 reads
This is a bit of a longer one, a look at how to do all the different joins and the exciting thing for MSSQL developers is that we get...
2021-02-05 (first published: 2021-01-25)
147 reads
This is a bit of a longer one, a look at how to do all the different joins and the exciting thing for MSSQL developers is that we get...
2021-01-25
2 reads
By Steve Jones
I had to demo the Flyway Autopilot system recently and created a GitHub Actions...
This is more complicated than using the Azure Migration method, but because it’s maxed...
I’ve covered how to create Elastic Jobs in the portal (this one is important...
Hi, I am using the SSMA for Oracle v10.0. I have installed the SSMA...
Hi, I an using VS 2022 to build a package that selects and then...
Accidental DBA here. After looking at all the work that needs to be done,...
Which of these is not a requirement for a database to be added to an Availability Group (AG)?
See possible answers