How to get data in a DataFrame via .NET for Apache Spark
When I first started working with Apache Spark, one of the things I struggled with was that I would have some variable or data in my code that I...
2021-01-17
39 reads
Ed Elliott
How to get data in a DataFrame via .NET for Apache Spark
When I first started working with Apache Spark, one of the things I struggled with was that I would have some variable or data in my code that I...
2021-01-17
4 reads
Git in 10 commands to do 99% of gitting and keeping out of trouble
Git is hard, probably harder than it needs to be but I have been using it for about 5 years and have a workflow that works for me. I...
2021-01-12
4 reads
TF-IDF in .NET for Apache Spark Using Spark ML v2
Spark ML in .NET for Apache Spark Apache Spark has had a machine learning API for quite some time and this has been partially implemented in .NET for Apache...
2020-12-19
75 reads
TF-IDF in .NET for Apache Spark Using Spark ML v2
Spark ML in .NET for Apache Spark Apache Spark has had a machine learning API for quite some time and this has been partially implemented in .NET for Apache...
2020-12-19
4 reads
Blog .NET for Apache Spark UDFs Missing Shared State
The Problem When you use a UDF in .NET for Apache Spark, something like this code:
class Program { static void Main(string args) { var spark = SparkSession.Builder().GetOrCreate(); _logging.AppendLine("Starting Select");...
2020-10-29
98 reads
Blog .NET for Apache Spark UDFs Missing Shared State
The Problem When you use a UDF in .NET for Apache Spark, something like this code:
class Program { static void Main(string args) { var spark = SparkSession.Builder().GetOrCreate(); _logging.AppendLine("Starting Select");...
2020-10-29
3 reads
Spark .NET - Spark ML TF-IDF
Spark ML in .NET for Apache Spark Spark is awesome, .NET is awesome, machine learning (ML) is awesome, so what could be better than using .NET to write ML...
2020-07-07
41 reads
TF-IDF in .NET for Apache Spark Using Spark ML
Spark ML in .NET for Apache Spark Spark is awesome, .NET is awesome, machine learning (ML) is awesome, so what could be better than using .NET to write ML...
2020-07-07
9 reads
TF-IDF in .NET for Apache Spark Using Spark ML
Last Updated: 2020-10-18
NOTE: What you read here was before .NET for Apache Spark 1.0 which includes everything we need to do this purely in .NET - in this post...
2020-07-07
17 reads
Blogs
Build a C++ Pipeline with Docker, GitHub Actions, Azure ACR and Azure App Service
In today’s Software Development Life Cycle (SDLC), having a robust build pipeline is very...
Better Trigger Design: #SQLNewBlogger
By Steve Jones
I had someone ask me about using triggers to detect changes in their tables....
SQL Server in the Cloud – Are DBAs Still Needed?
By Kevin3NF
Things your cloud vendor may not tell you Here’s a common theme I...
Forums
Getting year part out of a string that represents a date
Hi, I have a requirement to fetch the year from an imported .csv file...
Dropping a PK constraint.
I will have to test this next week, but will not have a chance...
SQL - Conditional merge join
I want to add a condition in the joining columns part of the merge...
Question of the Day
What is Between?
I have a table of products in SQL Server 2022. There are sequential items in the table with ProductIDs of 1, 2, 3, 4, 5, 6, 7, 8, 9, 10. If I run this code, how many rows are returned?
SELECT * FROM dbo.Products WHERE ProductID BETWEEN 4 AND 7;See possible answers