TF-IDF in .NET for Apache Spark Using Spark ML v2
Spark ML in .NET for Apache Spark Apache Spark has had a machine learning API for quite some time and this has been partially implemented in .NET for Apache...
2020-12-19
57 reads
Ed Elliott's Sql Developer Blog
TF-IDF in .NET for Apache Spark Using Spark ML v2
Spark ML in .NET for Apache Spark Apache Spark has had a machine learning API for quite some time and this has been partially implemented in .NET for Apache...
2020-12-19
2 reads
Blog .NET for Apache Spark UDFs Missing Shared State
The Problem When you use a UDF in .NET for Apache Spark, something like this code:
class Program { static void Main(string args) { var spark = SparkSession.Builder().GetOrCreate(); _logging.AppendLine("Starting Select");...
2020-10-29
77 reads
Blog .NET for Apache Spark UDFs Missing Shared State
The Problem When you use a UDF in .NET for Apache Spark, something like this code:
class Program { static void Main(string args) { var spark = SparkSession.Builder().GetOrCreate(); _logging.AppendLine("Starting Select");...
2020-10-29
Spark .NET - Spark ML TF-IDF
Spark ML in .NET for Apache Spark Spark is awesome, .NET is awesome, machine learning (ML) is awesome, so what could be better than using .NET to write ML...
2020-07-07
26 reads
TF-IDF in .NET for Apache Spark Using Spark ML
Spark ML in .NET for Apache Spark Spark is awesome, .NET is awesome, machine learning (ML) is awesome, so what could be better than using .NET to write ML...
2020-07-07
2 reads
TF-IDF in .NET for Apache Spark Using Spark ML
Last Updated: 2020-10-18
NOTE: What you read here was before .NET for Apache Spark 1.0 which includes everything we need to do this purely in .NET - in this post...
2020-07-07
Approaches to running Databricks ETL code from Azure ADF
Databricks is fantastic, but there is a small issue with how people use it. The problem is that Databricks is all things to all people. Data scientists and data...
2020-06-03
184 reads
Approaches to running Databricks ETL code from Azure ADF
Databricks is fantastic, but there is a small issue with how people use it. The problem is that Databricks is all things to all people. Data scientists and data...
2020-06-03
The four tenets of ETL testing
Every ETL pipeline is only ever as reliable as the data that the upstream system provides. It is inevitable that assumptions you make about the data you are provided...
2020-03-06
6 reads
Blogs
Query Store Hints in SQL Server 2022
Another neat little feature in SQL Server 2022 is Query Store Hints. This is...
Daily Coping 30 Nov 2022
By Steve Jones
Today’s coping tip is to learn a new skill from a friend or share...
Encrypting Your SQL Data Should be Your Default Option
Cyber-attacks and data breaches seem to be perpetually on the rise. Every week we...
Forums
Basic Checks on a New AWS RDS SQL Server
Comments posted to this topic are about the item Basic Checks on a New...
How to apply rates in a time column
Hello all I have this selected column : convert(TT.horas, Time) AS TimeTT, this column...
Designing Database from a piece of paper
Greetings experts, Hopefully, this is the forum for my question. I am trying to...
Ask SSC