TF-IDF in .NET for Apache Spark Using Spark ML
Spark ML in .NET for Apache Spark Spark is awesome, .NET is awesome, machine learning (ML) is awesome, so what could be better than using .NET to write ML...
2020-07-07
9 reads
Ed Elliott
TF-IDF in .NET for Apache Spark Using Spark ML
Last Updated: 2020-10-18
NOTE: What you read here was before .NET for Apache Spark 1.0 which includes everything we need to do this purely in .NET - in this post...
2020-07-07
18 reads
Approaches to running Databricks ETL code from Azure ADF
Databricks is fantastic, but there is a small issue with how people use it. The problem is that Databricks is all things to all people. Data scientists and data...
2020-06-03
198 reads
Approaches to running Databricks ETL code from Azure ADF
Databricks is fantastic, but there is a small issue with how people use it. The problem is that Databricks is all things to all people. Data scientists and data...
2020-06-03
2 reads
The four tenets of ETL testing
Every ETL pipeline is only ever as reliable as the data that the upstream system provides. It is inevitable that assumptions you make about the data you are provided...
2020-03-06
14 reads
The four tenets of ETL testing
Every ETL pipeline is only ever as reliable as the data that the upstream system provides. It is inevitable that assumptions you make about the data you are provided...
2020-03-06
6 reads
2020-02-21
5 reads
Passing status messages and results back from Databricks to ADF
When we use ADF to call Databricks we can pass parameters, nice. When we finish running the Databricks notebook we often want to return something back to ADF so...
2020-02-05
51 reads
Passing status messages and results back from Databricks to ADF
When we use ADF to call Databricks we can pass parameters, nice. When we finish running the Databricks notebook we often want to return something back to ADF so...
2020-02-05
2 reads
Spark Delta Lake, Updates, Deletes and Time Travel
When you use delta lake there are a couple of interesting things to note based around the fact that the data is stored in parquet files which are read-only...
2020-01-20
12 reads
Blogs
The Benefits of Teaching
By Brian Kelley
Even preparing for a class or seminar with set materials takes a lot of...
Power BI, Excel, OneLake – Dreams Do Come True!
By DataOnWheels
I can’t believe it’s finally here! A way to have Excel live in OneDrive...
The Book of Redgate: What Our Staff Says
By Steve Jones
This image is from 2010, and it goes along with my last post of...
Forums
Unlocking Data Transformation: My journey with dbt (Data Build Tool) on SQL Server
Comments posted to this topic are about the item Unlocking Data Transformation: My journey...
Putting the Player with the Number
Comments posted to this topic are about the item Putting the Player with the...
Your Security Checkup
Comments posted to this topic are about the item Your Security Checkup, which is...
Question of the Day
Putting the Player with the Number
In SQL Server 2025, what does this return?
DECLARE @player varchar(20) = 'Bo Nix', @num VARCHAR = '10' SELECT @player || @numSee possible answers