TF-IDF in .NET for Apache Spark Using Spark ML
Last Updated: 2020-10-18
NOTE: What you read here was before .NET for Apache Spark 1.0 which includes everything we need to do this purely in .NET - in this post...
2020-07-07
17 reads
Ed Elliott's Sql Developer Blog
Approaches to running Databricks ETL code from Azure ADF
Databricks is fantastic, but there is a small issue with how people use it. The problem is that Databricks is all things to all people. Data scientists and data...
2020-06-03
195 reads
Approaches to running Databricks ETL code from Azure ADF
Databricks is fantastic, but there is a small issue with how people use it. The problem is that Databricks is all things to all people. Data scientists and data...
2020-06-03
2 reads
The four tenets of ETL testing
Every ETL pipeline is only ever as reliable as the data that the upstream system provides. It is inevitable that assumptions you make about the data you are provided...
2020-03-06
13 reads
The four tenets of ETL testing
Every ETL pipeline is only ever as reliable as the data that the upstream system provides. It is inevitable that assumptions you make about the data you are provided...
2020-03-06
4 reads
2020-02-21
3 reads
Passing status messages and results back from Databricks to ADF
When we use ADF to call Databricks we can pass parameters, nice. When we finish running the Databricks notebook we often want to return something back to ADF so...
2020-02-05
50 reads
Passing status messages and results back from Databricks to ADF
When we use ADF to call Databricks we can pass parameters, nice. When we finish running the Databricks notebook we often want to return something back to ADF so...
2020-02-05
2 reads
Spark Delta Lake, Updates, Deletes and Time Travel
When you use delta lake there are a couple of interesting things to note based around the fact that the data is stored in parquet files which are read-only...
2020-01-20
12 reads
Spark Delta Lake, Updates, Deletes and Time Travel
When you use delta lake there are a couple of interesting things to note based around the fact that the data is stored in parquet files which are read-only...
2020-01-20
1 reads
Blogs
Leadership in Times of Change: Guiding Teams Through Uncertainty, Disruption, and Transformation
By Chris Yates
Change is inevitable. What separates thriving organizations from those that falter is not the...
The End of Year Vacation Burn
By Steve Jones
It’s been a good year for me. With my sabbatical, I felt like I’ve...
Speaking at PASS Summit 2025
By alevyinroc
In less than one month, I will be speaking not once but twice at...
Forums
Create an HTML Report on the Status of SQL Server Agent Jobs
Comments posted to this topic are about the item Create an HTML Report on...
Powershell script to generate SQL server Inventory in CSV format
Comments posted to this topic are about the item Powershell script to generate SQL...
Database Ledger in SQL Server 2022
Comments posted to this topic are about the item Database Ledger in SQL Server...
Question of the Day
Azure SQL Database MAXDOP
When Azure SQL Database was originally released, the MAXDOP was set to 0 for each new database. In Oct 2025, what is the default value for Azure SQL databases?
See possible answers