How to get data in a DataFrame via .NET for Apache Spark
When I first started working with Apache Spark, one of the things I struggled with was that I would have some variable or data in my code that I...
2021-01-17
43 reads
Ed Elliott's Sql Developer Blog
How to get data in a DataFrame via .NET for Apache Spark
When I first started working with Apache Spark, one of the things I struggled with was that I would have some variable or data in my code that I...
2021-01-17
6 reads
Git in 10 commands to do 99% of gitting and keeping out of trouble
Git is hard, probably harder than it needs to be but I have been using it for about 5 years and have a workflow that works for me. I...
2021-01-18 (first published: 2021-01-12)
1,021 reads
Git in 10 commands to do 99% of gitting and keeping out of trouble
Git is hard, probably harder than it needs to be but I have been using it for about 5 years and have a workflow that works for me. I...
2021-01-12
4 reads
TF-IDF in .NET for Apache Spark Using Spark ML v2
Spark ML in .NET for Apache Spark Apache Spark has had a machine learning API for quite some time and this has been partially implemented in .NET for Apache...
2020-12-19
75 reads
TF-IDF in .NET for Apache Spark Using Spark ML v2
Spark ML in .NET for Apache Spark Apache Spark has had a machine learning API for quite some time and this has been partially implemented in .NET for Apache...
2020-12-19
6 reads
Blog .NET for Apache Spark UDFs Missing Shared State
The Problem When you use a UDF in .NET for Apache Spark, something like this code:
class Program { static void Main(string args) { var spark = SparkSession.Builder().GetOrCreate(); _logging.AppendLine("Starting Select");...
2020-10-29
99 reads
Blog .NET for Apache Spark UDFs Missing Shared State
The Problem When you use a UDF in .NET for Apache Spark, something like this code:
class Program { static void Main(string args) { var spark = SparkSession.Builder().GetOrCreate(); _logging.AppendLine("Starting Select");...
2020-10-29
5 reads
Spark .NET - Spark ML TF-IDF
Spark ML in .NET for Apache Spark Spark is awesome, .NET is awesome, machine learning (ML) is awesome, so what could be better than using .NET to write ML...
2020-07-07
42 reads
TF-IDF in .NET for Apache Spark Using Spark ML
Spark ML in .NET for Apache Spark Spark is awesome, .NET is awesome, machine learning (ML) is awesome, so what could be better than using .NET to write ML...
2020-07-07
9 reads
Blogs
TSQL Tuesday #189: How is AI changing our careers
This month’s TSQL Tuesday invite is from my good friend, long standing MVP and...
Using SQL Compare to Revert a Stored Procedure
By Steve Jones
Imagine this situation, someone edits a stored procedure on a production server to “fix”...
PASS Data Community Summit LinkedIn Contest
By Brian Kelley
If you're not having success in convincing your organization to send you to this...
Forums
CDC job running for 17 days?
Good morning, I've noticed my CDC job running for 17 days. I've noticed it...
Database growth events for unidentified databases
We have recently upgraded from SQL Server 2016 to 2022 Standard Edition. Our nightly...
distributed availability group query
Not sure if this is my misunderstanding or an error in my process: Create...
Question of the Day
Determining the Updated Columns
I am creating a trigger in SQL Server 2022 and want to detect a change in a table. Here is my table DDL:
CREATE TABLE CustomerLarge ( CustomerID INT NOT NULL IDENTITY(1,1) CONSTRAINT CustomerLargePK PRIMARY KEY CLUSTERED , CustomerName VARCHAR(20) , CustomerContactFirstName VARCHAR(40) , CustomerContactLastName VARCHAR(40) , Address VARCHAR(20) , Address2 VARCHAR(20) , City VARCHAR(20) , CountryCode CHAR(3) , Postal VARCHAR(20) , creditlimit INT , discount numeric(4,2) , lastorderdate DATETIME , lastorderamount NUMERIC(10,2) , lastordercontact VARCHAR(20) , created DATETIME , modified DATETIME , modifiedby VARCHAR(20) , statusid INT , active BIT , customersize INT , primarysalesid INT) GOIf I want to detect that the creditlimit was updated, what IF statements should I use? See possible answers