Moving towards the DataFrame API using the Spark Connect gRPC API in .NET

All Spark Connect Posts
Code
Goal of this post So there are two goals of this post, the first is to take a look at Apache Arrow and how we can...

SQL Server's Buffer Cache: How to Calculate Dirty Page Sizes

SQL Server's Buffer Cache: How to Calculate Dirty Page Sizes

As we know, the SQL Server buffer cache is an area or region inside the server's memory where SQL Server...

The DevOps Airways Roadshow

I love this logo. Our marketing people were very creative. After the van tour last year, we decided to go with a plane this year. I wrote about the...

Azure Function App doesn’t retrieve most recent secret value from Azure Key Vault

Quite a long title for quite an annoying issue. Let me explain the set-up first: I have pipelines running in Azure Data Factory and I want to send e-mails...

A New Word: Tarrion

tarrion – n. an odd interval of blankness you feel after something big happens to you bt before you feel the resulting emotional reaction – stunned by a sudden...

Best Practice Tip #1: Beware of Best Practices

Best Practice Tip #1: Beware of Best Practices

It may sound contractionary that the first item of a best practices list is to be wary of...

Friday Flyway Tips–Linking a GitHub Issue to a Code Commit

Recently I was doing a demo and a customer asked how I had linked my commit in Azure DevOps to the work item that existed. It’s easy, and tldr;...

ISACA Journal Article on AI

The first issue of 2024 for the ISACA Journal has been published and the articles are available both in written and on-line format. I have a regular column on...

Exploring the Spark Connect gRPC API more

All Spark Connect Posts
Code
Goal of this post In this post we will continue looking at the gRPC API and the AnalyzePlan method which takes a plan and analyzes it....

THAT Conference 2024–Austin

This week I attended THAT Conference in Round Rock, just outside Austin, Texas. This was my second time attending the conference, which is a very unique. The conference runs...