Designing Delta Tables with Liquid Clustering: Real-World Patterns for Data Engineers
Get a short introduction to Liquid Clustering in Databricks.
Fun with JSON
Last year, I used a lot of JSON to exchange data between systems. There are several ways to extract data from a JSON file, but there is one specific, probably less-used possibility that I’d like to highlight. For one project, I received JSON files containing a variable number of parameters and their values. If I […]
Not Just an Upgrade
Choosing to upgrade isn't as simple as many of us would like. Steve has a few thoughts today on the decision to move to a new version of a database server.
SQL Server Long-Running Query Detection: How to Find and Monitor Slow Queries
Monitoring and alerting can be overwhelming tasks, especially for those new to the world of managing production data. One common challenge for any data professional is the identification and management of queries that run for longer than they should.
Webinar: Compliance Without Compromise: Test Data Management That Finally Fits
You know you shouldn't have production data in test environments. But every time you look at fixing it, the options feel impossible: enterprise tools that cost six figures and take months to implement, or DIY scripts that sort of work until they don't. Join this webinar on Mar 18 to learn more.
Metadata Driven Pipelines (Incremental Load): The Fabric Modern Data Platform
This article will use the incremental data load pattern to load data in our raw zone tables.
Why End-User Testing Is Even More Important with AI
I don’t think I’m alone in this frustration, but it crystallized for me recently while trying to do something that should have taken less than two minutes: check in for a flight. What followed was a cascade of app switching and authentication failures. I started in my favorite travel app, moved to one airline app, […]
Supervised versus Unsupervised Training of an Artificial Neural Network
Supervised training of an artificial neural network entails training the network to associate defined patterns with specified labels. Optical Character Recognition is an example of supervised training, where each input pattern is mapped to an alphanumeric character. In unsupervised training, a neural network learns to extract recurring patterns from noisy data. One of the earliest […]
Writing as an Art and a Job
Steve thinks communication is a core sill for technology people, especially in the age of AI.
How to Help Copilot Encourage Good Database Standards
I know a lot of y’all lag behind on upgrading SSMS, but v22.3 just introduced something that you need to be aware of. It’s going to impact any of your users who DO upgrade their SSMS, or who use Github Copilot. There’s something that you can do in order to improve Copilot’s code quality and make it match your preferred coding standards.
Blogs
The First Steps: Understanding the Basics of FinOps
By HeyMo0sh
As a DevOps professional, I’ve seen firsthand how cloud costs can quickly spiral out...
Monday Monitor Tips: AI Query Analysis
By Steve Jones
AI is everywhere. It’s in the news, it’s being added to every product, management...
AI: Blog a Day – Day 8: RAG – Retrieval Augmented Generation
By Vinay Thakur
RAG — Retrieval Augmented Generation. we have covered so far — embeddings, vectors, vector...
Forums
would it be so terrible to install ssms on a few user desktops?
Hi, ssms is free here. I can think of other reasons to do this...
I'm thinking about submitting some articles
I've written some documentation on using different Markdown types of files on GitHub. It's...
Not Just an Upgrade
Comments posted to this topic are about the item Not Just an Upgrade
Question of the Day
Restoring On Top I
I am doing development work on a database and want to keep a backup so I can reset my database. I make some changes and want to restore over top of my changes. When I run this code, what happens?
USE Master BACKUP DATABASE DNRTest TO DISK = 'dnrtest.bak' GO USE DNRTest GO CREATE TABLE MyTest(myid INT) GO USE master RESTORE DATABASE DNRTest FROM DISK = 'dnrtest.bak' WITH REPLACESee possible answers