Designing Delta Tables with Liquid Clustering: Real-World Patterns for Data Engineers
Get a short introduction to Liquid Clustering in Databricks.
Not Just an Upgrade
Choosing to upgrade isn't as simple as many of us would like. Steve has a few thoughts today on the decision to move to a new version of a database server.
SQL Server Long-Running Query Detection: How to Find and Monitor Slow Queries
Monitoring and alerting can be overwhelming tasks, especially for those new to the world of managing production data. One common challenge for any data professional is the identification and management of queries that run for longer than they should.
Webinar: Compliance Without Compromise: Test Data Management That Finally Fits
You know you shouldn't have production data in test environments. But every time you look at fixing it, the options feel impossible: enterprise tools that cost six figures and take months to implement, or DIY scripts that sort of work until they don't. Join this webinar on Mar 18 to learn more.
Metadata Driven Pipelines (Incremental Load): The Fabric Modern Data Platform
This article will use the incremental data load pattern to load data in our raw zone tables.
Why End-User Testing Is Even More Important with AI
I don’t think I’m alone in this frustration, but it crystallized for me recently while trying to do something that should have taken less than two minutes: check in for a flight. What followed was a cascade of app switching and authentication failures. I started in my favorite travel app, moved to one airline app, […]
Supervised versus Unsupervised Training of an Artificial Neural Network
Supervised training of an artificial neural network entails training the network to associate defined patterns with specified labels. Optical Character Recognition is an example of supervised training, where each input pattern is mapped to an alphanumeric character. In unsupervised training, a neural network learns to extract recurring patterns from noisy data. One of the earliest […]
Writing as an Art and a Job
Steve thinks communication is a core sill for technology people, especially in the age of AI.
How to Help Copilot Encourage Good Database Standards
I know a lot of y’all lag behind on upgrading SSMS, but v22.3 just introduced something that you need to be aware of. It’s going to impact any of your users who DO upgrade their SSMS, or who use Github Copilot. There’s something that you can do in order to improve Copilot’s code quality and make it match your preferred coding standards.
Blogs
AI: Blog a Day – Day 8: RAG – Retrieval Augmented Generation
By Vinay Thakur
RAG — Retrieval Augmented Generation. we have covered so far — embeddings, vectors, vector...
AI: Blog a Day – Day 7: Vector and Vector Databases
By Vinay Thakur
Continuing from Day 6 we learned Embeddings, Semantic Search and Checks, on Day 7...
AI: Blog a Day – Day 6: Embeddings – How AI Understands
By Vinay Thakur
Continuing from Day 5 where we covered notebooks, HuggingFace and fine tuning AI now...
Forums
Not Just an Upgrade
Comments posted to this topic are about the item Not Just an Upgrade
Restoring On Top I
Comments posted to this topic are about the item Restoring On Top I
Designing Delta Tables with Liquid Clustering: Real-World Patterns for Data Engineers
Comments posted to this topic are about the item Designing Delta Tables with Liquid...
Question of the Day
Restoring On Top I
I am doing development work on a database and want to keep a backup so I can reset my database. I make some changes and want to restore over top of my changes. When I run this code, what happens?
USE Master BACKUP DATABASE DNRTest TO DISK = 'dnrtest.bak' GO USE DNRTest GO CREATE TABLE MyTest(myid INT) GO USE master RESTORE DATABASE DNRTest FROM DISK = 'dnrtest.bak' WITH REPLACESee possible answers