Managing Fabric Lakehouse objects with the new CLI: Data Engineering with Fabric
In this next article, we are going to explore how to install, configure and use the command line to manage a couple different Fabric Lakehouse’s.
Purging Data from a Large Table in SQL Server
Purging data from a table is a common database maintenance task to prevent it from growing too large or to stay in compliance with data retention. When dealing with small amounts of data, this can be accomplished by a simple delete with no issues; however, with larger tables, this task can be problematic. Deleting records requires a lock that can block other processes from writing or even reading the data (depending on your isolation level). In this article I will share a technique I have used to work with some very large tables.
Helping Students with a Data Professional Career
Steve has advice for students looking to become data professionals.
DMV Comparison for SQL Server 2019 vs Azure SQL Database
What DMVs were added to Azure SQL Databases, and which DMVs are missing from Azure SQL Databases but still exist on SQL Server 2019 or other versions?
Deleting a Database
Who among us hasn't deleted a production data file? Steve hopes most of us have not.
Sentiment Analysis & Key Phrase Detection
Learn how you can conduct a sentiment analysis on data loaded into an Excel spreadsheet.
Power BI Mistakes to Avoid – Part 2
What advice would you give to someone new to Power BI? What are common Power BI mistakes to avoid? In this article, we will discuss several Power BI mistakes to avoid to help you navigate this powerful tool effectively.
Changing the Paradigm of Work
AI is changing work, sometimes for the better, sometimes not. Steve continues to examine and evaluate how GenAI systems might be used in today's world and asks if there is work that might help you.
Stairway to Transaction Log Management in SQL Server, Level 3: Transaction Logs, Backup and Recovery
This article discusses the different types of backup and recovery models and gives the essential facts that will guide you to being able to achieve a recovery of a database to a point in time.
How to Load a Date Dimension in Microsoft Fabric using Macros in dbt?
With the popular data transformation tool dbt (data build tool), we have a bunch of interesting features at our disposal to write SQL more efficiently. One of those features is macros, which we’ll introduce in this article
Blogs
AI: Blog a Day – Day 8: RAG – Retrieval Augmented Generation
By Vinay Thakur
RAG — Retrieval Augmented Generation. we have covered so far — embeddings, vectors, vector...
AI: Blog a Day – Day 7: Vector and Vector Databases
By Vinay Thakur
Continuing from Day 6 we learned Embeddings, Semantic Search and Checks, on Day 7...
AI: Blog a Day – Day 6: Embeddings – How AI Understands
By Vinay Thakur
Continuing from Day 5 where we covered notebooks, HuggingFace and fine tuning AI now...
Forums
Not Just an Upgrade
Comments posted to this topic are about the item Not Just an Upgrade
Restoring On Top I
Comments posted to this topic are about the item Restoring On Top I
Designing Delta Tables with Liquid Clustering: Real-World Patterns for Data Engineers
Comments posted to this topic are about the item Designing Delta Tables with Liquid...
Question of the Day
Restoring On Top I
I am doing development work on a database and want to keep a backup so I can reset my database. I make some changes and want to restore over top of my changes. When I run this code, what happens?
USE Master BACKUP DATABASE DNRTest TO DISK = 'dnrtest.bak' GO USE DNRTest GO CREATE TABLE MyTest(myid INT) GO USE master RESTORE DATABASE DNRTest FROM DISK = 'dnrtest.bak' WITH REPLACESee possible answers