Designing Delta Tables with Liquid Clustering: Real-World Patterns for Data Engineers
Get a short introduction to Liquid Clustering in Databricks.
2026-03-09
2,578 reads
data engineering
Empowering Lakehouse Users – Data Engineering with Fabric
Learn how to use the OneLake Explorer and Data Wrangler extension in VS Code to empower users to work with data in Microsoft Fabric.
2024-05-22
1,831 reads
Combining Silver Tables into a Model – Data Engineering with Fabric
This next article in the series creates objects at the gold layer for consumption by combining tables from the silver layer of the lake house.
2024-05-15
3,516 reads
Metadata Driven Pipelines – Data Engineering with Fabric
This article explains metadata driven pipelines and shows an example in Microsoft Fabric.
2024-05-01
5,100 reads
Full vs. Incremental Loads – Data Engineering with Fabric
Learn how to perform full and incremental loads in Fabric with a little SparkSQL.
2024-04-17
6,661 reads
Managing Files and Folders with Python – Data Engineering with Fabric
In this article, learn how you can manage files and folders for both full and incremental loading situations.
2024-03-27
3,740 reads
Managed Vs Unmanaged Tables – Data Engineering with Fabric
Learn how to get started with Microsoft Fabric along with the differences between managed and unmanaged tables.
2024-03-20
4,841 reads
Evolving Role of Data Professionals in Artificial Intelligence Era
Generative Al tools like Gemini and GPT promise to automate and augment knowledge-based work. Data professionals must adapt to this transformation by acquiring new skills and playing a central role in their organization's AI-driven future. Data preparation, curation, ethical sourcing and labeling, and collecting user feedback become crucial as high-quality data is essential for effective LLM based application.
2024-03-04
2,716 reads
What is OneLake in Microsoft Fabric?
Get ready to be blown away! The highly anticipated Microsoft Build in May 2023 has finally unveiled its latest and greatest creation: the incredible Microsoft Fabric - an unparalleled Data Intelligence platform that is guaranteed to revolutionize the tech world! fig 1: OneLake for all Data One of the most exciting things in Fabric I […]
2023-07-26
5,315 reads
Revolutionizing Real-Time Data Management with SQL Server, Kafka, and Informatica
This article examines how one can structure a pipeline for processing real-time data using Kafka and Informatica.
2023-04-26
4,678 reads
Blogs
Houston AI-Lytics 2026–Powerpoint Slides
By Steve Jones
Thanks to everyone for attending my session on running a Local LLM. If you...
The Book of Redgate: Do the Right Things
By Steve Jones
I do believe that Redgate has been very customer focused since it’s inception. I’ve...
How to Connect to SQL Server When Nothing Else Works – DAC
By gbargsley
It's 2 AM. Your phone is going off. Users can't connect to the application,...
Forums
Warning: Could not open global shared memory to communicate with performance DLL
Hi everyone I am getting below warning when I run SSIS: Warning: 0x80049304 at...
Let's Talk Community Events!
Comments posted to this topic are about the item Let's Talk Community Events!
that one limitation in replication
Hi as shown below a replication target requires a primary key. if we want...
Question of the Day
Detecting Deadlocks
By default, how often is the SQL Server Database Engine checking for deadlocks?
See possible answers