Designing Delta Tables with Liquid Clustering: Real-World Patterns for Data Engineers
Get a short introduction to Liquid Clustering in Databricks.
2026-03-09
2,659 reads
data engineering
Empowering Lakehouse Users – Data Engineering with Fabric
Learn how to use the OneLake Explorer and Data Wrangler extension in VS Code to empower users to work with data in Microsoft Fabric.
2024-05-22
1,839 reads
Combining Silver Tables into a Model – Data Engineering with Fabric
This next article in the series creates objects at the gold layer for consumption by combining tables from the silver layer of the lake house.
2024-05-15
3,544 reads
Metadata Driven Pipelines – Data Engineering with Fabric
This article explains metadata driven pipelines and shows an example in Microsoft Fabric.
2024-05-01
5,132 reads
Full vs. Incremental Loads – Data Engineering with Fabric
Learn how to perform full and incremental loads in Fabric with a little SparkSQL.
2024-04-17
6,679 reads
Managing Files and Folders with Python – Data Engineering with Fabric
In this article, learn how you can manage files and folders for both full and incremental loading situations.
2024-03-27
3,765 reads
Managed Vs Unmanaged Tables – Data Engineering with Fabric
Learn how to get started with Microsoft Fabric along with the differences between managed and unmanaged tables.
2024-03-20
4,854 reads
Evolving Role of Data Professionals in Artificial Intelligence Era
Generative Al tools like Gemini and GPT promise to automate and augment knowledge-based work. Data professionals must adapt to this transformation by acquiring new skills and playing a central role in their organization's AI-driven future. Data preparation, curation, ethical sourcing and labeling, and collecting user feedback become crucial as high-quality data is essential for effective LLM based application.
2024-03-04
2,717 reads
What is OneLake in Microsoft Fabric?
Get ready to be blown away! The highly anticipated Microsoft Build in May 2023 has finally unveiled its latest and greatest creation: the incredible Microsoft Fabric - an unparalleled Data Intelligence platform that is guaranteed to revolutionize the tech world! fig 1: OneLake for all Data One of the most exciting things in Fabric I […]
2023-07-26
5,318 reads
Revolutionizing Real-Time Data Management with SQL Server, Kafka, and Informatica
This article examines how one can structure a pipeline for processing real-time data using Kafka and Informatica.
2023-04-26
4,694 reads
Blogs
ISACA AI Material/Exam Prep Discount (May 18 – June 30, 2026)
By Brian Kelley
If you are considering any of the ISACA AI certs like the Advanced Artificial...
A Fabric solution can be very cost effective
By ChrisJenkins
Are you currently using Microsoft Fabric or considering migrating to it? If so, there...
Track SQL Server Configuration Changes Using the Error Log
By SQLPals
Track SQL Server Configuration Changes Using the Error Log If you...
Forums
We Are Eating Our Own Seed Corn
Comments posted to this topic are about the item We Are Eating Our Own...
Before Using AI with Business Data, Read This
Artificial intelligence tools are quickly becoming part of daily business operations, from document analysis...
Designing SQL Server ETL Pipelines That Don't Break at Scale
Comments posted to this topic are about the item Designing SQL Server ETL Pipelines...
Question of the Day
Detecting Deadlocks Quickly
In the Database Engine, when a deadlock is detected, what does the detection interval shrink to (in time)?
See possible answers