Empowering Lakehouse Users – Data Engineering with Fabric
Learn how to use the OneLake Explorer and Data Wrangler extension in VS Code to empower users to work with data in Microsoft Fabric.
2024-05-22
1,811 reads
data engineering
Combining Silver Tables into a Model – Data Engineering with Fabric
This next article in the series creates objects at the gold layer for consumption by combining tables from the silver layer of the lake house.
2024-05-15
3,389 reads
Metadata Driven Pipelines – Data Engineering with Fabric
This article explains metadata driven pipelines and shows an example in Microsoft Fabric.
2024-05-01
4,952 reads
Full vs. Incremental Loads – Data Engineering with Fabric
Learn how to perform full and incremental loads in Fabric with a little SparkSQL.
2024-04-17
6,544 reads
Managing Files and Folders with Python – Data Engineering with Fabric
In this article, learn how you can manage files and folders for both full and incremental loading situations.
2024-03-27
3,690 reads
Managed Vs Unmanaged Tables – Data Engineering with Fabric
Learn how to get started with Microsoft Fabric along with the differences between managed and unmanaged tables.
2024-03-20
4,707 reads
Evolving Role of Data Professionals in Artificial Intelligence Era
Generative Al tools like Gemini and GPT promise to automate and augment knowledge-based work. Data professionals must adapt to this transformation by acquiring new skills and playing a central role in their organization's AI-driven future. Data preparation, curation, ethical sourcing and labeling, and collecting user feedback become crucial as high-quality data is essential for effective LLM based application.
2024-03-04
2,708 reads
What is OneLake in Microsoft Fabric?
Get ready to be blown away! The highly anticipated Microsoft Build in May 2023 has finally unveiled its latest and greatest creation: the incredible Microsoft Fabric - an unparalleled Data Intelligence platform that is guaranteed to revolutionize the tech world! fig 1: OneLake for all Data One of the most exciting things in Fabric I […]
2023-07-26
5,284 reads
Revolutionizing Real-Time Data Management with SQL Server, Kafka, and Informatica
This article examines how one can structure a pipeline for processing real-time data using Kafka and Informatica.
2023-04-26
4,648 reads
Step by Step Guide to Install Jupyter Notebook
Whether you work as a Data Engineer or a Data Scientist, a Jupyter Notebook is a helpful tool. One of the projects I was working required a comparison of two parquet files. This is mainly a schema comparison, not a data comparison. Though the two .parquet were created from two different sources, the outcome should […]
2021-05-17
5,499 reads
Blogs
Learn Better: Pause to Review More
By Brian Kelley
If you want to learn better, pause more in your learning to intentionally review.
Azure SQL Managed Instance Next-Gen: Bring on the IOPS
By John
If you’ve used Azure SQL Managed Instance General Purpose, you know the drill: to...
SQL, MDX, DAX – the languages of data
By DataOnWheels
Ramblings of a retired data architect Let me start by saying that I have...
Forums
Two foreign keys to the same table. Can't cascade deletes.
Not sure if this is really a relational theory question but it seems about...
Connecting Power BI to SSAS and effective user not working
Hi everyone, Below is a consolidated summary of what we validated Architecture & data...
High Availability setup - has anyone seen this method?
Hi all, I recently moved to a new employer who have their HA setup...
Question of the Day
Encoding URLs
I have this data in a SQL Server 2025 table:
CREATE TABLE Response ( ResponseID INT NOT NULL CONSTRAINT ResponsePK PRIMARY KEY , ResponseVal VARBINARY(5000) ) GOIf I want to get a value from this table that I can add to a URL in a browser, which of these code items produces a result I can use? See possible answers