Incremental Data Loading Using ADF and Change Tracking
This article looks at moving data in three related tables to Azure SQL Database using the change tracking feature in SQL Server to determine which rows have been changed.
2021-10-04
8,117 reads
Azure Data Factory
2021-10-01
379 reads
Working with the Delete Activity in Azure Data Factory
Introduction We can use the delete activity in Azure Data Factory to delete files from both on-premises and cloud storage. In this article, we will discuss the delete activity with the various options available for the file deletion. I will show the following operations with the Delete Activity: Delete files from a folder. Delete contents […]
2021-09-27
15,719 reads
How to Flatten JSON in Azure Data Factory?
When you work with ETL and the source file is JSON, many documents may get nested attributes in the JSON file. Your requirements will often dictate that you flatten those nested attributes. There are many ways you can flatten the JSON hierarchy, however; I am going to share my experiences with Azure Data Factory (ADF) […]
2021-09-17
20,466 reads
Azure Data Factory Incremental Pipeline from Azure SQL Database to Databricks
In this tip find out how to use Azure Data factory to build an incremental pipeline from Azure SQL Database to Databricks.
2021-08-25
Working with Get Metadata Activity in Azure Data Factory
Learn how to gather metadata information about the files being processed in your ADF pipeline.
2021-08-20
23,694 reads
Merge Multiple Files in Azure Data Factory
A short tutorial on how to combine multiple files together in an Azure Data Factory Copy Data activity.
2021-08-04
27,870 reads
Why Power Query as an Activity in Azure Data Factory and SSIS?
There is a Power Query activity in SSIS and Azure Data Factory, which can be more useful than other tasks in some situations.
2021-07-26
4,458 reads
Upsert Operation in Cosmos DB using Azure Data Factory
This article covers the basics of upserting data in CosmosDB using Azure Data Factory.
2021-07-23
15,772 reads
Mapping Data Flows in Azure Data Factory
This article helps to create a data flow in Azure Data Factory, add conditional split logic to the flow, and transfer data from a file to an Azure SQL Database.
2021-07-05 (first published: 2021-06-04)
5,896 reads
Blogs
Why your data still can’t answer a simple question
Every organization I talk to has the same problem dressed up in different clothes....
T-SQL Tuesday #197 Invitation – An impactful session or two from a conference
By DataOnWheels
I am delighted to host this month’s T-SQL Tuesday invitation. If you are new...
Did You Really Name That Default?
By alevyinroc
Ten years (and a couple jobs) ago, I wrote about naming default constraints to...
Forums
The day-to-day pressures of a DBA team, and how we can work smarter with automation and AI
Comments posted to this topic are about the item The day-to-day pressures of a...
Daily aggregation of Azure Blob Storage by tier (created/tier-change/deleted)
Hello all, I’m looking for advice on how to derive a daily snapshot table...
SQL 2017 to SQL 2025. Good to Go ?
We need to replace our Windows server running SQL 2017. Any reason not to...
Question of the Day
Using OPENJSON
I have some data in a table that looks like this:
BeerID BeerName brewer beerdescription 1 Becks Interbrew Beck's is a German-style pilsner beer 2 Fat Tire New Belgium Toasty malt, gentle sweetness, flash of fresh hop bitterness. 3 Mac n Jacks Mac & Jack's Brewery This beer erupts with a floral, hoppy taste 4 Alaskan Amber Alaskan Brewing Alaskan Brewing Amber Ale is an "alt" style beer 8 Kirin Kirin Brewing Kirin Ichiban is a Lager-type beerIf I run this, what is returned?
select t1.[key]
from openjson((select t.* FROM Beer AS t for json path)) t1 See possible answers