How to use a Script Activity in ADF as a Lookup
In Azure Data Factory (ADF, but also Synapse Pipelines and Fabric Pipelines), you have a typical scenario where you retrieve some metadata from a database and then loop over...
2024-06-27
62 reads
Koen Verbeeck
Database Build Error – Incorrect syntax near DISTINCT
I wrote a piece of SQL that had some new T-SQL syntax in it: IS DISTINCT FROM. This predicate checks if two expressions are equal taking NULL into account....
2024-06-24
235 reads
Speaking at dataMinds Connect 2024
I’m very excited to announce I’ve been selected as a speaker for dataMinds Connect 2024, Belgium’s (and maybe/probably/most likely mainland Europe’s) best and greatest Microsoft data platform conference. My...
2024-06-17
1 reads
Dynamic Warehouse & Lakehouse Connections in Microsoft Fabric Data Pipelines
When you develop data pipelines in Microsoft Fabric (the Azure Data Factory equivalent in Fabric, not to be confused with deployment pipelines), you will most likely have some activities...
2024-07-01 (first published: 2024-06-13)
291 reads
System Views in Microsoft Fabric – Query references an object that is not supported in distributed processing mode
I have a metadata-driven ELT framework that heavily relies on dynamic SQL to generate SQL statements that load data from views into a respective fact or dimension. Such a...
2024-07-08 (first published: 2024-06-08)
136 reads
PostgreSQL error in Fabric Pipelines – No pg_hba.conf Entry for Host
I came across a bit of a weird error when I was trying to connect to a PostGreSQL database (hosted as an Azure DB for PostGreSQL), where “xx.xx.xx.xxx” is...
2024-06-07
88 reads
Book Review – Fundamentals of Data Engineering
This book was recommended by some of my colleagues, so I decided to give it a try. After finishing the book, I was pleased that I did. As the...
2024-06-24 (first published: 2024-06-05)
427 reads
Planview Portfolios REST API with ADF – Retrieving Actual Data
In the introduction of this blog post series, I explained the use case: extracting data from the Planview Portfolios REST API using Azure Data Factory. Any tool that can...
2024-06-19 (first published: 2024-05-26)
194 reads
Planview Portfolios REST API with ADF – Fetching the Access Token
In the introduction of this blog post series, I explained the use case: extracting data from the Planview Portfolios RESET API using Azure Data Factory. Any tool that can...
2024-05-28 (first published: 2024-05-26)
21 reads
Planview Portfolios REST API with ADF – The OData Feed
In the introduction, I explained the setup of the use case and why we need to use the OData feed: to get the list of Project IDs, because the...
2024-05-28 (first published: 2024-05-26)
11 reads
Blogs
T-SQL Tuesday #178–A Recent Technical Problem
By Steve Jones
This month we have a good invitation from Deepthi Goguri, where she asks us...
Redgate Clone Graduating Images
By Steve Jones
I wanted my own custom image in our internal Redgate Clone cluster, so I...
Forums
GIT Configuration and Automated Release for Azure Data Factory
Comments posted to this topic are about the item GIT Configuration and Automated Release...
How to Add a New Shared Disk to a WSFC as a SQL Resource
Comments posted to this topic are about the item How to Add a New...
Capture long transact query using SQL Server performance condition alert feature
I created a SQL Alert trying to capture long query transaction under the SQL...
Question of the Day
Adding Features During a SQL Server 2022 Upgrade
I have a SQL Server 2016 SP3 instance that I want to upgrade to SQL Server 2022. I don't have replication installed, but I want to enable this on SQL Server 2022. Can I add replication during the in-place upgrade?
See possible answers