How to use a Script Activity in ADF as a Lookup
In Azure Data Factory (ADF, but also Synapse Pipelines and Fabric Pipelines), you have a typical scenario where you retrieve some metadata from a database and then loop over...
2024-06-27
136 reads
Koen Verbeeck
- Twitter: @https://twitter.com/Ko_Ver
- Website: https://sqlkover.com/
- LinkedIn: https://www.linkedin.com/in/kverbeeck/
Book Review – Fundamentals of Data Engineering
This book was recommended by some of my colleagues, so I decided to give it a try. After finishing the book, I was pleased that I did. As the...
2024-06-24 (first published: 2024-06-05)
468 reads
Planview Portfolios REST API with ADF – Retrieving Actual Data
In the introduction of this blog post series, I explained the use case: extracting data from the Planview Portfolios REST API using Azure Data Factory. Any tool that can...
2024-06-19 (first published: 2024-05-26)
217 reads
Speaking at dataMinds Connect 2024
I’m very excited to announce I’ve been selected as a speaker for dataMinds Connect 2024, Belgium’s (and maybe/probably/most likely mainland Europe’s) best and greatest Microsoft data platform conference. My...
2024-06-17
16 reads
Extracting Data from the Planview Portfolios REST API using ADF – Introduction
I have a client using Planview Portfolios to manage their PMO. As part of the data warehouse, we want to extract the project data from the Planview REST API....
2024-06-14 (first published: 2024-05-26)
319 reads
How to Set Up Microsoft Fabric Database Mirroring for Azure Cosmos DB
This article shows how to configure database mirroring from CosmosDB to Microsoft Fabric.
2024-06-10
1,265 reads
PostgreSQL error in Fabric Pipelines – No pg_hba.conf Entry for Host
I came across a bit of a weird error when I was trying to connect to a PostGreSQL database (hosted as an Azure DB for PostGreSQL), where “xx.xx.xx.xxx” is...
2024-06-07
234 reads
Planview Portfolios REST API with ADF – Fetching the Access Token
In the introduction of this blog post series, I explained the use case: extracting data from the Planview Portfolios RESET API using Azure Data Factory. Any tool that can...
2024-05-28 (first published: 2024-05-26)
29 reads
Planview Portfolios REST API with ADF – The OData Feed
In the introduction, I explained the setup of the use case and why we need to use the OData feed: to get the list of Project IDs, because the...
2024-05-28 (first published: 2024-05-26)
29 reads
Get row counts of all tables in a Microsoft Fabric warehouse
I loaded some built-in sample data from Wide World Importers into a Fabric warehouse. You get an option to load sample data when you create a new pipeline in...
2024-05-20 (first published: 2024-05-02)
261 reads
Blogs
A New Word: on tenderhooks
By Steve Jones
on tenderhooks – adj. feeling the primal satisfaction of being needed by someone, which...
Ramblings about data communities and your contributions, no excuses
By DataOnWheels
I have been active in the data community throughout my career. I have met...
SQL Server Journey till 2025 (brief)
By Vinay Thakur
Quick Summary for Microsoft SQL Server till 2025, I am fortunate to be part...
Forums
how do i map the "current" object entry in for each to one variable
hi, in an ssis for each loop over an object variable called MyListVariable, i...
Simulating Mercury’s Orbital Motion Using Pure T-SQL (NASA 2025 Dataset)
SQL Server is typically viewed as a transactional or analytical database engine. However, it...
Azure SQL Database | CREATE EVENT SESSION [Blocking_Capture] ON DATABASE
Hello, Is there a way in Azure SQL Database to change the 'Blocking Process...
Question of the Day
String Similarity I
On SQL Server 2025, when I run this, what is returned?
SELECT EDIT_DISTANCE_SIMILARITY('SQL Server', 'MySQL') See possible answers