How to use a Script Activity in ADF as a Lookup
In Azure Data Factory (ADF, but also Synapse Pipelines and Fabric Pipelines), you have a typical scenario where you retrieve some metadata from a database and then loop over...
2024-06-27
150 reads
Koen Verbeeck
- Twitter: @https://twitter.com/Ko_Ver
- Website: https://sqlkover.com/
- LinkedIn: https://www.linkedin.com/in/kverbeeck/
Book Review – Fundamentals of Data Engineering
This book was recommended by some of my colleagues, so I decided to give it a try. After finishing the book, I was pleased that I did. As the...
2024-06-24 (first published: 2024-06-05)
482 reads
Planview Portfolios REST API with ADF – Retrieving Actual Data
In the introduction of this blog post series, I explained the use case: extracting data from the Planview Portfolios REST API using Azure Data Factory. Any tool that can...
2024-06-19 (first published: 2024-05-26)
227 reads
Speaking at dataMinds Connect 2024
I’m very excited to announce I’ve been selected as a speaker for dataMinds Connect 2024, Belgium’s (and maybe/probably/most likely mainland Europe’s) best and greatest Microsoft data platform conference. My...
2024-06-17
18 reads
Extracting Data from the Planview Portfolios REST API using ADF – Introduction
I have a client using Planview Portfolios to manage their PMO. As part of the data warehouse, we want to extract the project data from the Planview REST API....
2024-06-14 (first published: 2024-05-26)
344 reads
How to Set Up Microsoft Fabric Database Mirroring for Azure Cosmos DB
This article shows how to configure database mirroring from CosmosDB to Microsoft Fabric.
2024-06-10
1,344 reads
PostgreSQL error in Fabric Pipelines – No pg_hba.conf Entry for Host
I came across a bit of a weird error when I was trying to connect to a PostGreSQL database (hosted as an Azure DB for PostGreSQL), where “xx.xx.xx.xxx” is...
2024-06-07
246 reads
Planview Portfolios REST API with ADF – Fetching the Access Token
In the introduction of this blog post series, I explained the use case: extracting data from the Planview Portfolios RESET API using Azure Data Factory. Any tool that can...
2024-05-28 (first published: 2024-05-26)
47 reads
Planview Portfolios REST API with ADF – The OData Feed
In the introduction, I explained the setup of the use case and why we need to use the OData feed: to get the list of Project IDs, because the...
2024-05-28 (first published: 2024-05-26)
41 reads
Get row counts of all tables in a Microsoft Fabric warehouse
I loaded some built-in sample data from Wide World Importers into a Fabric warehouse. You get an option to load sample data when you create a new pipeline in...
2024-05-20 (first published: 2024-05-02)
268 reads
Blogs
AI Helps Me with My Sloppiness
By Steve Jones
I type fairly well. Well, I type fast, but I do wear out a...
WITH clause gets a 26ai boost!
By way of background, a while back I did video called “My New Favourite...
Automatic Index Compaction
By ReviewMyDB
Index maintenance has always meant nightly jobs and a window you have to defend....
Forums
SQL Art, Part 4: Happy 4th of July — A British DBA's Guide to Celebrating a War We Don't Talk About
Comments posted to this topic are about the item SQL Art, Part 4: Happy...
How We Handled a Vendor Retry That Loaded Twice in Snowflake
Comments posted to this topic are about the item How We Handled a Vendor...
Cognitive Coverage
Comments posted to this topic are about the item Cognitive Coverage
Question of the Day
Getting the Average
I have this data in the dbo.Commission table in a SQL Server 2022 database.
salesperson commission Brian 12 Brian 16 Andy 7 Andy 14 Andy 21 Steve 20 Steve NULLAll the data is a varchar, and I decide to run this query to get the totals for each salesperson.
SELECT SalesPerson
, AVG(TRY_PARSE(Commission AS int)) AS TotalCommission
FROM commission
GROUP BY SalesPerson
GO
What average commission is calculated for Steve? See possible answers