Using ADF to Upload Disparate CSV Files into Azure MySQL

In this article our objective is to showcase how to leverage Azure Data Factory (ADF) and a custom script to upload data in Azure MySQL database when we have CSV files with different schemas. As there is no straightforward way to upload data directly using ADF for this given scenario, it will actually help to […]

Azure Data Factory Pipeline Logging Error Details

In this article we will cover how to capture and persist Azure Data Factory pipeline errors to an Azure SQL Database table.

Working with NULL Values in an ADF Data Flow?

Learn how to replace NULL values in an ADF data flow.

The ADF Case

How to simulate Case statement in Azure Data Factory (ADF) compared with SSIS?

This post will describe how you use a CASE statement in Azure Data Factory (ADF). If you are coming from SSIS background, you know a piece of SQL statement will do the task. However let's see how do it in SSIS and the very same thing can be achieved in ADF. Problem statement For my […]

Azure Data Factory Pipelines: Filling in the gaps

Azure Data Factory is a cloud based data orchestration tool that many ETL developers began using instead of SSIS. In this article, Rodney Landrum recalls a Data Factory project where he had to depend on another service, Azure Logic Apps, to fill in for some lacking functionality.

Orchestrating Azure Databricks Notebooks with Azure Data Factory

Learn how to orchestrate your Databricks notebooks through Azure Data Factory in this article with a step by step walkthrough.

Incremental Data loading through ADF using Change Tracking

Learn how you can use Change Tracking to incrementally load data with Azure Data Factory

Downloading a CSV File from an API Using Azure Data Factory

In this article, learn how to use Azure Data Factory with a REST API to download files.

Getting Started with Delta Lake Using Azure Data Factory

This article will demonstrate how to get started with Delta Lake using Azure Data Factory's new Delta Lake connector through examples of how to create, insert, update, and delete in a Delta Lake.