ETL/SSIS/Azure Data Factory

SQLServerCentral Article

Microsoft Azure ADF - Dynamic Pipelines

  • Article

Azure Data Factory (ADF) is a cloud based data integration service that allows you to create data-driven workflows in the cloud for orchestrating and automating data movement and data transformation. Azure Data Factory does not store any data itself. but it allows you to create data-driven workflows to orchestrate the movement of data between supported […]

5 (5)

You rated this post out of 5. Change rating

2021-03-01

10,785 reads

SQLServerCentral Article

How to simulate Case statement in Azure Data Factory (ADF) compared with SSIS?

  • Article

This post will describe how you use a CASE statement in Azure Data Factory (ADF). If you are coming from SSIS background, you know a piece of SQL statement will do the task. However let's see how do it in SSIS and the very same thing can be achieved in ADF. Problem statement For my […]

4.5 (2)

You rated this post out of 5. Change rating

2020-11-12

20,972 reads

SQLServerCentral Article

Incremental Data Loading using Azure Data Factory

  • Article

Introduction In my last article, Loading data in Azure Synapse Analytics using Azure Data Factory, I discussed the step-by-step process for loading data from an Azure storage account to Azure Synapse SQL through Azure Data Factory (ADF). ADF basics are covered in that article. In this article I will go through the process for the incremental […]

4.5 (2)

You rated this post out of 5. Change rating

2020-09-24

41,518 reads

SQLServerCentral Article

Modular ETL Architecture Design in SSIS

  • Article

Overview of ETL Architecture In a data warehouse, one of the main parts of the entire system is the ETL process. ETL is the system that reads data from the source system, transforms the data according to the business logic, and finally loads it into the warehouse. While fetching data from the sources can seem […]

4 (2)

You rated this post out of 5. Change rating

2019-10-21

13,677 reads

Blogs

How important is having great soft skills as a Software Engineer for personal growth and career…

By

How important is having great soft skills as a Software Engineer for personal growth...

Master Advanced SQL: 2 Essential Courses for Every Data Analyst

By

If you're a data analyst, you already know that SQL isn't just a nice-to-have...

Friday Flyway Tips–State-based Deployments

By

Recently the Flyway Desktop (FWD) team release support for state-based deployments. These are similar...

Read the latest Blogs

Forums

Implementing Change Data Capture

By Steve Jones - SSC Editor

Comments posted to this topic are about the item Implementing Change Data Capture

What is new in Copilot, the new features available

By Daniel Calbimonte

Comments posted to this topic are about the item What is new in Copilot,...

Managed Instance Impressions

By Steve Jones - SSC Editor

Comments posted to this topic are about the item Managed Instance Impressions

Visit the forum

Question of the Day

Implementing Change Data Capture

I have a complex environment that uses quite a few SQL Server 2022 servers. We have a powerful SQL Server running Enterprise that hosts most of our transaction data. However, there are remote locations that run Standard, Web, Express, and Express with Advanced Services editions for local collection of data before the data is transferred to our central Enterprise Edition server. We are considering using Change Data Capture (CDC) to lower the amount of data we transfer from clients. Which editions can we implement this feature on?

See possible answers