Configuring an SSIS ForEach Loop for Multiple File Types
The ForEach loop works with only one file type at a time by default. Learn how you can add code to your packages to work with multiple types of files.
2023-12-18
3,403 reads
ETL/SSIS/Azure Data Factory
Using Pipeline Return Value in Azure Data Factory and Azure Synapse Analytics
Learn how you can return data from one ADF pipeline for use in another.
2023-11-01
4,940 reads
Trigger the Execution of an ADF Pipeline from an Email
Learn how you can configure an Azure Data Factory pipeline that is triggered by an email being sent to an address.
2023-11-03 (first published: 2023-10-27)
4,551 reads
Top 10 Methods to Improve ETL Performance Using SSIS
Extraction Transformation Load (ETL) is the backbone for any data warehouse. In the data warehouse world data is managed by the ETL process, which consists of three processes, Extraction-Pull/Acquire data from sources, Transformation-change data in the required format and Load-push data to the destination generally into a data warehouse or a data mart.
2023-10-25
What I Wish Everyone Knew About ETL Processes - Traditional to Modern Cloud Solutions
Learn about the evolutionary journey of ETL (Extract, Transform, Load) from traditional processes to modern cloud solutions.
2023-10-18
GIT Configuration and Automated Release for Azure Data Factory
Learn a step-by-step method to save your ADF pipelines in Git and automatically release new changes to test and production.
2024-09-23 (first published: 2023-10-16)
2,564 reads
Sending Multiple Attachments in Email from Azure Data Factory Pipeline
This article shows how you can have your Azure Data Factory (ADF) pipeline send an email using a Logic App.
2023-09-29
3,401 reads
How Effective Is Your Data Load Monitoring in SQL and Python?
Learn how you can use monitor your data warehouse load process with Python code and a structured process.
2023-10-06 (first published: 2023-09-20)
1,995 reads
Unpivot Data Using Python
This article looks at manipulating data using Python to unpivot data received in a cross tab format.
2023-06-30
3,342 reads
Advantages of Kappa architecture in the Modern Data Stack
A comparison of the lambda and kappa architectures for real time ingestion and analysis of big data.
2023-06-19
5,265 reads
Blogs
A New Word: Foilsick
By Steve Jones
foilsick – adj. feeling ashamed after revealing a little too much of yourself to...
Accelerated Database Recovery for tempdb in SQL Server 2025
Accelerated database recovery was introduced in SQL Server 2019 and provides fast recovery, instantaneous...
Measuring What Matters: Operationalizing Data Trust for CDOs
By Chris Yates
Trust is the currency of the data economy. Without it, even the most advanced...
Forums
Create an HTML Report on the Status of SQL Server Agent Jobs
Comments posted to this topic are about the item Create an HTML Report on...
Deleting data in large table
I have a large table with 17M+ rows for our package record audits. I've...
ETL Framework In Production
Hello, I am leveraging Python within SQL Server Integration Services (SSIS) packages, primarily through...