Configuring an SSIS ForEach Loop for Multiple File Types
The ForEach loop works with only one file type at a time by default. Learn how you can add code to your packages to work with multiple types of files.
2023-12-18
3,244 reads
ETL/SSIS/Azure Data Factory
Using Pipeline Return Value in Azure Data Factory and Azure Synapse Analytics
Learn how you can return data from one ADF pipeline for use in another.
2023-11-01
4,729 reads
Trigger the Execution of an ADF Pipeline from an Email
Learn how you can configure an Azure Data Factory pipeline that is triggered by an email being sent to an address.
2023-11-03 (first published: 2023-10-27)
4,418 reads
Top 10 Methods to Improve ETL Performance Using SSIS
Extraction Transformation Load (ETL) is the backbone for any data warehouse. In the data warehouse world data is managed by the ETL process, which consists of three processes, Extraction-Pull/Acquire data from sources, Transformation-change data in the required format and Load-push data to the destination generally into a data warehouse or a data mart.
2023-10-25
What I Wish Everyone Knew About ETL Processes - Traditional to Modern Cloud Solutions
Learn about the evolutionary journey of ETL (Extract, Transform, Load) from traditional processes to modern cloud solutions.
2023-10-18
GIT Configuration and Automated Release for Azure Data Factory
Learn a step-by-step method to save your ADF pipelines in Git and automatically release new changes to test and production.
2024-09-23 (first published: 2023-10-16)
2,493 reads
Sending Multiple Attachments in Email from Azure Data Factory Pipeline
This article shows how you can have your Azure Data Factory (ADF) pipeline send an email using a Logic App.
2023-09-29
3,252 reads
How Effective Is Your Data Load Monitoring in SQL and Python?
Learn how you can use monitor your data warehouse load process with Python code and a structured process.
2023-10-06 (first published: 2023-09-20)
1,983 reads
Unpivot Data Using Python
This article looks at manipulating data using Python to unpivot data received in a cross tab format.
2023-06-30
3,305 reads
Advantages of Kappa architecture in the Modern Data Stack
A comparison of the lambda and kappa architectures for real time ingestion and analysis of big data.
2023-06-19
5,087 reads
Blogs
Redefining Tech Leadership in the Age of Microsoft AI
By Chris Yates
AI is no longer a niche capability – it is a leadership catalyst. As...
Sample Data with GenAI in Seconds
By Steve Jones
A friend was asking for help with some data analysis. This was in PowerBI,...
TSQL Tuesday #188 Growing community
I am responding late to a T-SQL Tuesday invite from John Sterrett. John’s call...
Forums
How a Legacy Logic Choked SQL Server in a 30-Year-Old Factory
Comments posted to this topic are about the item How a Legacy Logic Choked...
do i lose "what this object depends on" etc when moving sprocs to etl server
Hi i was surprised to see the approach my coworkers used to sunset talend...
People Make Odd Choices
Comments posted to this topic are about the item People Make Odd Choices
Question of the Day
Query Plan Regressions --
For the Question of the day, I am going to go deep, but try to be more clear, as I feel like I didn't give enough info last time, leading folks to guess the wrong answer... :) For today's question: You’re troubleshooting a performance issue on a critical stored procedure. You notice that a previously efficient query now performs a full table scan instead of an index seek. Upon investigating, you find that an NVARCHAR parameter is being compared to a VARCHAR column in the WHERE clause. What is the most likely cause of the query plan regression?
See possible answers