Dynamic ELT with Azure Data Factory - Part 3 of 3
In part 3 of this series, see how you can use the principles from the series to build an Azure Data Factory pipeline.
2023-01-25
5,448 reads
Sarah Dugan
Technical Considerations for Data Ingestion - Part 2
In part 2, we discuss the concepts of structure, tooling, and indexing for your data ingestion pipelines.
2023-01-18
2,679 reads
The Art of Data Ingestion - Part 1
Data movement is a fundamental piece of a data engineer’s duties, and recently I’ve been thinking about the art of data movement. What are some of the most important pieces that a data engineer needs to think about when confronted with data ingestion? There is of course data exporting as well, and in that case, […]
2022-11-11
5,883 reads
Dynamic ETL with SSIS
Learn how to dynamically load data from ETL load files using SSIS as a shell. The code downloads files from FTP, parses them and loads them into the database.
2013-05-03 (first published: 2010-10-19)
27,398 reads
Blogs
The Data API Builder Start and Add Extensions in VS Code
By Steve Jones
One of the things that I like about the Data API Builder (DAB) is...
Using OneLake for Excel Files in Microsoft Fabric
By DataOnWheels
Hey data friends! This blog is to discuss an edge case I’ve run into...
Another AI Faux Pax
By Steve Jones
I was experimenting with a local model (article) and as a part of this,...
Forums
AD, powershell and ssis
Hi, i have a requirement that involves visiting multiple folders in AD for active,...
File date from Extended Event .xel files
I know this, but I do not remember it. I have scoured by saved...
SSMS gets very messy
At work we have quite a few databases that I'm frequently browsing. This is...
Question of the Day
Sparse Column Defaults
What are the restrictions for defaults on columns declared as sparse?
See possible answers