Dynamic ELT with Azure Data Factory - Part 3 of 3
In part 3 of this series, see how you can use the principles from the series to build an Azure Data Factory pipeline.
2023-01-25
5,570 reads
Sarah Dugan
Technical Considerations for Data Ingestion - Part 2
In part 2, we discuss the concepts of structure, tooling, and indexing for your data ingestion pipelines.
2023-01-18
2,711 reads
The Art of Data Ingestion - Part 1
Data movement is a fundamental piece of a data engineer’s duties, and recently I’ve been thinking about the art of data movement. What are some of the most important pieces that a data engineer needs to think about when confronted with data ingestion? There is of course data exporting as well, and in that case, […]
2022-11-11
5,986 reads
Dynamic ETL with SSIS
Learn how to dynamically load data from ETL load files using SSIS as a shell. The code downloads files from FTP, parses them and loads them into the database.
2013-05-03 (first published: 2010-10-19)
27,576 reads
Blogs
Simplify Kubernetes Security With Kyverno and OPA Gatekeeper
Here’s how these tools can make Kubernetes security easier and help you avoid common...
A New Word: Lackout
By Steve Jones
lackout – n. the sudden awareness that you’re finally over someone, noticing that the...
Delta Lake over Spark Connect
By Ed Elliott
All Spark Connect Posts I have just finished an update for the spark connect dotnet...
Forums
Shades and Reflecting on SQLBits and the Bright Future of Data
Comments posted to this topic are about the item Shades and Reflecting on SQLBits...
Merge techniques
In Azure SQL DB, i want to merge records from the staging table to...
SSRS error: The Value for the image 'Image1' has a constant value...
Full error message: SSRS error: The Value for the image 'Image1' has a constant...
Question of the Day
Adding Defaults
I have a table, called dbo.logger, in SQL Server 2022. I decide to add two new columns to this table with this code.
ALTER TABLE dbo.logger ADD CreateDate DATETIME CONSTRAINT dfGetDate DEFAULT GETDATE() GO ALTER TABLE dbo.logger ADD ModifyDate DATETIME DEFAULT dfGetDate GOWhat happens when I run these two batches? See possible answers