Data movement is a fundamental piece of a data engineer’s duties, and recently I’ve been thinking about the art of data movement. What are some of the most important pieces that a data engineer needs to think about when confronted with data ingestion? There is of course data exporting as well, and in that case, […]
2022-11-11
2,627 reads
In this post, Tim Smith will look at some of the considerations for both data rules and logic to prevent invalid data early in the ETRL process.
2018-05-02
3,324 reads
2018-04-03
226 reads
The need for data imports, exports, and transformations seems to be growing.
2018-02-21
135 reads
In this post, Tim Smith looks at the different options you can use to audit your SQL Server extracts and loads during the ETL process.
2017-07-04
3,755 reads
Scala and Apache Spark might seem an unlikely medium for implementing an ETL process, but there are reasons for considering it as an alternative. After all, many Big Data solutions are ideally suited to the preparation of data for input into a relational database, and Scala is a well thought-out and expressive language. Krzysztof Stanaszek describes some of the advantages and disadvantages of a scala-based approach to implementing and testing an ETL solution.
2017-06-12
4,658 reads
People were doing ETL long before ETL packages were invented. Some of those facilities still have worth today
2016-08-15
4,905 reads
Jeremy Kadlec introduces the Enhanced Data Integration Suite (EDIS), a SQL Server T-SQL stored procedure based solution to automate, manage, and audit ETL processes so you no longer have to manually build SSIS Packages.
2016-02-03
6,164 reads
A tale in which is detailed how I used SWITCH PARTITION to efficiently load my data and save myself from the flaming jaws of death.
2017-10-20 (first published: 2015-11-02)
4,253 reads
This article takes a simple look at loading data in parallel from a single data source, be it a flat file of a database
2015-08-03
6,530 reads
I previously blogged about how to create a STONITH resource for a pacemaker cluster...
By Zikato
Foreword Have you ever wondered where the .xel file is saved when you create a...
Another neat little feature in SQL Server 2022 is Query Store Hints. This is...
Hi, In Power BI Report Builder I need to use SSRS code for my...
Hi We have a SSIS package that uploads data to Blob storage. The package...
I need only one backup full at mid night, and one backup log each...
Ask SSC