Python 3 Script for Generating SQL Insert Statements from CSV Data

This Python 3 script is designed to take CSV file data pasted into the csv_data variable and generate SQL insert statements that can be used to insert the data into a MySQL database. The script is easy to use and can save you a lot of time when working with large amounts of data.

The Art of Data Ingestion - Part 1

Data movement is a fundamental piece of a data engineer’s duties, and recently I’ve been thinking about the art of data movement. What are some of the most important pieces that a data engineer needs to think about when confronted with data ingestion? There is of course data exporting as well, and in that case, […]

Parquet

Chopping Off Data

An ETL issue with Excel causes issues, because the users didn't realize a limitation.

Incremental Data loading through ADF using Change Tracking

Learn how you can use Change Tracking to incrementally load data with Azure Data Factory

Access external data from Azure Synapse Analytics using Polybase

Learn how you can use Polybase technology in Azure Synapse to load data into your warehouse.

Provisioning ADF - Level 2 of the Stairway to Azure Data Factory

In this next level of the Stairway to Azure Data Factory, learn how to build your first ADF environment.

Data Transfer Strategies between MongoDB and SQL Server

There are a variety of days to move data between MongoDB and SQL Server. This article covers some of your options and gives you ideas on which method might work best for you.

Preventing Invalid Data Early In An ETL Flow

In this post, Tim Smith will look at some of the considerations for both data rules and logic to prevent invalid data early in the ETRL process.

3 Solutions For Auditing Long SQL Server Extracts or Loads

In this post, Tim Smith looks at the different options you can use to audit your SQL Server extracts and loads during the ETL process.