Time-Series Data Analysis with Apache Druid
Learn the basics of Apache Druid and how it can be used to ingest data into a data lake.
2023-11-10
14,166 reads
ETL (Extract Transform and Load)
What I Wish Everyone Knew About ETL Processes - Traditional to Modern Cloud Solutions
Learn about the evolutionary journey of ETL (Extract, Transform, Load) from traditional processes to modern cloud solutions.
2023-10-18
Unpivot Data Using Python
This article looks at manipulating data using Python to unpivot data received in a cross tab format.
2023-06-30
2,744 reads
Advantages of Kappa architecture in the Modern Data Stack
A comparison of the lambda and kappa architectures for real time ingestion and analysis of big data.
2023-06-19
4,438 reads
Python 3 Script for Generating SQL Insert Statements from CSV Data
This Python 3 script is designed to take CSV file data pasted into the csv_data variable and generate SQL insert statements that can be used to insert the data into a MySQL database. The script is easy to use and can save you a lot of time when working with large amounts of data.
2023-05-08 (first published: 2023-05-05)
3,478 reads
The Art of Data Ingestion - Part 1
Data movement is a fundamental piece of a data engineer’s duties, and recently I’ve been thinking about the art of data movement. What are some of the most important pieces that a data engineer needs to think about when confronted with data ingestion? There is of course data exporting as well, and in that case, […]
2022-11-11
5,649 reads
2021-04-23
605 reads
Chopping Off Data
An ETL issue with Excel causes issues, because the users didn't realize a limitation.
2020-10-19
283 reads
Incremental Data loading through ADF using Change Tracking
Learn how you can use Change Tracking to incrementally load data with Azure Data Factory
2022-04-18 (first published: 2020-10-13)
15,298 reads
Access external data from Azure Synapse Analytics using Polybase
Learn how you can use Polybase technology in Azure Synapse to load data into your warehouse.
2020-07-28
26,559 reads
Blogs
Redgate Summit Comes to the Windy City
By Steve Jones
I love Chicago. I went to visit three times in 2023: a Redgate event,...
Non-Functional Requirements
By Brian Kelley
I have found that non-functional requirements (NFRs) can be hard to define for a...
Techorama 2024 – Slides
You can find the slidedeck for my Techorama session “Microsoft Fabric for Dummies” on...
Forums
AG listener cant be removed
Testing with AG on Linux with Cluster=NONE. it was all going ok and as...
Remove comma inside Comma Delimited File csv in SSIS Using Script task
Hi, I have two tables: one for headers with 9 fields and another for...
Inserting 100K rows Performance - Baseline Performance
We're trying to understand how quick new versions of SQL server can be. Obviously...
Question of the Day
The "ORDER BY" clause behavior
Let’s consider the following script that can be executed without any error on both SQL Sever and PostgreSQL. We define the table t1 in which we insert three records:
create table t1 (id int primary key, city varchar(50)); insert into t1 values (1, 'Rome'), (2, 'New York'), (3, NULL);If we execute the following query, how will the records be sorted in both environments?
select city from t1 order by city;See possible answers