Time-Series Data Analysis with Apache Druid
Learn the basics of Apache Druid and how it can be used to ingest data into a data lake.
2023-11-10
13,835 reads
Learn the basics of Apache Druid and how it can be used to ingest data into a data lake.
2023-11-10
13,835 reads
Learn about the evolutionary journey of ETL (Extract, Transform, Load) from traditional processes to modern cloud solutions.
2023-10-18
This article looks at manipulating data using Python to unpivot data received in a cross tab format.
2023-06-30
2,413 reads
A comparison of the lambda and kappa architectures for real time ingestion and analysis of big data.
2023-06-19
3,944 reads
This Python 3 script is designed to take CSV file data pasted into the csv_data variable and generate SQL insert statements that can be used to insert the data into a MySQL database. The script is easy to use and can save you a lot of time when working with large amounts of data.
2023-05-08 (first published: 2023-05-05)
2,165 reads
Data movement is a fundamental piece of a data engineer’s duties, and recently I’ve been thinking about the art of data movement. What are some of the most important pieces that a data engineer needs to think about when confronted with data ingestion? There is of course data exporting as well, and in that case, […]
2022-11-11
5,378 reads
2021-04-23
599 reads
An ETL issue with Excel causes issues, because the users didn't realize a limitation.
2020-10-19
282 reads
Learn how you can use Change Tracking to incrementally load data with Azure Data Factory
2022-04-18 (first published: 2020-10-13)
14,898 reads
Learn how you can use Polybase technology in Azure Synapse to load data into your warehouse.
2020-07-28
25,163 reads
By Steve Jones
Recently a customer asked how they could get index changes to be captured in...
By Steve Jones
giltwrights – n. the imaginary committee of elders that keeps a running log of...
By DataOnWheels
Hey folks, fun personal post today. A few weeks ago, I got married! My...
Hello, so I was reading on partitioning a large table, Which i successfully did,...
Can I authenticate with Active Directory and get into PostgreSQL? Version: PostgreSQL 16.1 on...
USE [DBName] SELECT QUOTENAME(SCHEMA_NAME(sOBJ.schema_id)) + '.' + QUOTENAME(sOBJ.name) AS [TableName] , SUM(sPTN.Rows) AS [RowCount]...