Revolutionizing Real-Time Data Management with SQL Server, Kafka, and Informatica
This article examines how one can structure a pipeline for processing real-time data using Kafka and Informatica.
2023-04-26
4,715 reads
This article examines how one can structure a pipeline for processing real-time data using Kafka and Informatica.
2023-04-26
4,715 reads
Whether you work as a Data Engineer or a Data Scientist, a Jupyter Notebook is a helpful tool. One of the projects I was working required a comparison of two parquet files. This is mainly a schema comparison, not a data comparison. Though the two .parquet were created from two different sources, the outcome should […]
2021-05-17
5,516 reads
This article will describe how to add your local timestamp at the end of the each file in Azure Data Factory (ADF). In general, ADF gets a UTC timestamp, so we need to convert the timestamp from UTC to EST, since our local time zone is EST. For example, if the input Source file name […]
2021-04-22
30,375 reads
Introduction I recently passed the Google Cloud Professional Data Engineer certification exam, Professional Data Engineer Certification. It took me about five month to prepare for this, and I would like to share my thoughts of why I decided to take it on and how I prepared for it. At the moment, Google cloud (GCP) is […]
2021-03-15
9,793 reads
Say you need outside help. You’ve exhausted all the things that you could do...
I’m honored to announce that I’ve been renewed as a Microsoft MVP for the...
By Arun Sirpal
Until now, a CRITICAL finding did the right internal routing, but the last mile...
I installed a new SQL server 2025 Enterprise developer edition for our development environment....
Comments posted to this topic are about the item How Clustering can be Used...
Comments posted to this topic are about the item Moving the Error Log
How can I change the location in which the SQL Server error log is written in SQL Server 2025?
See possible answers