Revolutionizing Real-Time Data Management with SQL Server, Kafka, and Informatica
This article examines how one can structure a pipeline for processing real-time data using Kafka and Informatica.
2023-04-26
4,250 reads
This article examines how one can structure a pipeline for processing real-time data using Kafka and Informatica.
2023-04-26
4,250 reads
SQL Server Integration Services (SSIS) has been the de facto ETL tool for over 15 years for DBAs, Developers and Business Intelligence Professionals to extract, transform and load data (i.e. ETL tasks) for specific business processes, data-centric applications, data warehousing, reporting and data exchange between organizations. SSIS is a great product with high adoption across the globe, but has some limitations related to modern data sources, performance and streamlining tedious tasks. How can we overcome these limitations and have SSIS provide greater value?
2023-04-10
There are many ways to load data into a SQL Server database. In this article, Greg Moore demonstrates how to get PowerShell to do more of the work.
2021-10-11
There is a Power Query activity in SSIS and Azure Data Factory, which can be more useful than other tasks in some situations.
2021-07-26
4,221 reads
This article will describe how to add your local timestamp at the end of the each file in Azure Data Factory (ADF). In general, ADF gets a UTC timestamp, so we need to convert the timestamp from UTC to EST, since our local time zone is EST. For example, if the input Source file name […]
2021-04-22
27,194 reads
Overview of ETL Architecture In a data warehouse, one of the main parts of the entire system is the ETL process. ETL is the system that reads data from the source system, transforms the data according to the business logic, and finally loads it into the warehouse. While fetching data from the sources can seem […]
2019-10-21
13,670 reads
By DataOnWheels
Over the past couple of months, I have started losing my ability to talk...
By Steve Jones
apolytus– n. the moment you realize you are changing as a person, finally outgrowing...
If you've ever wrestled with complex SQL code, you know the drill. Hours spent...
Comments posted to this topic are about the item Do you listen to music...
I have a job running each night starting at 4:30AM and usually finishing at...
hi guys, I have a partitioned table AM_ITM_INSTNC_MSS and I want to get...
Our environment runs using SQL Server Standard. We are implementing Availability groups. Our database has been experiencing high read volumes, so I want to let the application read the Synchronized Secondary replica, as I read that HADR does this. Can we implement this?
See possible answers