Sync SQL Server and Kafka in real time

• Adelia

  SSC-Addicted

  Points: 431

  More actions

  February 22, 2025 at 11:54 am

  #4543690

  Hello,

  1. Let say, my .NET API has been inserted successfully into SQL Server Database. It is possible, this data also inserted in Kafka in real time ?
  2. This transaction should be done in .NET API or should be done in SQL Server by configuration ?

  Please help me to understand more and better

• Site Owners

  SSC Guru

  Points: 80342

  More actions

  February 23, 2025 at 12:10 pm

  #4544209

  Thanks for posting your issue and hopefully someone will answer soon.

  This is an automated bump to increase visibility of your question.

• KonRob

  Grasshopper

  Points: 16

  More actions

  March 4, 2025 at 5:45 pm

  #4551127

  Yes, it's possible to sync SQL Server with Kafka in real time. You have two main approaches: handling it within your .NET API or configuring it directly in SQL Server.

  If you want real-time streaming directly from SQL Server, you can use SQL Server Change Data Capture (CDC) with Debezium to capture changes and stream them to Kafka. This setup requires Kafka Connect with the Debezium SQL Server connector.

  Alternatively, if you prefer handling it at the API level, you can modify your .NET API to publish events to Kafka whenever a new record is inserted into SQL Server. The best choice depends on your architecture, CDC is more seamless for existing databases, while API-level integration provides more control over event processing.