SQL Clone
SQLServerCentral is supported by Redgate
 
Log in  ::  Register  ::  Not logged in
 
 
 


Data sync between SQL VM in Azure and On Premises SQL Database


Data sync between SQL VM in Azure and On Premises SQL Database

Author
Message
Suezy
Suezy
SSC-Enthusiastic
SSC-Enthusiastic (189 reputation)SSC-Enthusiastic (189 reputation)SSC-Enthusiastic (189 reputation)SSC-Enthusiastic (189 reputation)SSC-Enthusiastic (189 reputation)SSC-Enthusiastic (189 reputation)SSC-Enthusiastic (189 reputation)SSC-Enthusiastic (189 reputation)

Group: General Forum Members
Points: 189 Visits: 138
Hi Guys,

I need to figure out best way to address data syncing between database on SQL VM (in Azure env) and On premises sql databases.

We are going to have 6 different locations in china with on site SQL Servers and we will have one central SQL Server in Azure cloud to keep master data. They all will be connected through point-to-site vpn. On nightly basis, we will be feeding Onsite servers (inserts to table) from cloud server. and every 15 minutes, we need to update cloud server with changes that happened onSite server.
What is the best way to do it considering performance and lock situation on cloud server.

Thanks
Grant Fritchey
Grant Fritchey
SSC Guru
SSC Guru (162K reputation)SSC Guru (162K reputation)SSC Guru (162K reputation)SSC Guru (162K reputation)SSC Guru (162K reputation)SSC Guru (162K reputation)SSC Guru (162K reputation)SSC Guru (162K reputation)

Group: General Forum Members
Points: 162691 Visits: 33199
You can set up a virtual network that allows you to treat the VMs as if they were part of your on-premises servers. Then, you have lots of choices. You can set up any of the standard methods for moving data around, including replication, availability groups, log shipping, whatever you think will work best. But start by getting the virtual network setup. Just remember, any method you use needs to take into account two issues, availability and latency. There is a likelihood of connection issues, so you have to have a good retry mechanism. And, depending on where your home base is, you're going to see latency. But neither of those should prevent you using just about any mechanism for moving the data around.

----------------------------------------------------
The credit belongs to the man who is actually in the arena, whose face is marred by dust and sweat and blood...
Theodore Roosevelt

The Scary DBA
Author of: SQL Server Query Performance Tuning and SQL Server Execution Plans
Product Evangelist for Red Gate Software
Suezy
Suezy
SSC-Enthusiastic
SSC-Enthusiastic (189 reputation)SSC-Enthusiastic (189 reputation)SSC-Enthusiastic (189 reputation)SSC-Enthusiastic (189 reputation)SSC-Enthusiastic (189 reputation)SSC-Enthusiastic (189 reputation)SSC-Enthusiastic (189 reputation)SSC-Enthusiastic (189 reputation)

Group: General Forum Members
Points: 189 Visits: 138
Thanks Grant.

I did create a virtual network so that all my machines can talk to each other (cloud and oniste). I also tried SSIS, Bits and Azure Queues to transfer data. And it seems direct load using SSIS working the best. You are right regarding adding retry mechanism into our system. Will work on that next....
Go


Permissions

You can't post new topics.
You can't post topic replies.
You can't post new polls.
You can't post replies to polls.
You can't edit your own topics.
You can't delete your own topics.
You can't edit other topics.
You can't delete other topics.
You can't edit your own posts.
You can't edit other posts.
You can't delete your own posts.
You can't delete other posts.
You can't post events.
You can't edit your own events.
You can't edit other events.
You can't delete your own events.
You can't delete other events.
You can't send private messages.
You can't send emails.
You can read topics.
You can't vote in polls.
You can't upload attachments.
You can download attachments.
You can't post HTML code.
You can't edit HTML code.
You can't post IFCode.
You can't post JavaScript.
You can post emoticons.
You can't post or upload images.

Select a forum







































































































































































SQLServerCentral


Search