Click here to monitor SSC
SQLServerCentral is supported by Red Gate Software Ltd.
 
Log in  ::  Register  ::  Not logged in
 
 
 
        
Home       Members    Calendar    Who's On


Add to briefcase

Data sync between SQL VM in Azure and On Premises SQL Database Expand / Collapse
Author
Message
Posted Thursday, August 7, 2014 9:34 AM
Forum Newbie

Forum NewbieForum NewbieForum NewbieForum NewbieForum NewbieForum NewbieForum NewbieForum Newbie

Group: General Forum Members
Last Login: Friday, October 24, 2014 2:04 PM
Points: 2, Visits: 24
Hi Guys,

I need to figure out best way to address data syncing between database on SQL VM (in Azure env) and On premises sql databases.

We are going to have 6 different locations in china with on site SQL Servers and we will have one central SQL Server in Azure cloud to keep master data. They all will be connected through point-to-site vpn. On nightly basis, we will be feeding Onsite servers (inserts to table) from cloud server. and every 15 minutes, we need to update cloud server with changes that happened onSite server.
What is the best way to do it considering performance and lock situation on cloud server.

Thanks
Post #1600717
Posted Friday, August 15, 2014 6:11 AM


SSChampion

SSChampionSSChampionSSChampionSSChampionSSChampionSSChampionSSChampionSSChampionSSChampionSSChampion

Group: General Forum Members
Last Login: Today @ 4:31 PM
Points: 14,000, Visits: 28,381
You can set up a virtual network that allows you to treat the VMs as if they were part of your on-premises servers. Then, you have lots of choices. You can set up any of the standard methods for moving data around, including replication, availability groups, log shipping, whatever you think will work best. But start by getting the virtual network setup. Just remember, any method you use needs to take into account two issues, availability and latency. There is a likelihood of connection issues, so you have to have a good retry mechanism. And, depending on where your home base is, you're going to see latency. But neither of those should prevent you using just about any mechanism for moving the data around.

----------------------------------------------------
"The credit belongs to the man who is actually in the arena, whose face is marred by dust and sweat and blood..." Theodore Roosevelt
The Scary DBA
Author of: SQL Server Query Performance Tuning
SQL Server 2012 Query Performance Tuning
SQL Server 2008 Query Performance Tuning Distilled
and
SQL Server Execution Plans

Product Evangelist for Red Gate Software
Post #1603659
Posted Friday, August 15, 2014 6:37 AM
Forum Newbie

Forum NewbieForum NewbieForum NewbieForum NewbieForum NewbieForum NewbieForum NewbieForum Newbie

Group: General Forum Members
Last Login: Friday, October 24, 2014 2:04 PM
Points: 2, Visits: 24
Thanks Grant.

I did create a virtual network so that all my machines can talk to each other (cloud and oniste). I also tried SSIS, Bits and Azure Queues to transfer data. And it seems direct load using SSIS working the best. You are right regarding adding retry mechanism into our system. Will work on that next....

Post #1603676
« Prev Topic | Next Topic »

Add to briefcase

Permissions Expand / Collapse