35 votes
Accepted

Sync two MySQL databases in two different locations

You have a few options: Set up MySQL replication between the servers. Your internal server can act as the Master, and the web host server as the slave. Any updates performed on the Master will be ...
user avatar
  • 1,282
14 votes
Accepted

Syncing two databases in SQL Server

Well I might not get it, but I try to answer it. You said you need a high performance solution which runs often (minimum all 2 minutes) and you need a good approach which should be fast without ...
user avatar
  • 2,161
13 votes
Accepted

Synchronization using triggers

1. Does the trigger follow the relational database's ACID principle? Is there any chance an insert might be committed but the trigger fail? This question is partly answered in a related question you ...
user avatar
  • 71k
9 votes

Syncing two databases in SQL Server

I will try to enumerate some options here with advantages and disadvantages as I percieve them: SQL Server Replication - this is the best and most optimized native SQL Server tool for this task. ...
user avatar
9 votes
Accepted

Is there a way to determine what kind of data is sitting in the Redo Queue for an AlwaysOn AG Secondary Replica?

The short answer is no, there is not a DMV that contains this information. It would be a significant amount of overhead for SQL Server to track what table was associated with each log record that had ...
user avatar
  • 7,773
8 votes

Offline to Online database synchronization programmatically using PHP and MySQL

Plan A: You charge your client an arm an leg to develop code to keep track of diffs, avoid dup keys, upload data, etc. Plan B: Multi-source replication (available at least in MariaDB). With Multi-...
user avatar
  • 68.7k
7 votes
Accepted

Post Mortem Analysis: PostgreSQL replication failed

Based on this I'd say you didn't have enough wal_keep_segments on the master, weren't using a replication slot, and either had hot_standby_feedback off or had the connection drop for long enough for ...
user avatar
  • 52.1k
5 votes
Accepted

org.postgresql.util.PSQLException: ERROR: canceling statement due to conflict with recovery

What you see is a common experience for anyone running standbys and bigger queries on the master. There are a couple of possible causes: There are also additional types of conflict that can occur ...
user avatar
  • 28.9k
5 votes
Accepted

What's the cause for an AlwaysOn AG Secondary Replica to have a high Redo Queue Size and Estimated Recovery Time with a good Redo Rate?

So a number of things here... (e.g. this will be a long answer and may go through a number of iterations): First and foremost did this AG experience a failover? If not, then checking the ERRORLOGs ...
user avatar
5 votes

Is partial synchronisation possible between two databases on different servers?

The only built-in data synchronization technology that meets your requirements, I think, is Transactional Replication. See the FAQ on replication: How do I add or change indexes on publication and ...
user avatar
  • 27.2k
4 votes

Sync two MySQL databases in two different locations

You can also use options like symmetricDS which can help in synchronizing two databases. With this you will be able to select the tables which needs to be synchronized that way you can save internet ...
user avatar
4 votes

Checking existence and syncing data with millions of rows

I would not design a system to do lookups on the fly. Instead I would design the system to validate if a given number is on the DND list at the time the number is added to your system, and weekly (...
user avatar
  • 67.2k
4 votes
Accepted

MongoDB replication: going into maintenance mode with 10333 other maintenance mode tasks in progress

What are maintenance mode tasks? The "maintenance mode tasks" message is referring to a counter of successive calls to the replSetMaintenance command and (as at MongoDB 3.4) isn't associated with ...
user avatar
  • 9,805
3 votes

How to auto replicate specific columns only from a table in MySQL

Why not create one separate db for your SSO, which is accessible for each site? Copying data around will create problems when two sites are editing "the same field". If you only want to use a copy to ...
user avatar
  • 39
3 votes

Scaling out SQL Server and syncing data across multiple machines

Creating a Scale Out database at Internet scale is pretty huge step. You will face a lot of issues that are not critical on a single big database. From your notes I see that you understand some of the ...
user avatar
  • 13.8k
3 votes

Sync two SQL Server databases

SQL Server replication, creates jobs which runs through SQL Server Agent, but because SQL Server Agent doesn't run with SQL Server Express Edition, Replication also can not run and the feature is not ...
user avatar
3 votes

Sync data in SQL Server 2014 with Oracle database12c

You have a few options: Transactional replication: this has been around for quite some time and works nicely within its narrowly defined scenario. Unfortunately, the use of non-SQL Server subscribers ...
user avatar
  • 1,435
3 votes

Are expdp/impdp commands appropriate for daily schema sync?

No, that is not a possible way: Most of the non-table objects will already exist in your schema. You already get such error messages. The import will not overwrite it. You can configure how ...
user avatar
  • 7,441
3 votes

Instant synchronization of multiple SQL servers

I may be understanding this slightly wrong so I apologise if I am. If you have two databases that you need to be identical and are on 2014 then use the AlwaysOn High Availability Group. Since you're ...
user avatar
  • 1,951
3 votes

How do I synchronize rows in tables in remote databases?

If the GUID is the absolute truth about what is supposed to match, then the GUID must be the PRIMARY KEY. Get rid of id. If you want semi-automated "conflict resolution based on time", you want ...
user avatar
  • 68.7k
3 votes

Sync two databases on different servers

User acceptance testing (UAT) usually involves clicking around in an application, which usually means making changes and testing them. This is especially true if you think you're going to "replicate ...
user avatar
  • 41.4k
3 votes
Accepted

Azure SQL Database in different locations

Based on your scenario Data Sync is the best fit. It's the only Azure PaaS solution for Data Synchronizaion. Transactional replication is supported for on-premise to Azure. If sync in this direction ...
user avatar
  • 46
3 votes

Keeping database in synch

No. In order for a log to be restored to a database, the log sequence number (LSN) of the log has to be the correct number to match what the database requires for the next log to be restored. If you ...
user avatar
  • 7,773
3 votes
Accepted

Problems of having DR as Synchronous Commit

If i want to change the DR to Synchronous Commit will there be any performance issues ? Well, it will take longer to commit transactions, as the primary will wait for the log records to be saved on ...
user avatar
3 votes
Accepted

Load data from a temporal table to another temporal table in Azure

You have two interacting problems here: transferring data between Azure databases, and updating data maintained by system versioning. And possibly a third: live data in dev. Transferring Data in ...
user avatar
3 votes
Accepted

Will a MERGE between two tables ever be faster than a DROP and SELECT INTO on the second table?

Will a MERGE between two tables ever be faster than a DROP and SELECT INTO on the second table? I think, in general, I'd say probably not. But it depends on a lot of factors. Bulk Loading (minimal ...
user avatar
  • 27.2k
3 votes

what are the best ways to sync two databases in sql server or azure sql db?

You seem to want to do data replication in almost real-time. Why haven’t you considered SQL Server data replication or even better, an availability group? Our data warehouse is setup as a cluster-less ...
user avatar
  • 351
3 votes

How to ship new rows from the source to a target server?

It sounds like in this case, a simpler solution might be best for you, such as scheduling a daily SQL Agent job that INSERTS INTO the Target Database's Table the 10 million rows you need from your ...
user avatar
  • 24.6k
3 votes

Is partial synchronisation possible between two databases on different servers?

This is possible if your synchronization methodology is via the Replication features of SQL Server, such as with Transactional Replication. One minor limitation though is any schema bound objects (...
user avatar
  • 24.6k
2 votes

Sync postgreSQL with SQL Server database- on data change event

A tool like Daffodil Replicator or SymmetricDS is designed to sync between different brands of databases. You could try the tds_fdw Foreign Data Wrapper, which may be able to write to SQL Server.
user avatar

Only top scored, non community-wiki answers of a minimum length are eligible