Questions tagged [replication]
Replication is the process of sharing any level of information so as to ensure consistency between redundant hardware/software resources to improve reliability, fault-tolerance, and accessibility
922
questions with no upvoted or accepted answers
6
votes
0
answers
5k
views
AWS RDS Postgres Logical replication
I am using AWS RDS Postgres's and RDS's logical replication support
(Edit: Note, this is not the same as the logical replication featurein PostgreSQL 10. It's AWS RDS functionality based on the same ...
- 61
5
votes
1
answer
1k
views
postgresql: Replaying of streaming WAL files is slow on some standby servers
Environment: Postgresql 9.6.21.
Multiple standby servers managed by patroni
+ Cluster: db11 (12345678901234567) ------+---------+-----+-----------+
| Member | Host | Role | ...
- 157
5
votes
3
answers
1k
views
advantages of single-leader (transactions) over multi-leader replication
I am reading the excellent book "Designing Data-Intensive Applications" which I wholeheartedly recommend, but I'm confused by a section comparing multi-leader (i.e. multi-writer) replication to single-...
- 213
5
votes
0
answers
1k
views
Setup to allow creating new tables in PostgreSQL replica
My goal is to create a replica of an existing database that would allow me to create new tables and populate them. I don't care about writes to replicated tables - those can and probably should throw ...
- 51
5
votes
1
answer
2k
views
Replication stops with GTID_NEXT error after creation/drop of memory table in mysql5.6
We have recently upgraded to mysql5.6.25 from mysql5.5.x/mysql5.1.x on our mysql-cluster.
Below is a brief snapshot of our architecture.
Since we have upgraded and enabled gtid-mode we have been ...
- 51
5
votes
1
answer
512
views
Mysqlfailover command - No slave is listed in health status
I have successfully created replication using GTID_MODE. It works perfectly. Now I need to setup automatic failover feature in it. I have run the following command.
mysqlfailover --master=root:abc@10....
- 51
5
votes
1
answer
6k
views
Postgres Streaming Replication: How to re-sync data in master (with standby) after failover
I am absolutely new to postgres 9.1 replication mechanisms.
I have managed to set up streaming replication between a master and standby postgres (Both have x number of records). At one point when ...
- 51
4
votes
0
answers
1k
views
MySQL replication - Follower stuck and behind
I understand there are lots of similar problems and threads but non of those solution helped me. Please read through the thread I will try to give as much information as possible:
I have setup a ...
- 141
4
votes
0
answers
2k
views
SQL Server Replication Administrative Password not working
I have been struggling for the past one week to setup the replication in our environment and has been stuck on Administrative Password issue when adding Distributor on Publisher Server.
Important ...
- 325
4
votes
1
answer
1k
views
Why is restart_lsn not set, even on checkpoint - postgresql
A logical slot will emit each change just once in normal operation.
The current position of each slot is persisted only at checkpoint, so
in the case of a crash the slot may return to an earlier ...
- 165
4
votes
0
answers
734
views
How to get the Slave commit timestamp using MySql replication?
I've been looking for ways to collect information about the replication delays on MySql 8. I found an alternative solution, but I imagine there's a more straightforward way to do that.
By reading its ...
- 41
4
votes
2
answers
693
views
SQL Replication - Distribution database backlog of commands for one table
Our infrastructure is as follows:
Publisher on Live db server, Distibutor and subscriber on our mirror server.
Basically yesterday we were doing archiving on a huge table on our live server, (...
- 141
4
votes
0
answers
792
views
What's the best practice when deploying Redis replication cluster on 2 data centers connected by MPLS?
I deployed Redis replication cluster on 2 data centers (ping time between 2 DCs is around 1ms).
I used Master (Node1 on DC 1) - Slave (Node2 in DC2) replication model and Sentinel to control ...
- 41
4
votes
0
answers
8k
views
Slave is not configured or failed to initialize properly. You must at least set --server-id to enable either a master or a slave
I am trying to setup multi source replication. In my slave I have defined following two properties in its configuration file.
master-info-repository=table
relay-log-info-repository=table
These ...
- 451
4
votes
1
answer
2k
views
SymmetricDS Setup - SQL Server 2008 to MySQL
I need to replicate just a couple of tables from a Microsoft SQL Server 2008 database to a MySQL 5.7 database (one-way only). I've been struggling to find a simple solution.
I've ultimately decided ...
- 41
4
votes
1
answer
569
views
Write-lock a whole table during transaction
I need to perform a delicate operation to my table in which I will solely insert, delete and select upon all of my rows and no God may interfere with the table during this operation: the table will be ...
- 141
4
votes
1
answer
1k
views
MongoDB can't add new replica set member [rsSync] SEVERE: Got signal: 6
I have a replica set and I added a new member to the set. The initialSync begins for the new member and rs.status (on primary) shows STARTUP2 as status. However, after a long enough time, there's a ...
- 253
4
votes
1
answer
664
views
mysql replication missed quite a lot SQL statement
I have set up a master/slave with mysql-5.1.73
The master's binlog format is "statement".
The master and slave seemed running very well with slave status:
Slave_IO_Running: Yes
...
- 141
4
votes
0
answers
313
views
Conflict handling, SQL Server 2008 R2 Peer to Peer
I have a Peer to Peer replication topology set up between two SQL Server 2008 R2 servers. I was doing some testing on fault tolerance and conflict handling. I have conflict detection enabled, and ...
- 169
4
votes
0
answers
564
views
SQL Server 2008 replication scenario
First of all sorry about my english, and most importantly, my database ignorance, I'll do my best ;)
Until now, the scenario that I have is as follows:
In a server under our LAN, we have a database ...
- 41
4
votes
1
answer
4k
views
Postgresql 11: terminating walsender process due to replication timeout
I have found some questions about the same error, but didn't find any of them answering my problem.
The setup is that I have two Postgres11 clusters (A and B) and they are making use of publication ...
- 121
3
votes
1
answer
122
views
How do distributed databases follow unique constraints?
Lets say i have an application where user can register, and the username has to be unqiue value.
Now lets say i have N partitions and for each partition i have M replicas with multiple leaders.
Now i ...
- 131
3
votes
0
answers
92
views
More low-level faster replication schemes for PostgreSQL?
From this question: in PostgreSQL REPMGR Master-Slave environment is it necessary to have same H/W config for HOT STANDBY setup?, I was reminded of my experience and disappointment with the hot-...
- 493
3
votes
0
answers
3k
views
Replication instantly fails with 1032 error; Coordinator stopped because there were error(s) in the worker(s)
I have two databases, which I'm attempting to configure in a master-slave relationship (the eventual goal is to set them as master-master, but I'll settle for getting master-slave working at this ...
3
votes
0
answers
248
views
Logical Replication/Foreign Data Wrapper Connectivity between Two Aurora Serverless Databases (PostgreSQL 10.7)
I have two Aurora PostgreSQL Serverless databases running in the same region and have PostgreSQL version 10.7. I'm wondering if logical replication is available? The official docs say that it's ...
- 131
3
votes
0
answers
2k
views
MySQL Slave SQL Running State - "Waiting for dependent transaction to commit" confusion
I'm trying to debug a replication lag issue.
We have a job that we run over the weekend, where we delete a large number of rows (potentially millions) from a table, currently in batches of 100. While ...
- 83
3
votes
0
answers
238
views
Is binary log purging done by expire_logs_days equivalent to PURGE BINARY LOGS?
In a MySQL replication environment where replication is done with binary logs, if you run PURGE BINARY LOGS on the master, the server will not delete logs that are currently being replicated by a ...
- 131
3
votes
0
answers
5k
views
MySQL RDS Incompatible Restore while creating read replica
We have multiple m5 generation MySQL RDS instance. The problem we are facing is that while creating read replica for these instances we are repeatedly getting 'incompatible-restore' error. In the ...
- 438
3
votes
0
answers
9k
views
ERROR 1794 (HY000): Slave is not configured or failed to initialize properly
This is my my.cnf file:
[mysqld]
server_id = 1
log_bin = /var/log/mysql/mysql-bin.log
log_bin_index = /var/log/mysql/mysql-bin.log.index
relay_log = /var/log/...
3
votes
0
answers
112
views
Should I use Transactional Replication here?
I have a database on SQL Server A & one on SQL Server B. (SQL 2017 w/ enterprise) They share similar objects and need to be kept fairly up to date. Both will require changes to be passed to each ...
- 620
3
votes
0
answers
511
views
Postgres Replication out of sync
We have master server on one Datacenter, and the Replicate is in another Datacenter
Intermittently, on the replicate server, we see this as below.
“2018-12-19 07:24:25 UTC: : @: [25775]: [2-1] ...
- 31
3
votes
0
answers
2k
views
SQL SERVER database replication primary primary
I currently run a c# web app with one SQL server (2016) database. However due to latency with the world (our server are currently in China), we were wondering the path to follow in order to be able to ...
3
votes
0
answers
576
views
Replication doesn't resume once it fails to connect
We have MySQL replication running for our application. Right now the slave fails to resume if it fails to connect to the server for some time.
We get the error below:
[ERROR] Slave I/O: error ...
- 89
3
votes
0
answers
63
views
Is sp_stoppublication_snapshot considered a undocumented procedure or is my searching just bad?
I am trying to start and stop the replication snapshot via t-sql. I found sp_startpublication_snapshot, and doing a trace while hitting the stop on the snapshot from inside SSMS I see it calls ...
- 1,045
3
votes
0
answers
778
views
Merge replication subscriptions are repeating the same actions endlessly
We have a merge publication set up on SQL Server 2008R2, with several subscribers. Synchronisation is done through the internet.
Over the last few days, some subscribers are unable to synchronise.
In ...
- 245
3
votes
0
answers
1k
views
Mariadb multi-master replication with old gtids
I have a multi-master replication setup up and running well in MariaDB. Each node has its own server-id and gtid_domain_id and is set up with its own master-slave and slave-master (two-way) ...
- 31
3
votes
0
answers
494
views
Is it good practice to have multiple keyspaces in Cassandra?
I've Cassandra configured on Amazon EC2 having 3 nodes(instances) in single cluster. Now what I want to do is give some space on Cassandra to my clients by creating separate keyspace for each in a ...
- 79
3
votes
1
answer
577
views
How did you setup MySQL Replication with autofailover that is app transparent?
Recently told MySQL is shelving MySQL Fabric. Interested how others have implemented a MySQL replicated environment that is app transparent.
I am considering using HA Proxy to host virtual IP ...
- 31
3
votes
1
answer
508
views
Download the replication snapshot file using FTPS
I have two databases for two companies. Company A's database contains domain data. The other company is pulling the data using snapshot replication. We have used FTP to communicate:
Created FTP ...
3
votes
1
answer
7k
views
MySQL replication: slave is not getting data from master
My problem is that all setup is done for MySQL replication but the slave is unable to sync the master's data. To understand I am sharing link below; please visit.
mysql> SHOW SLAVE STATUS \G;
****...
- 31
3
votes
0
answers
2k
views
"The schema script could not be propagated to the subscriber" error has SQL code instead of file name
This type of error is unfortunately not uncommon. One report of many is this one on Stack Overflow: https://stackoverflow.com/questions/11360331/sql-server-merge-replication-error-the-schema-script-...
- 245
3
votes
0
answers
495
views
Recovery from Live to a new Slave Server - PostgreSQL - ERROR
I've started a new SLAVE PostgreSQL server set up.
master: 192.168.100.1
slave1: 192.168.100.2
slave2(NEW SLAVE) 192.168.100.3
* NOTE: I run the pg_basebackup from another STANDBY SERVER. Not from ...
- 31
3
votes
0
answers
887
views
transaction replication causing too many deadlocks after adding a indexed view - what to monitor in order to avoid this?
I have created the following indexed view and its clustered index:
This view was created on a subscriber database and all the tables used in the view are constantly being written to through the ...
- 16.4k
3
votes
0
answers
860
views
MongoDB user account required for arbiter?
I have a test environment with two mongo v2.6.5 instances (#1, #2) and an arbiter instance in a replica set. I have a a common key file configured for all three instances. I have created an admin ...
- 131
3
votes
0
answers
378
views
PostgreSQL Streaming Replication Tools - Windows
Is there any clusterware available for PostgreSQL clusters running on Windows OS? I'm specifically interested in automatic failover and STONITH functionality. I've done a fairly extensive Google ...
3
votes
0
answers
486
views
SQL Job Step created via wizard does not correctly set server & database_name values
I've recently been tasked with migrating a database from SQL Server 2005 to 2008R2. This has all been accomplished without any issues, but one part of the system requires a Snapshot Replication to be ...
- 31
3
votes
1
answer
9k
views
Permanent count of waiting tasks (2) in Activity monitor
Now I'm observing in Activity Monitor permanent count of waiting tasks:
and at "Resource waits" tab I see next:
so, my question is: How to find and resolve this wait tasks?
I suspect that it ...
- 169
3
votes
0
answers
710
views
Recovery when failover
1/ Description:
I have 2 Centos machine: master, slave (streaming replication). Both of them are built on PostgreSQL 9.3 (image below) and configured failover event (failover PG 9.3 document).
Last ...
- 1,982
3
votes
0
answers
2k
views
SQL Replication With Always On Availability Group
We have an always-on SQL 2012 availability group with two replica servers and an AG listener.
Doing merge replication via anonymous subscriptions through IIS between SQL and multiple remote clients ...
- 131
3
votes
0
answers
777
views
How can I avoid breaking Postgres sync replication when building a large index?
We have pairs of Postgres 9.2 servers using synchronous replication. Sometimes rebuilding an index on a large table will break replication due to WAL segments not being kept around long enough. We are ...
- 471