Questions tagged [replication]

Replication is the process of sharing any level of information so as to ensure consistency between redundant hardware/software resources to improve reliability, fault-tolerance, and accessibility

Filter by
Sorted by
Tagged with
0 votes
0 answers
30 views

MySQL 8.0.31 replications fails when running in docker container?

Since a couple of days I'm trying (unsuccessfully) to start a replication between two MySQL 8.0.31 running each in a docker on a custom port. This always fails with (Original Post): Last_IO_Errno: ...
  • 111
1 vote
1 answer
29 views

Workaround logical replication & FOR EACH STATEMENT triggers

We are using logical replication to sync data into a table. Perfect solution so far! The problem now is we need triggers on this subscriber table. Those triggers make heavy calculations (think of ...
  • 111
0 votes
1 answer
49 views

MySQL replication fails with permission error for unknown reason

Since 36h I'm struggling to setup a simple Master <-> Master replication with MySQL 8. None of the found solutions on the Internet works here and meanwhile I'm a bit desperate. Even the first ...
  • 111
0 votes
0 answers
18 views

Can PostgreSQL bulk update cause issue in Logical replication?

I use AWS Aurora PostgreSQL. PS version:13(updated the question) We use Logical slots(wal2json) to replicate to the data warehouse. Recently one of the Bulk updates queries updated 40 million rows. ...
  • 1,738
0 votes
1 answer
26 views

Read Replica block queries postgres

I've RDS PostgreSQL DB with read-replica. Also, have one script which frequently checks the blocking query but I faced one issue yesterday where the blocking query was a startup(backend_type)process ...
0 votes
2 answers
21 views

Internal Paramaters on sp_MSdel<TableName>, sp_MSins<TableName>, sp_MSupd<TableName>

The following procedures sp_MSdel, sp_MSins, sp_MSupd are the outcome of an configured publication/subscription on SQL Server. These procedures let you do small transformations inside them so the ...
1 vote
1 answer
49 views

Error in the documentation MariaDB -> mysqlbinlog: `--rewrite-db` and `--database`

In the mysqlbinlog utility documentation, the --rewrite-db=name option has the following explanation Filtering (e.g. with --database=name ) happens AFTER the database rewrites have been performed. ...
  • 453
0 votes
0 answers
17 views

pg_replication_origin_status returns NULL external_id

When i run pdns=# select * from pg_replication_origin_status ; local_id | external_id | remote_lsn | local_lsn ----------+-------------+------------+----------- 2 | | 0/7D56538 | ...
1 vote
2 answers
28 views

Change Tracking SYS_CHANGE_COLUMNS on Update operation

I would like to get an understanding of why on an update operation in the change tracking table, the SYS_CHANGE_COLUMNS can be NULL. I would expect the SYS_CHANGE_COLUMNS will be populated. In the ...
  • 21
1 vote
1 answer
20 views

Does hidden priority-0 replica count when calculating fault tolerance?

We have a mongdodb cluster with 3 replicas in one. We are planning to add one more replica on cloud. The replica on cloud is set as hidden and priority-0. If we include the hidden the total no. of ...
0 votes
1 answer
13 views

SQL Server 2016 Transactional Replication with Service packs on 2 Servers

Transactional replication: If Server A has Publisher and Distributor with SQL Server Service pack 1 and Server b is Subscriber with SQL Server 2016 service pack 2 Does publisher and distributor (SQL ...
  • 3
0 votes
1 answer
25 views

SQL Server Merge Replication bulk delete leaves subscriber databases large

We have SQL Server 2017 merge replication set up with three subscribers (running SQL Server 2017 Express). We need to clear data from the server database occasionally to reduce the database size at ...
1 vote
1 answer
37 views

Merging data from identical tables from multiple databases into one larger table. N-1 table replication

There are N databases with identical table structures in a multitenant, multi-database system. The desire is to replicate a table(s) from these databases into a single larger table in a OLAP database, ...
  • 431
0 votes
1 answer
26 views

Backup master - slave replication

On a master-slave replication setup (1 master with 2 slaves. the slaves are hot standby in case the master fails). How can I do a backup under normal circumstances? Are all nodes are backed up ...
  • 65
1 vote
1 answer
21 views

Schedule replication overnight

I have a MySQL database, where approximately 3.5 million entries are been inserted/updated daily. For some heavier data analysis I would like to create a replica. Is it possible to schedule the ...
  • 13
0 votes
2 answers
28 views

How to perform mysqldump and import simultaneously?

I have a master database and a slave one. Recently, the slave has not synced with the master. So, I tried running mysqldump command to the master: mysqldump -h <master_host> -u <user> -p &...
  • 3
0 votes
0 answers
24 views

Multi master with some slaves vs single master with some slaves

I need some advice on architecture. I have a national database that relies on postgres and some architectural design that involves orchestrating several components, very much similar to the picture ...
  • 65
1 vote
1 answer
30 views

MySQL 8 replication: is it possible to specify master side a specific port for replication, and only replication (different than the default 3306)

Master side. In MySQL 8 for the replication, is it possible to specify master side a specific port for replication, and only replication that is different than the default 3306 where regular clients ...
  • 411
0 votes
1 answer
42 views

Mongodb replica stuck at STARTUP

I have 4 Servers: Mongo1(with secondary and arbiter), Mongo2(primary). Mongo3, Mongo4 Mongo1 and Mongo2 were initiated and successfully running for months. (1 and 2 + arbiter are connected over the ...
0 votes
0 answers
18 views

In Redis, using "SLAVEOF NO ONE" command reverts back after a few seconds

I have a redis slave that I need to remove from replication and make a master. I've tried running both "SLAVEOF NO ONE" and "REPLICAOF NO ONE." Those commands work for a few ...
2 votes
1 answer
25 views

GTID replication from a MySQL 5.7.38 Master to MariDB 10.6.10?

Is it possible to use GTID in a replication scenario where MySQL 5.7.38 is the master and MariaDB 10.6.10 is the slave?
  • 23
-1 votes
0 answers
15 views

Migration from RDS Postgres 11 to 14

I am following fall-forward architecture to split our application from a shared RDS Postgres to another aws account. Current source RDS is postgres 11.5, since i need to create new RDS for the split, ...
  • 9
0 votes
0 answers
21 views

MariaDB replication lagging up to a dozen times a day for no obvious reasons

We first set up MariaDB replication using less powerful servers but considering our increased database load we had to rent more powerful servers and that's when the troubles began. Right now the ...
0 votes
1 answer
26 views

how to make PostgreSQL-13 slave node as read-write once primary node is down

I have two servers in master-slave configuration format. They are in streaming state and synchronization state is "Sync". I also used "repmgr" to make them as a cluster in primary ...
0 votes
1 answer
19 views

Troubleshooting foreign key dependency error when setting up new MariaDB replica

Question: Does anyone have advice on what I can do to successfully get this new replica set up and replicating from our production server just like the old replica? Details: I am trying to set up a ...
0 votes
1 answer
26 views

what after WAL LSN value of type pg_lsn reach its limit

I am trying to determine the optimal Standby for automated failover based on the highest value of pg_last_wal_receive_lsn() of all slaves. But what if max_wal_size is reached, does pg_lsn values go to ...
0 votes
1 answer
75 views

postgresql 12 streaming replication not working

I want to set up streaming replication on the Slave. On the Primary Server (Server A. Ubuntu 18.04; Postgres 12) : sudo nano /etc/postgresql/12/main/postgresql.conf Set listen_addresses = '*' The ...
  • 65
1 vote
2 answers
32 views

Automating MySQL replication using snapshots on AWS RDS (or Linux)

I'm currently working on a BASH script to build a new Aurora cluster based on the latest snapshot of an existing cluster, then set up MySQL replication from the old one to the new. In the past I've ...
  • 131
0 votes
0 answers
25 views

User Permissions for WAL files

I'm setting up replication on Postgres. (expect more questions later :-) I'm putting the WAL files on the NAS so that both servers have access to the files. The Postgres service is running as "...
  • 101
0 votes
1 answer
39 views

streaming replication consideration

I am asking for guidance. I want to set up a replication between 3 servers : 1 master A, 2 slaves B and C. The master streams to 2 slaves. A to B is logical replication, whereas A to C is streaming ...
  • 65
0 votes
0 answers
45 views

Is it possible to re-sync table with logical replication?

Let's imagine that someone executed the command TRUNCATE TABLE tbl1; on logical replica. How will it be correct to synchronize only one table again? I use PostgreSQL 14.
  • 103
0 votes
1 answer
49 views

Error 1236 in MySQL GTID Slave due to mistaken 'reset master' on MySQL 5.7 GTID master

Sequence of events: Disabled binary logs in MySQL 8 slave with the following relevant parameters in mysqld.cnf: log-replica-updates = OFF gtid-mode = ON enforce-gtid-consistency = ON master-info-...
0 votes
0 answers
17 views

MySQL : Huge table truncation in replication environment

We have 2 tables of size 186G and 63G that are no longer in use and needs to be truncated from the database. I cannot directly run the truncate table statement on the master DB as it has 14 replicas ...
0 votes
1 answer
17 views

Can we do incremental sync of MongoDB based on a schedule?

Can we sync a mongodb database to another incrementally based on a schedule? Say, once every night at 12 am? Background: We have a MongoDB replica cluster consisting of 3 instances, all located within ...
  • 133
0 votes
1 answer
42 views

Can Cassandra nodes running in 2 different DCs on K8s behind NAT on private subnet form a cluster?

Is there anyway Cassandra nodes running in two different data centers behind NAT, on private subnet can form a single cluster? Use case: For an on premise Geo-Diverse setup, we needs to run Cassandra ...
0 votes
0 answers
101 views

PostgreSQL Logical Replication Lag

I am using pglogical extension for logical replication between a PostgreSQL version 10 and 13. I have multiple databases in the primary which are replicating data to three databases in logical replica....
0 votes
0 answers
5 views

How xtrabackup restores data to the replica server

The product is a microservice architecture, divided into multiple databases. In order to facilitate the background management program to facilitate cross-database linked list query, a replica server ...
  • 1
0 votes
1 answer
36 views

LVM snapshot of MyISAM tables requires repair every time

I'm attempting to setup slave replication of a large MyISAM table. I login to the master server and perform FLUSH TABLES WITH READ LOCK; SHOW MASTER STATUS and that returns right away with the ...
0 votes
0 answers
31 views

How do I update definers to enable MySQL replication?

I am trying to create a MySQL replica in Cloud SQL, Google's managed MySQL service. However I have the following error which won't allow me to start replication: "kind": "sql#...
  • 113
0 votes
1 answer
170 views

WAL file retention in Aurora Postgres

I’m planning to create a bunch of Aurora Postgres clusters with logical_replication enabled, so I would not have to reboot my clusters once will need to enable logical_replication for future ...
  • 333
1 vote
0 answers
55 views

Upgrade Replication MySQL from 5.7.34 to 8.0.28 without database downtime

I have to upgrade a MySQL replication topology from 5.7 to 8.0 without database downtime. It’s MySQL Community Edition. There is one source and 5 replicas in the topology and connections happen via ...
0 votes
1 answer
64 views

message 'The Distributor has not been installed correctly'

I get the message The Distributor has not been installed correctly Could not enable database for publishing when trying to execute sp_replicationdboption. The publisher (which is on separate server ...
0 votes
1 answer
43 views

PostgreSQL: does the WAL group commit affect synchronous replication performance?

I'm curious if PostgreSQL's Group Commit mechanism (controlled by commit_delay and commit_siblings parameters) only affects disk fsync calls. Or does it also allow multiple on-the-fly transactions to ...
  • 103
0 votes
1 answer
25 views

MariaDB Multi level replication (replicate from slave)

I am looking for a way to set up MariaDB replication from slave. My configuration looks as following: First datacenter: Master + 3 slaves connected via private switch Second datacenter: Master + 3 ...
  • 3
0 votes
2 answers
102 views

High Load MariaDB Cluster (Galera Multi Master Replication) - Same hardware needed for Slaves?

My Galera Cluster is on very high load. To run it fine, I´m using strong hardware and for sure a lot of custom MariaDB settings and custom OS tweaks. Now, I want to add Slaves to get "realtime&...
0 votes
1 answer
30 views

postgres 11.3 checksum validation post migration

I am in the process of migrating our AWS RDS postgresql from one account to another with zero downtime. I am going with pg_dump/pg_restore + AWS CDC for ongoing replication. I am looking for a way to ...
  • 9
0 votes
1 answer
28 views

EDB Replication Server, Sequences not updating

I'm using EDB Replication server to have 3 postgres 14 databases in sync (MMR Replication). I'm using Table Trigger as changeset logging It's working fine for the most part, but I have a problem with ...
2 votes
0 answers
32 views

More low-level faster replication schemes for PostgreSQL?

From this question: in PostgreSQL REPMGR Master-Slave environment is it necessary to have same H/W config for HOT STANDBY setup?, I was reminded of my experience and disappointment with the hot-...
0 votes
1 answer
23 views

Can oplog be put in a different disk partition?

I'm just curious if this is possible. Coming from mysql, the log_bin can be put on a different disk.
  • 59
0 votes
0 answers
54 views

sync_state pg_stat_replication

I created 2 tables replication with these procedure : Create publication : CREATE PUBLICATION pub_1 FOR TABLE table_1, table_2; Create subscription for table 1 : CREATE SUBSCRIPTION sub_1 CONNECTION ...
  • 65

1
2 3 4 5
68