Questions tagged [replication]
Replication is the process of sharing any level of information so as to ensure consistency between redundant hardware/software resources to improve reliability, fault-tolerance, and accessibility
3,521
questions
3
votes
2
answers
8k
views
mongo replicated shard member not able to recover, stuck in STARTUP2 mode
I have following setup for a sharded replica set in Amazon VPC:
mongo1: 8G RAM Duo core (Primary)
mongo2: 8G RAM Duo core (Secondary)
mongo3: 4G RAM (Arbiter)
mongo1 is the primary ...
CommunityBot
- 1
1
vote
1
answer
424
views
migrate mysql DB between two servers using replication
I need to perform some steps, I have to migrate our company live DB to a new server, if I use normal way such as lock table, mysqldump, scp, mysql restore, it take around 5-6 hours, so I want to make ...
CommunityBot
- 1
1
vote
2
answers
667
views
replication error
I am getting error for connect to master (mysql 5.1) from slave (mysql5.7)
Slave I/O for channel '': error connecting to master
'replica@hostname' - retry-time: 60 retries: 6, Error_code: 2027
...
CommunityBot
- 1
0
votes
1
answer
963
views
PostgreSQL cluster has two primary databases after network glitch
My test environment had network glitch over the weekend and I ended up having two Primary databases up and running in the cluster.
ID | Name | Role | Status | ...
CommunityBot
- 1
0
votes
0
answers
16
views
RDS Mysql replica cdc performance
I have a RDS Mysql which has high read/write volume. ~10k IOPS on an average and peaks up to 16k IOPS.
I have another RDS mysql replica of the main. We are using this replica to capture cdc logs and ...
1
vote
1
answer
2k
views
MySql Replication: Access Denied
I am trying to migrate between cloud providers, using MySql Replication to copy data across live so we can switch with no downtime.
Current setup:
2x Windows servers with old provider, with MySql 8 ...
CommunityBot
- 1
0
votes
0
answers
26
views
MySQL 8 Replication Master-Master fatal error
I have two servers with the same MySQL 8.0.40. I set up a Master to Master replication.
When I run the command SHOW REPLICA STATUS\G; on both servers, I see an error: The replica I/O thread stops ...
Dev Dev
1
vote
2
answers
2k
views
MariaDB replication lagging up to a dozen times a day for no obvious reasons
We first set up MariaDB replication using less powerful servers but considering our increased database load we had to rent more powerful servers and that's when the troubles began.
Right now the ...
- 26.6k
0
votes
2
answers
2k
views
Help setting up Galera Arbitrator
I am testing a MariaDB Galera Cluster set up with only 2 nodes, I have three servers haproxy, node1 and node2 . I was able to set it up and it worked fine until testing phase.
There are two types of ...
CommunityBot
- 1
1
vote
2
answers
354
views
MySQL DB as Master for some tables and Slave for others
I have 2 DBs - DB1 (back-office) and DB2 (web application). The data needs to be synced between the 2. I'm happy with the idea of full master-master replication and may have to implement it, but ...
CommunityBot
- 1
0
votes
0
answers
37
views
MySQL log_bin and relay_log base_name.extension
Some of the MySQL clusters I manage have the following my.cnf settings:
log_bin = mysql-bin.log
relay_log = mysql-relay-bin.log
For the log_bin setting the .log extension is not needed because ...
- 1
0
votes
1
answer
41
views
Postgres Logical Replication - how to see what subscriber is doing with received data?
I've got two Postgres 13 databases on AWS RDS.
One is a master, the other a slave using logical replication.
Replication has fallen behind by about 350Gb.
The slave was maxed out in terms of CPU for ...
- 307
0
votes
1
answer
30
views
Added Articles Are Being Ignored
there is a publisher --> distributor --> subscriber setup and all has been well configured in this system and a few simple tests of adding a few tables and re-snapping tables seems to work well.
...
- 567
0
votes
1
answer
369
views
MySQL backup of incremental changesets
With a MySQL database, is there a way of logging and/or backing up incremental changesets?
We have a number of large databases (100-200 GB), for which we take daily backups using mysqldump. These ...
CommunityBot
- 1
0
votes
1
answer
787
views
Is there a cross-platform way to compare data in one columnd on each sitde of replicated data, like a checksum or hash?
I have an Oracle 12 database with lots of tables, and I am replicating several of the tables (a subset of rows) into a SQL Server 2016 database. The subset of rows can be established with a WHERE ...
CommunityBot
- 1
1
vote
1
answer
3k
views
MySQL 5.6 replication causes 'waiting for table lock'
All of the sudden queries on slave server stopped with status "Waiting for table level lock"
I restart mysql service and stop replications and locking does not show up anymore. Once I turn ...
CommunityBot
- 1
0
votes
1
answer
382
views
MariaDB: Periodic copy of data from local database to remote database
I need to periodically copy the outcome of a view on our local database to another remote database.
I've tried using mysqldump which works fine when copying data from tables to tables, but i need to ...
CommunityBot
- 1
4
votes
1
answer
1k
views
MongoDB can't add new replica set member [rsSync] SEVERE: Got signal: 6
I have a replica set and I added a new member to the set. The initialSync begins for the new member and rs.status (on primary) shows STARTUP2 as status. However, after a long enough time, there's a ...
CommunityBot
- 1
0
votes
3
answers
374
views
How to drop a table that was replicated in the past?
An database being used at my job has several tables that appear to be remnants of an previous replication setup. These tables are no longer needed not having been used for at least 10 years so I am ...
CommunityBot
- 1
1
vote
2
answers
53
views
Postgres Hot standby stuck starting waiting for contrrecord despite wal file being present
We are experimenting with patroni Multi Datacenter HA with postgres16 using replication slots. At high level for building the remote cluster from scratch , we are by running base backup, while active ...
- 121
1
vote
1
answer
328
views
Is there any way to monitor if all columns in an article is published in replication
In replication, if we add a column in Publisher then it doesnt replicate to Subscriber unless it is done explicitly. I am looking for a way to track or monitor this.
I am not able to find any system ...
CommunityBot
- 1
2
votes
2
answers
437
views
Deadlocks With Trigger Based Replication
A table ORIGINAL exists with the following structure:
ID VARCHAR Length 10 (key)
VALUE VARCHAR Length 10 (non-key)
A table REPLICATION exists with the following structure:
ID ...
CommunityBot
- 1
1
vote
1
answer
367
views
Problem creating subscriptions on Replication Server version 15.7.1
if anyone knows what is the error? Can not use active or standby connection names for subscriptions
I got this error when I'm trying to create my subscriptions. I have already created a repdef WITH ...
CommunityBot
- 1
3
votes
1
answer
7k
views
MySQL replication: slave is not getting data from master
My problem is that all setup is done for MySQL replication but the slave is unable to sync the master's data. To understand I am sharing link below; please visit.
mysql> SHOW SLAVE STATUS \G;
****...
CommunityBot
- 1
3
votes
2
answers
3k
views
mongodb replication failed with socketexception and listener
I'm trying to set up mongodb replication using two servers in different data center. For the purposes of this question, I'll say their IP address are 1.1.1.1 and 2.2.2.2. I installed a clean version ...
CommunityBot
- 1
1
vote
1
answer
20
views
SSMS Version of 2008R2 Publisher not compatible with 20012 Subscriber
I am setting up transactional replication on my 2008R2 server to 2012 distribution server to 2012 Subscriber server. All the three servers are on FULL recovery mode. Log backup is taken every 15 ...
- 10.1k
0
votes
0
answers
37
views
SQL Server On Linux. Error MSSQL_REPL20024
Background:
I had a temporary SQL Server 2019 (v15) database on windows. I set up an UBUNTU 22.04 server with SQL Server 2022 (v16) and migrated the data to that new instance.
I then set up an ...
cmwa
1
vote
1
answer
688
views
Mariadb replication - Ignore users changes
I posted this question on ServerFault but was told to ask it here.
I need to set up multi-source replication (3 masters and 1 slave). I'd like to avoid replicating users' changes on the slave because ...
CommunityBot
- 1
0
votes
3
answers
659
views
Should I write to MySQL slave (replica) for reporting?
I intent to put reporting/analytics database on slave and run job scheduler every night to aggregate and insert data from operational database to reporting database.
Should I do this or I have to ...
CommunityBot
- 1
1
vote
0
answers
44
views
How to troubleshoot logical replication on Postgresql, when it comes to high replication lag?
I have a use case in which we use AWS DMS to stream data to our data lakes (S3), from time to time the replication lag gets out of control, leading to over 500Gb in replication slot lag.
It was also ...
- 11
0
votes
1
answer
345
views
Postgresql 12 logical replication catchup state (terminating walsender process due to replication timeout)
I have an issue with our logical replication which is still on catchup state.
It would read several lsn then got stuck on a particular lsn (EA/738D4DA8 both on sent_lsn and write_lsn) then reset again....
CommunityBot
- 1
1
vote
2
answers
558
views
Automating MySQL replication using snapshots on AWS RDS (or Linux)
I'm currently working on a BASH script to build a new Aurora cluster based on the latest snapshot of an existing cluster, then set up MySQL replication from the old one to the new. In the past I've ...
CommunityBot
- 1
0
votes
0
answers
37
views
Error in 'Distribution Cleanup' job
I neede some help with this problem.
Using MS SQL Server, I have a replication setup and working from Server A to server B.
There is a clean up Job that has to run on the agent -
'Distribution clean ...
- 101
4
votes
1
answer
2k
views
Sybase ASE to Microsoft SQL Server Replication
I am currently working on several projects to migrate legacy applications from a Sybase ASE (12.5 and 15.0) to a Microsoft SQL Server 2014 platform.
There will be a need to replicate data in both ...
- 149
1
vote
2
answers
318
views
Invalid Replication Server Name (IP Address) SQL Server 2012
I have a server in production (SQL Server 2012) that someone tried to set up replication (distributor), but they used an IP address instead of the name.
I can see that the installation must have ...
CommunityBot
- 1
0
votes
2
answers
2k
views
'Illegal mix of collations (utf8_general_ci,IMPLICIT) and (latin1_swedish_ci,EXPLICIT) for operation '='' on query
I have migrated the mysql 5.1 to 5.7 by using the mysqldump file. But i am facing the issue during master slave replication as below.
Error 'Illegal mix of collations (utf8_general_ci,IMPLICIT) and (...
CommunityBot
- 1
1
vote
1
answer
653
views
mysql replication duplicate entry
I replicate my mysql master to a slave. They works very well but once in a while, duplicate entry would happen and I don't know how to resolve it ending up copy the master over and start replicate ...
CommunityBot
- 1
0
votes
1
answer
483
views
Cannot connect to mysql server error for master replication
Am trying to connect to a mysql master which is a server running LAMP. It replies with an error "cannot connect to mysql server". Have also tried to connect using mysql -h XXX -u -p from the slave ...
CommunityBot
- 1
0
votes
1
answer
675
views
Multi master vs leader-follower
Sorry if I ask this basic question. I am reading different articles and trying to understand how it works.
Lets suppose I have two master DB(MySQL) in two different availability zone and two different ...
CommunityBot
- 1
0
votes
1
answer
11
views
Can wal_level be set to logical for both pitr recovery and logical replication?
My database cluster currently uses logical replication with wal_level set to logical. How can I integrate Point-In-Time Recovery (PITR) into this setup without changing the wal_level? If it's possible,...
- 341
0
votes
1
answer
22
views
MongoDB Replication for Backup
Our's is a small application. Every day we do mongodump and take DB backup to Amazon Glacier. Instead of this I would like to use MongoDB replication that will copy actual database on another ...
- 111
0
votes
2
answers
1k
views
Create triggers on slave only in mysql replication with a slave with different schema
I have a mysql replication setup with one master reporting to one slave. The schema on the slave is the same than the master but for each table I have an additional synchronized column only on the ...
CommunityBot
- 1
0
votes
3
answers
509
views
mysql table replication on just some records?
I have a big database which contain a table with about 26 million records. Now i need to make some reports on it from a special period of time.
So how to make a replication from that table from a ...
CommunityBot
- 1
0
votes
1
answer
35
views
Can I compress SQL Server Replication Subscriber tables before the snapshot is applied to the Subscriber?
I am setting up a Staging/PreProd environment by taking nightly backups of our Prod environment and applying them to our new PreProd environment. This part is working well.
Unfortunately, we have a ...
0
votes
1
answer
468
views
Postgres hot_standby_feedback supersedes or uses vacuum_defer_cleanup_age?
According to this web article, the hot_standby_feedback parameter makes use of the vacuum_defer_cleanup_age parameter to calculate when it will send updates? According to the postgres documentation, ...
CommunityBot
- 1
0
votes
0
answers
6
views
Clash of Auto increment column in MySQL during replication
I am trying to figure out a way to have 2 Aurora MySQL clusters in a Multi master setup where both clusters can serve traffic, and the data should be in sync between both clusters even if it is ...
YusufDoc
0
votes
1
answer
746
views
Detecting deleted rows in mysql
I have a Spring Boot webapp with a MySQL database. I'm trying to replicate this data into a MSSQL for running reports against.
All rows are audited with created_at and modified_at datetimes so i can ...
CommunityBot
- 1
1
vote
2
answers
763
views
I am looking for a query to determine when the snapshot has been finished applying on the subscriber
Is there any way to determine with a query when the replication has finished applying the snapshot on the subscriber?
I have a transnational pull replication set up for reporting purposes and it also ...
CommunityBot
- 1
0
votes
1
answer
6k
views
Login failed for user 'NT Service\SSISScaleOutMaster140'
In times of creating replication by using below query I getting from log
Login failed for user 'NT Service\SSISScaleOutMaster140'
DECLARE @distributor AS sysname;
DECLARE @distributionDB AS sysname;
...
CommunityBot
- 1
0
votes
0
answers
126
views
MySQL slave replication fails with error code 1032
We are running a MySQL DB master server version 8.0.36-0ubuntu0.22.04.1 and MySQL DB slave server version 8.0.39-0ubuntu0.22.04.1, where replication fails after a few hours with this in /var/log/mysql/...
schmidax