Questions tagged [replication]
Replication is the process of sharing any level of information so as to ensure consistency between redundant hardware/software resources to improve reliability, fault-tolerance, and accessibility
3,340
questions
1
vote
1
answer
35
views
Drop Subscriber at SQL Transactional replication
We have SQL Transactional pull replication:
Publisher and Distributor are at the same server - ServerA.
It publicates Publication1.
Pull Subscribers to Publication1 are - ServerB, ServerC and ...
- 11
1
vote
0
answers
180
views
Replicate MySQL table to MariaDB for System Versioning
We have some tables in an operational and busy MySQL database (AWS RDS) for which we require system versioning for some of the tables. (point-in-time queries)
Is it possible to somehow replicate the ...
user5372615
0
votes
0
answers
30
views
MySQL Replication with Data Transformation and Replicant-specific Data
I have two MySQL 8.0.23 RDS's - one "Production" RDS that actual users use, and one "Performance" RDS that is used for performance testing.
These databases have the same schema and ...
- 101
0
votes
1
answer
48
views
SQL Database Replication
I have requirement with below for SQL database replication.
I have two separate SQL database servers on same network, one will be used as primary and another one as secondary.
Primary is a central ...
- 1
0
votes
1
answer
33
views
Can we use a mongodb 4.3.3 and mongodb 2.6.5 in same replica set?
we are running a mongo 2.6.5, 5 member replica set on CentOS and are looking to upgrade to 4.3.3. We do not use sharding. The tricky part for us is that we operate a service and can't have scheduled ...
0
votes
1
answer
18
views
Enabling replication in MySQL in fresh database
We have a legacy TokuDB database that we would like to begin migrating to a new engine. Unfortunately taking the db offline for migration is not feasible. We also can reprocess all the data in the ...
- 113
0
votes
1
answer
158
views
Finding the MySQL binlog positions to restore replication
I have a large database where replication became broken (a query to delete rows ran on the slave directly by mistake)
The decision was taken to restore the slave from the master. I've made an export ...
0
votes
1
answer
108
views
Postgresql Replication issues of clarity
In an effort to document myself I examined a few sources; these two from the official docs and this external one seemed promising
Now the latter one seems to be updated in 2020, but refers to version ...
- 249
0
votes
1
answer
550
views
Is wal_keep_segments required with streaming replication when archive and restore commands are set?
I have a 2 node postresql(12.9) cluster with streaming replication enabled. I have also set the archive and restore commands which I verified is working as expected. No replication slots or ...
- 1
0
votes
0
answers
232
views
Why is restoring a fresh database from a backup failing due to a duplicate key error?
I'm trying to build a replica from an active database with no downtime for replication purposes.
I run the following statement to get a backup, avoid locking the tables, and flush the logs so that the ...
- 167
1
vote
1
answer
207
views
SQL Server replication between standard and developer editions
I have one SQL Server Standard (2019), I want to add one server to developper (not used by production so the version if developper), it's possible to replicate data ? what is the best methode ? we ...
- 11
0
votes
0
answers
46
views
Report (log) of each transaction on SQL Server Replication?
I've configured a transactional type of Replication between two SQL Servers. Since it's a project that it's still under review on my side I have only selected a couple of articles for the replication. ...
0
votes
0
answers
78
views
How can replication break from a crashed replica?
I have a master-master relationship between two database servers, server A and B. Server B acts as a failover in case server A were to go down. Server B recently went down unexpectedly due to ...
- 167
0
votes
1
answer
39
views
MySql (local-Online) replication
I am trying to apply MySql replication between a local server (Master) and an online server (Slave) and need your help.
** All names (username – password – server name) are just an example and not the ...
0
votes
0
answers
241
views
AWS RDS database replication replicates everything regardless my parameters group
I have a database in RDS that I want to replicate. I made a parameter group where I described which tables I want to be replicated. I applied it to my replica, and still it replicated the whole ...
- 101
0
votes
1
answer
366
views
fivetran replication from PostgreSQL (connector Broken with WAL log error)
PostgreSQL RDS instance having physical replication to multi-AZ, same instance also enabled for Fivetran replication copying data to BigQuery using WAL logical test-decoding.
Multiple issues here:
...
- 1
1
vote
0
answers
146
views
Which MariaDB-Galera Node Should I Start After Cluster Crushing or Failing?
Sometimes my 3-Node GaleraCluster fails and doesn't serve. When I check I see all of them are activated but two of them are not working, so I check log files I see one of them could not operate an ...
0
votes
0
answers
49
views
ubutun 18.04 I did master and slave replication. before it was working fine but today it stopped all of a sudden I don't know why
2022-04-27T21:57:22.421118Z 2 [ERROR] Slave I/O for channel '': error connecting to master 'replicat@172.20.10.2:3306' - retry-time: 60 retries: 1, Error_code: 2003
2022-04-27T21:58:22.810750Z 2 [...
1
vote
1
answer
155
views
Azure Database Performance Throttling - Use Replication or?
We keep a "rather large" azure database where we load all of our company data into every night.
It uses temporal tables to keep track of changes to the data
Now we want to start reading this ...
- 113
3
votes
1
answer
110
views
MySQL replication setup based on an LVM snapshot – am I forgetting anything?
I'm tasked with starting a brand new replica of a client's MySQL 5.7.35 database server. While I've observed others doing this in the past in various circumstances, I haven't been in charge of this ...
- 135
0
votes
1
answer
115
views
Restore SQL Server replication subscriber
We have merge replication in our system and there is a case when we need to deploy our system with subscriber database and time is crutial. I wonder if the is possibility to take configured subscriber ...
- 3
0
votes
1
answer
208
views
Upgrading Logical Replica of PostgreSQL
I am trying to upgrade a logical replica from PostgreSQL V10 to V13. We are using pglogical for the logical replication.
Though the upgrade process of the replica can be done, however the replication ...
- 514
1
vote
1
answer
318
views
SQL Server replication msRepl_commands msRepls_transactions tables growing
I'm not getting any clue how to safely clean up the above tables. Last Friday, these tables had 22m and 6m records, respectively. Over the weekend, the number of rows has been reduced to 10m and 2.5m. ...
- 11
1
vote
1
answer
577
views
How to re-sync the Mysql replication if Master down
I have a very simple webapp infra: FE => BE => MySQL. I have set up MySQL master-slave replication successfully. If my MySQL master node is down, I can manually point the MySQL IP to the Slave ...
- 111
0
votes
0
answers
348
views
Postgres: one publication for all tables or one publication per table?
Are there any significant pros or cons to having one publication for all tables vs one per table? The ones I can think of are:
Cons for one publication for all tables:
If multiple services consume ...
- 111
0
votes
2
answers
80
views
Is better to copy value between DB table or create a reference?
I’m at a crossroads, and I don't know which is the best option to choose.
Let's say I have a Table A which contains addresses and other information. As you can expect lot of rows contains the same ...
1
vote
0
answers
114
views
SQL Replication - What is @frequency_recurrence_factor and what must it be set to?
The documentation says:
[ @frequency_recurrence_factor = ] frequency_recurrence_factor Is the
recurrence factor used by frequency_type. frequency_recurrence_factor
is int, with a default of 0.
Does ...
- 253
0
votes
0
answers
66
views
Large log backup files on subscriber side of merge replication
I have a merge replication setup in SQL Server 2019 (Full recovery model) that is working great with no problems in use.
The publisher and the subscriber both have weekly full backups, and hourly log ...
- 101
1
vote
1
answer
276
views
How do I safely drop a table under replication
I have newly set up replication on my Sql 2012 Server. It is working OK.
I occasionally have sql scripts that drop existing tables and recreate them.
However, I cannot drop any table currently under ...
- 73
1
vote
1
answer
340
views
How to modify the Replication Subscription Job/script to make it point an IP Address and a Port number?
I have an SQL Server 2012 server set up replicating one Database. It is behind a firewall. I have poked a hole in the firewall so I can access the server on Port 1433. I am using an IP Address and a ...
- 73
0
votes
0
answers
58
views
SQL Server Database Migration from old data type to new SQL Server with new data type (VLDB)
I have a database sized 25+ TB.
There are objects (almost all tables has) with nvarchar data typed columns with partitions. Recently we realized there is no necessity for maintaining nvarchar data ...
- 1,586
0
votes
1
answer
83
views
SQL Server modification timestamps
I'm implementing ingestion job from SQL Server 2016. For performance reasons we want to implement incremental loads.
Few facts:
Customer has read replica as a part of always on availability group ...
- 101
2
votes
1
answer
4k
views
MySQL 8 Replication
I've got this error message:
Coordinator stopped because there were error(s) in the worker(s). The most recent failure being: Worker 1 failed executing transaction 'ANONYMOUS' at master log mysql-bin....
Ayaa Ahmed
0
votes
0
answers
74
views
Skip updates from postgres replication
I'm working on an app that is currently consuming from psql replication.
I'm creating the publication like:
create publication pub for table table1 with (publish = 'insert')
When I start consuming ...
0
votes
1
answer
78
views
"The slave is lagging behind"-mystery
I have a testing scenario with one dedicated server (6 vCore x 3.6 GHz AMD Ryzen 5 Pro 3600, RAM: 32 GB, HDD: 2 x 1000 GB Software RAID 1 if that matters) and a MySQL (MariaDB) replication setup with ...
- 101
0
votes
1
answer
56
views
Is it possible to logically replicate pg_catalog tables?
I would like to logically replicate pg_catalog tables from various (100s) databases to a single cluster to help me reliably compare schemas via query. I have tried FDW (and dblink) but found that ...
- 279
0
votes
1
answer
997
views
Postgresql: how to enable pg_stat_replication_slots?
I have a streaming replication on pg 14.2 that seems to be working, on a slot named slot1.
select * from pg_stat_replication_slots has no output. Do I need to enable anything else?
I have those on:
...
- 417
2
votes
1
answer
276
views
Fix mysql replication crashed due to underlying storage corruption
we have critical database server running on two virtual machines. one virtual machine crashed due to underlying storage problem and we had to move it to different storage medium and recover the xfs ...
- 123
0
votes
0
answers
159
views
Replicating on-prem MS SQL databases with Azure DataFactory
Is it possible to replicate a database from an on-prem SQL server to a SQL Server running on an Azure VM (SQL on IaaS, not a SQL Managed Instance or an AzureSQL database) using Azure DataFactory?
Most ...
- 101
2
votes
1
answer
57
views
Does executing mysql dump files trigger replication?
I have two servers A and B that have a source/replica replication set up. I need to bring a new database over from another server, say server C. If I create a dump file of it, and then execute the ...
- 167
0
votes
0
answers
886
views
PostgreSQL logical replication : new table not replicated on distant server
PostgreSQL 13, windows server 12
In the context of a logical replication, I made a dump of a database without the data of a primary server (-s) and restored the backup on a secondary server.
Then I ...
- 197
1
vote
2
answers
1k
views
PostgreSQL replication lag without obvious bottleneck
We have PostgreSQL 14.2 running on Ubuntu 18.04 with physical (asynchronous) replication set up. The standby is on an AWS EC2 instance with an EBS volume. When I test inserting data as fast as ...
- 188
0
votes
1
answer
193
views
understanding parallel replication in MySQL 5.7
I am currently experimenting with parallel replication in MySQL (5.7).
I have set up a replication between master and slave (MyISAM, statement based) and did also set the following settings for ...
- 1
2
votes
2
answers
132
views
PostgreSQL (TimescaleDB) asynchronous replication (WAL) doesn't work
I'm trying to setup asynchronous replication of a PostgreSQL (TimescaleDB) database. I've been following numerous of guides, and even after trying things from documentation it doesn't seem to work. I ...
- 21
2
votes
0
answers
25
views
Why would my MySQL replica server experience an sql integrity constraint error after losing connection and attempting to start again?
I have a master-master replication setup between two different servers using MariaDB. One is the primary server (server A) that is connected to my web applications, and the other is a replica that ...
- 167
1
vote
0
answers
49
views
SQL Server Replication - One-to-Many in Same DB
I'm setting up some canary tables to more effectively monitor replication latency between on-prem and Azure. I've set it up using one source table that gets updated with a timestamp every few seconds, ...
- 444
0
votes
0
answers
49
views
postgres14 on ubuntu streaming replication to a freebsd
I am trying to setup my postgres streaming replication to a freebsd machine. The problem is that both use different postgres.conf files with different system locations.
I can run pg_basebackup with no ...
- 151
1
vote
0
answers
38
views
Replicating/Inserting 300M MYSQL records from 6 Remote Servers on Local using Unique Identifier
I have 6 remote servers that dial phone numbers daily. I have a total record count of over 300 million combined and now I want to procress on them. The table data looks like this using this query
...
- 11
0
votes
0
answers
228
views
Postgres13 logical replication degrading slowly
We're halfway through a postgres upgrade (from 11 to 13) and have run into a pretty unusual blocker, being that our 13 logical replica can't seem to keep up with changes from our 13 master. For ...
0
votes
1
answer
48
views
Start SQL replication using differential backup
I need to replicate a few databases but they are too (>100GB) to use snapshot or to copy the full backup on last minute (it take around 5 hrs to copy the full backup across centers). I'm looking ...
