Questions tagged [replication]

Replication is the process of sharing any level of information so as to ensure consistency between redundant hardware/software resources to improve reliability, fault-tolerance, and accessibility

Filter by
Sorted by
Tagged with
-1 votes
0 answers
6 views

AWS Postgresql RDS to OCI Postgresql Database Real Time Replication

Good day, our organization is planning to have a DRP cloud provider which is OCI. Is it possible to implement the REAL TIME syncing of data from AWS PostgreSQL RDS to OCI PostgreSQL Database?? If yes, ...
user avatar
0 votes
1 answer
14 views

MySql (local-Online) replication

I am trying to apply MySql replication between a local server (Master) and an online server (Slave) and need your help. ** All names (username – password – server name) are just an example and not the ...
user avatar
0 votes
0 answers
51 views

AWS RDS database replication replicates everything regardless my parameters group

I have a database in RDS that I want to replicate. I made a parameter group where I described which tables I want to be replicated. I applied it to my replica, and still it replicated the whole ...
user avatar
0 votes
0 answers
16 views

fivetran replication from PostgreSQL (connector Broken with WAL log error)

PostgreSQL RDS instance having physical replication to multi-AZ, same instance also enabled for Fivetran replication copying data to BigQuery using WAL logical test-decoding. Multiple issues here: ...
user avatar
0 votes
0 answers
17 views

Which MariaDB-Galera Node Should I Start After Cluster Crushing or Failing?

Sometimes my 3-Node GaleraCluster fails and doesn't serve. When I check I see all of them are activated but two of them are not working, so I check log files I see one of them could not operate an ...
user avatar
0 votes
0 answers
13 views

ubutun 18.04 I did master and slave replication. before it was working fine but today it stopped all of a sudden I don't know why

2022-04-27T21:57:22.421118Z 2 [ERROR] Slave I/O for channel '': error connecting to master 'replicat@172.20.10.2:3306' - retry-time: 60 retries: 1, Error_code: 2003 2022-04-27T21:58:22.810750Z 2 [...
user avatar
1 vote
1 answer
36 views

Azure Database Performance Throttling - Use Replication or?

We keep a "rather large" azure database where we load all of our company data into every night. It uses temporal tables to keep track of changes to the data Now we want to start reading this ...
user avatar
  • 113
3 votes
1 answer
23 views

MySQL replication setup based on an LVM snapshot – am I forgetting anything?

I'm tasked with starting a brand new replica of a client's MySQL 5.7.35 database server. While I've observed others doing this in the past in various circumstances, I haven't been in charge of this ...
user avatar
  • 135
0 votes
1 answer
27 views

Restore SQL Server replication subscriber

We have merge replication in our system and there is a case when we need to deploy our system with subscriber database and time is crutial. I wonder if the is possibility to take configured subscriber ...
user avatar
0 votes
1 answer
22 views

Upgrading Logical Replica of PostgreSQL

I am trying to upgrade a logical replica from PostgreSQL V10 to V13. We are using pglogical for the logical replication. Though the upgrade process of the replica can be done, however the replication ...
user avatar
1 vote
1 answer
32 views

SQL Server replication msRepl_commands msRepls_transactions tables growing

I'm not getting any clue how to safely clean up the above tables. Last Friday, these tables had 22m and 6m records, respectively. Over the weekend, the number of rows has been reduced to 10m and 2.5m. ...
user avatar
1 vote
1 answer
30 views

How to re-sync the Mysql replication if Master down

I have a very simple webapp infra: FE => BE => MySQL. I have set up MySQL master-slave replication successfully. If my MySQL master node is down, I can manually point the MySQL IP to the Slave ...
user avatar
0 votes
0 answers
12 views

Postgres: one publication for all tables or one publication per table?

Are there any significant pros or cons to having one publication for all tables vs one per table? The ones I can think of are: Cons for one publication for all tables: If multiple services consume ...
user avatar
  • 101
0 votes
2 answers
28 views

Is better to copy value between DB table or create a reference?

I’m at a crossroads, and I don't know which is the best option to choose. Let's say I have a Table A which contains addresses and other information. As you can expect lot of rows contains the same ...
user avatar
1 vote
0 answers
21 views

SQL Replication - What is @frequency_recurrence_factor and what must it be set to?

The documentation says: [ @frequency_recurrence_factor = ] frequency_recurrence_factor Is the recurrence factor used by frequency_type. frequency_recurrence_factor is int, with a default of 0. Does ...
user avatar
  • 253
0 votes
0 answers
20 views

Large log backup files on subscriber side of merge replication

I have a merge replication setup in SQL Server 2019 (Full recovery model) that is working great with no problems in use. The publisher and the subscriber both have weekly full backups, and hourly log ...
user avatar
  • 101
1 vote
1 answer
11 views

How do I safely drop a table under replication

I have newly set up replication on my Sql 2012 Server. It is working OK. I occasionally have sql scripts that drop existing tables and recreate them. However, I cannot drop any table currently under ...
user avatar
  • 73
1 vote
1 answer
50 views

How to modify the Replication Subscription Job/script to make it point an IP Address and a Port number?

I have an SQL Server 2012 server set up replicating one Database. It is behind a firewall. I have poked a hole in the firewall so I can access the server on Port 1433. I am using an IP Address and a ...
user avatar
  • 73
0 votes
0 answers
37 views

SQL Server Database Migration from old data type to new SQL Server with new data type (VLDB)

I have a database sized 25+ TB. There are objects (almost all tables has) with nvarchar data typed columns with partitions. Recently we realized there is no necessity for maintaining nvarchar data ...
user avatar
0 votes
1 answer
30 views

SQL Server modification timestamps

I'm implementing ingestion job from SQL Server 2016. For performance reasons we want to implement incremental loads. Few facts: Customer has read replica as a part of always on availability group ...
user avatar
  • 101
0 votes
1 answer
79 views

MySQL 8 Replication

I've got this error message: Coordinator stopped because there were error(s) in the worker(s). The most recent failure being: Worker 1 failed executing transaction 'ANONYMOUS' at master log mysql-bin....
user avatar
0 votes
0 answers
15 views

Skip updates from postgres replication

I'm working on an app that is currently consuming from psql replication. I'm creating the publication like: create publication pub for table table1 with (publish = 'insert') When I start consuming ...
user avatar
0 votes
0 answers
10 views

Split data file into multiple files

We have a 7 TB database that currently consists of 2 files (~2 TB & ~5 TB). We are also migrating onto a new platform and haven't yet decided on the migration method. It has been recommended that ...
user avatar
  • 1
0 votes
1 answer
36 views

"The slave is lagging behind"-mystery

I have a testing scenario with one dedicated server (6 vCore x 3.6 GHz AMD Ryzen 5 Pro 3600, RAM: 32 GB, HDD: 2 x 1000 GB Software RAID 1 if that matters) and a MySQL (MariaDB) replication setup with ...
user avatar
  • 101
0 votes
0 answers
20 views

Add new table to existing Google Data Fusion replication job

I have functional replication job (MariaDB to BigQuery) in Google Data Fusion - replication module (accelerator), which was pretty simple to configure and it works great, even when altering tables. ...
user avatar
  • 1
0 votes
0 answers
16 views

Redis, replication and unreasonably high memory consumption

I'm trying to replicate a redis instance (keydb to be honest, but that's just a SMP flavor actually) with the following metrics: 16 Gb used memory, 24K rps, 4K clients, 1.4M items. While theoretically ...
user avatar
  • 197
0 votes
1 answer
14 views

Is it possible to logically replicate pg_catalog tables?

I would like to logically replicate pg_catalog tables from various (100s) databases to a single cluster to help me reliably compare schemas via query. I have tried FDW (and dblink) but found that ...
user avatar
0 votes
1 answer
62 views

Postgresql: how to enable pg_stat_replication_slots?

I have a streaming replication on pg 14.2 that seems to be working, on a slot named slot1. select * from pg_stat_replication_slots has no output. Do I need to enable anything else? I have those on: ...
user avatar
2 votes
1 answer
41 views

Fix mysql replication crashed due to underlying storage corruption

we have critical database server running on two virtual machines. one virtual machine crashed due to underlying storage problem and we had to move it to different storage medium and recover the xfs ...
user avatar
0 votes
0 answers
24 views

Replicating on-prem MS SQL databases with Azure DataFactory

Is it possible to replicate a database from an on-prem SQL server to a SQL Server running on an Azure VM (SQL on IaaS, not a SQL Managed Instance or an AzureSQL database) using Azure DataFactory? Most ...
user avatar
  • 101
0 votes
0 answers
12 views

Mysql replication and binlog position saving

I'm using Mysql replication sets for I don't really remember how long, and one thing really bothers me: it seems like something has changed between 5.7 and 8.0 in the binlog position syncing. I'l ...
user avatar
  • 197
2 votes
1 answer
21 views

Does executing mysql dump files trigger replication?

I have two servers A and B that have a source/replica replication set up. I need to bring a new database over from another server, say server C. If I create a dump file of it, and then execute the ...
user avatar
0 votes
0 answers
66 views

PostgreSQL logical replication : new table not replicated on distant server

PostgreSQL 13, windows server 12 In the context of a logical replication, I made a dump of a database without the data of a primary server (-s) and restored the backup on a secondary server. Then I ...
user avatar
  • 157
1 vote
2 answers
55 views

PostgreSQL replication lag without obvious bottleneck

We have PostgreSQL 14.2 running on Ubuntu 18.04 with physical (asynchronous) replication set up. The standby is on an AWS EC2 instance with an EBS volume. When I test inserting data as fast as ...
user avatar
  • 165
0 votes
1 answer
52 views

understanding parallel replication in MySQL 5.7

I am currently experimenting with parallel replication in MySQL (5.7). I have set up a replication between master and slave (MyISAM, statement based) and did also set the following settings for ...
user avatar
  • 1
2 votes
2 answers
45 views

PostgreSQL (TimescaleDB) asynchronous replication (WAL) doesn't work

I'm trying to setup asynchronous replication of a PostgreSQL (TimescaleDB) database. I've been following numerous of guides, and even after trying things from documentation it doesn't seem to work. I ...
user avatar
2 votes
0 answers
14 views

Why would my MySQL replica server experience an sql integrity constraint error after losing connection and attempting to start again?

I have a master-master replication setup between two different servers using MariaDB. One is the primary server (server A) that is connected to my web applications, and the other is a replica that ...
user avatar
1 vote
0 answers
27 views

SQL Server Replication - One-to-Many in Same DB

I'm setting up some canary tables to more effectively monitor replication latency between on-prem and Azure. I've set it up using one source table that gets updated with a timestamp every few seconds, ...
user avatar
  • 424
0 votes
0 answers
17 views

postgres14 on ubuntu streaming replication to a freebsd

I am trying to setup my postgres streaming replication to a freebsd machine. The problem is that both use different postgres.conf files with different system locations. I can run pg_basebackup with no ...
user avatar
  • 151
1 vote
0 answers
32 views

Replicating/Inserting 300M MYSQL records from 6 Remote Servers on Local using Unique Identifier

I have 6 remote servers that dial phone numbers daily. I have a total record count of over 300 million combined and now I want to procress on them. The table data looks like this using this query ...
user avatar
0 votes
0 answers
36 views

Replicating MySQL database to Clickhouse via Kafka: what about the initial state?

I need to set up the replication from existing MySQL database into a an empty database in an existing Clickhouse cluster. Since the most simple solution, clickhouse-mysql seems to be broken (stumbles ...
user avatar
  • 197
0 votes
0 answers
21 views

replicate_rewrite_db not working on create table

I'm trying to set up replication on Mariadb 10.6 on Debian 9. I'd like to replicate database "DB" on master to database "DB1" on slave. I've configured the following on the slave : ...
user avatar
  • 1
0 votes
0 answers
43 views

Postgres13 logical replication degrading slowly

We're halfway through a postgres upgrade (from 11 to 13) and have run into a pretty unusual blocker, being that our 13 logical replica can't seem to keep up with changes from our 13 master. For ...
user avatar
0 votes
1 answer
35 views

Start SQL replication using differential backup

I need to replicate a few databases but they are too (>100GB) to use snapshot or to copy the full backup on last minute (it take around 5 hrs to copy the full backup across centers). I'm looking ...
user avatar
-1 votes
1 answer
32 views

Can I set up Wal Archiving on a three years old Postgres database?

If I set up Wal Archiving on a three years old Postgres database (used in production); do the Continuous Archiving and Point-in-Time Recovery (PITR) will work from the beginning? Will I have all the ...
user avatar
0 votes
0 answers
38 views

Change Column size of a table

We have a mysql 5.6 cluster, 1 master 5 slaves. Requirements:- We have to modify the size of a column varchar from 20 to 35 for 2 databases. What is the best approach for doing this accross the ...
user avatar
0 votes
1 answer
33 views

Will updating a row with identical values create entries for logical replication

I am using Postgresql 14 and it is set up for logical replication. Trying to stream changes with debezium version 1.8. Actually, everything seems OK. Every insert, update, delete is streamed except ...
user avatar
  • 103
0 votes
1 answer
62 views

Postgres 13: Subscription stuck at initialize state

Postgres version: 13.5 I have 2 sets of publication/subscription between my 2 DBs. One of them is working fine and the other one is stuck at initializing state for all the tables. sourcedb=# select * ...
user avatar
2 votes
2 answers
277 views

How to avoid replication lag in case all writes on master and reads on replica?

I have stuck with the replication lag problem. I am trying to refactor my DB infrastructure. The first step was read-write split. I used ProxySQL то implement it. Now I have masterDb where all INSERT ...
user avatar
1 vote
1 answer
83 views

MySQL master-slave replication not updating

I set up MASTER->SLAVE database replication. Looks like everything fine, but when I change the master, the slave database is not updated. Exec_Master_Log_Pos on slave is updated when I update ...
user avatar

1
2 3 4 5
66