All Questions
4,459 questions
0
votes
1
answer
22
views
PostgreSQL logical replication without a static IP
I have a PostgreSQL database that is running on AWS. I also have a database running locally on a Raspberry Pi, that is supposed to replicate the changes from the AWS one. I was thinking of using ...
0
votes
1
answer
153
views
RDS MySQL not using NVMe instance storage - no benefit of "Optimised Reads"
I am load testing various RDS instances trying to optimise db price/performance
I had seen this doc https://docs.aws.amazon.com/AmazonRDS/latest/UserGuide/rds-optimized-reads.html and it sounded like ...
- 528
0
votes
0
answers
22
views
RDS Mysql replica cdc performance
I have a RDS Mysql which has high read/write volume. ~10k IOPS on an average and peaks up to 16k IOPS.
I have another RDS mysql replica of the main. We are using this replica to capture cdc logs and ...
0
votes
0
answers
46
views
MySQL 8 Replication Master-Master fatal error
I have two servers with the same MySQL 8.0.40. I set up a Master to Master replication.
When I run the command SHOW REPLICA STATUS\G; on both servers, I see an error: The replica I/O thread stops ...
- 101
0
votes
0
answers
43
views
MySQL log_bin and relay_log base_name.extension
Some of the MySQL clusters I manage have the following my.cnf settings:
log_bin = mysql-bin.log
relay_log = mysql-relay-bin.log
For the log_bin setting the .log extension is not needed because ...
- 1
0
votes
0
answers
46
views
How can I find what's eating so much space in Postgres in AWS RDS Aurora?
Essentially when I run
SELECT
pg_size_pretty(SUM(pg_total_relation_size(relid))) as total_size,
pg_size_pretty(SUM(pg_indexes_size(relid))) as index_size,
pg_size_pretty(SUM(pg_relation_size(...
- 101
1
vote
1
answer
26
views
SSMS Version of 2008R2 Publisher not compatible with 20012 Subscriber
I am setting up transactional replication on my 2008R2 server to 2012 distribution server to 2012 Subscriber server. All the three servers are on FULL recovery mode. Log backup is taken every 15 ...
- 13
0
votes
0
answers
86
views
SQL Server On Linux. Error MSSQL_REPL20024
Background:
I had a temporary SQL Server 2019 (v15) database on windows. I set up an UBUNTU 22.04 server with SQL Server 2022 (v16) and migrated the data to that new instance.
I then set up an ...
cmwa
0
votes
0
answers
192
views
How to grant SYSTEM_VARIABLES_ADMIN permission to master MySQL user or rds_superuser_role from MySQL Workbench hosted on RDS?
Using MySQL 8.0.39 on an AWS RDS insteance, for troubleshooting purposes we want to be able to Enable/Disable the global general_log setting , being able to turn it on and off easily and quickly from ...
- 9
0
votes
1
answer
77
views
Postgres Logical Replication - how to see what subscriber is doing with received data?
I've got two Postgres 13 databases on AWS RDS.
One is a master, the other a slave using logical replication.
Replication has fallen behind by about 350Gb.
The slave was maxed out in terms of CPU for ...
- 317
1
vote
2
answers
62
views
Does regular truncate & insert hurt performance?
We have a large (5 TB) PostgreSQL 15 RDS that acts as a data warehouse, data comes in through regular pipelines and then ~20 users run analytic queries on it.
Our infrastructure people have access to ...
- 559
0
votes
1
answer
40
views
Added Articles Are Being Ignored
there is a publisher --> distributor --> subscriber setup and all has been well configured in this system and a few simple tests of adding a few tables and re-snapping tables seems to work well.
...
- 629
0
votes
1
answer
116
views
Error in 'Distribution Cleanup' job
I neede some help with this problem.
Using MS SQL Server, I have a replication setup and working from Server A to server B.
There is a clean up Job that has to run on the agent -
'Distribution clean ...
- 101
1
vote
0
answers
94
views
How to troubleshoot logical replication on Postgresql, when it comes to high replication lag?
I have a use case in which we use AWS DMS to stream data to our data lakes (S3), from time to time the replication lag gets out of control, leading to over 500Gb in replication slot lag.
It was also ...
- 11
0
votes
0
answers
11
views
How to see number of storage volumes on AWS RDS MySQL?
According to https://docs.aws.amazon.com/AmazonRDS/latest/UserGuide/CHAP_Storage.html, for "400–65,536 GiB" storage MySQL RDS will use "Number of volumes provisioned = 4".
I have ...
1
vote
2
answers
102
views
How to work around "row is too big" for role definitions without recreating the database?
I am running into the row is too big (ERROR: 54000: row is too big: size 9976, maximum size 8160) error in Postgres related to role permissions on a couple of my instances. I understand that after ...
- 11
0
votes
1
answer
18
views
Can wal_level be set to logical for both pitr recovery and logical replication?
My database cluster currently uses logical replication with wal_level set to logical. How can I integrate Point-In-Time Recovery (PITR) into this setup without changing the wal_level? If it's possible,...
1
vote
2
answers
160
views
Postgres Hot standby stuck starting waiting for contrrecord despite wal file being present
We are experimenting with patroni Multi Datacenter HA with postgres16 using replication slots. At high level for building the remote cluster from scratch , we are by running base backup, while active ...
- 121
1
vote
1
answer
32
views
Why free storage space dip on MySQL replica?
I have AWS RDS MySQL 8.0.36 primary-replica setup. I see this storage free space dip on the replica only. Any ideas why it happened?
0
votes
1
answer
24
views
MongoDB Replication for Backup
Our's is a small application. Every day we do mongodump and take DB backup to Amazon Glacier. Instead of this I would like to use MongoDB replication that will copy actual database on another ...
- 111
0
votes
1
answer
40
views
Can I compress SQL Server Replication Subscriber tables before the snapshot is applied to the Subscriber?
I am setting up a Staging/PreProd environment by taking nightly backups of our Prod environment and applying them to our new PreProd environment. This part is working well.
Unfortunately, we have a ...
- 331
0
votes
0
answers
25
views
Clash of Auto increment column in MySQL during replication
I am trying to figure out a way to have 2 Aurora MySQL clusters in a Multi master setup where both clusters can serve traffic, and the data should be in sync between both clusters even if it is ...
YusufDoc
2
votes
0
answers
76
views
AWS RDS PostgreSQL -
We have an AWS RDS PostgreSQL (v14.10) instance running on a db.t3.micro instance. Randomly throughout the day (some days more than others), our .NET Core application starts failing with the following ...
- 121
0
votes
0
answers
197
views
MySQL slave replication fails with error code 1032
We are running a MySQL DB master server version 8.0.36-0ubuntu0.22.04.1 and MySQL DB slave server version 8.0.39-0ubuntu0.22.04.1, where replication fails after a few hours with this in /var/log/mysql/...
- 9
0
votes
0
answers
31
views
MSSQL on AWS: remote user unable to establish connection via SSMS
Newly created MSSQL 2017 SE instance, using SQL authentication. I am able to connect to it with no issues via my corporate VPN. Overseas user on VPN is unable to connect, getting this error from SSMS:
...
- 143
1
vote
1
answer
49
views
Why do I get a unique constraint violation error when updating a logical replica?
I have two docker containers with PostgreSQL. I want to replicate data from existing tables in a database called wiki. I have tried using pglogical and the native logical replication feature. However, ...
- 111
0
votes
0
answers
22
views
PostGreSQL 12 : Logical Replication - Specific Schemas
0
I've two database servers : Host 1 & Host 2
On the Host 1, I've several schemas in the database :
SchemaA
SchemaB
SchemaC
etc...
I would like set in place a logical replication from Host 1 to ...
- 1
0
votes
0
answers
41
views
How can I avoid downtime for AWS RDS SSL/TLS certificate rotation?
I have some production databases in RDS for which I have active connections and writes every minute. The current server certificates are expiring on 22nd August. I tried to update one, it takes 5 ...
- 101
0
votes
1
answer
22
views
PostgreSQL physical and logical replication - key values
PostgreSQL.
When using physical replication, does a given row in a table in the replica database have the same primary key value as its corresponding row in the primary database?
Same question when ...
0
votes
1
answer
55
views
Querying whole PostgreSQL table in replica on CTID
I noticed it is quite fast to query a whole PostgreSQL table in chunks on ctid as explained for example in this Airbyte blog post. I need this for a syncing task that might take from hours to a few ...
- 101
0
votes
1
answer
45
views
MongoDB ReplicaSet system configuration and modeling
I want to create a replica set model that look like this:
PC 1 : ip=1.1.1.1 - The only one that writes
PC 2 : ip=2.2.2.2 - Read only
PC 3 : ip=3.3.3.3 - Read only
Use-case: On PC 1 I have a program ...
1
vote
0
answers
43
views
Snapshot replication fails with error 4817
I have set up snapshot replications between two SQL Servers. There are multiple replication jobs, one for each database. One of subscriber jobs is failing with the error message
2024-07-29 06:05:55....
- 11
0
votes
1
answer
95
views
In what circumstances would you use a different value for gtid_domain_id and server_id in mariadb GTID replication?
I'm learning about MariaDB GTID replication and one thing I am completely stuck on is why GTIDs have both a domain ID and a server ID, which make up the (domain_id)-(server_id)-(sequence_number) in ...
- 109
0
votes
1
answer
61
views
PostgreSQL: Best practises for Deleting huge volume of Data in Replicated Environment
We have a prod database (PostgreSQL13) with a hot-standby(physical replication) as well as logical replication to a different subscriber server. Now we are in requirement of purging few year's record ...
- 395
0
votes
1
answer
66
views
Mysql replication - Access denied for user 'repl'@'hostname' (using password: YES)
I had setup mysql replication using percona Xtrabackup. Replication was from my web server to my local machine. It used to work but my ISP changed IP address and replication stopped working. I'm ...
- 101
0
votes
1
answer
53
views
xp_cmdshell and SQL Server replication process
Do enabling/disabling xp_cmdshell has effect on replication setup?
We have transactional replication setup with our SQL Sever 2014.
- 81
0
votes
1
answer
87
views
Is it possible to make a No-DELETE replica/follower database?
I would like to allow an application's database to execute DELETE statements. However, for analytics purposes, I would like to keep all data, even deleted data.
I'm trying to figure out if there is a ...
- 143
0
votes
1
answer
167
views
Transactional replication is trying to update a row that does not exist yet. Why?
I've been tinkering with SQL Server 2019 and transactional replication for a little while now and I've hit a wall. Looking at the replication monitor I'm seeing the error "The row was not found ...
0
votes
0
answers
23
views
Failed to prune sessions: no pg_hba.conf entry for host, although connection works fine
I am using an AWS RDS Postgres database and Typeorm to connect to the database. I have also configured the RDS database to require a SSL connection. I pass the CA certificate to the database like this:...
- 101
0
votes
0
answers
31
views
MYSQL Replication But While the backup is being uploaded to the slave, the changes in the master are not received
I am trying to do mysql replication. But I want to while the backup is being uploaded to the slave server, the changes in the master are not received.
For example:
I have a user table on my X db. And ...
İbrahim Gunes
1
vote
1
answer
37
views
Decrease high response time when reading large table in MySQL
I have a table with around 80~ million rows called parts.
I have a simple query like this
SELECT line_code, part_number, compressed_part_number, ...[Others columns]
FROM parts
WHERE (@partNumber = ...
- 111
0
votes
0
answers
29
views
EDB Replication behavior
I'm using EDB Replication with 3 postgres databases in MMR Replication.
Let's call them Node1, Node2 and Node3. I have a table "todo" on each one of them and I'm getting some weird behavior.
...
0
votes
1
answer
62
views
MariaDB 10.7 to 10.5 replication issue with DROP DATABASE
Originally posted on StackOverflow
I am helping a client migrate from a MariaDB 10.7 on Windows setup to a MariaDB 10.5 cluster on Debian 11. The Windows server is called win13, the Debian machines ...
- 101
1
vote
0
answers
54
views
Steps to promote a logical replica in PostgreSQL
If I want to promote a logical replica in PostgreSQL, do I have to do any additional setup besides stopping the replication?
I think I can see is sequence values are not replicated so I have do ...
0
votes
2
answers
271
views
Yet another Replicated transactions are waiting for next Log backup or for mirroring partner to catch up
We have a partial transactional replication setup in our environment to make a data subset available to another application.
Application Server 1 -> Tables1.row1/row2/row3 -> Application Server ...
- 1
0
votes
0
answers
40
views
Postgresql Logical Replication from citus distributed table to another citus distributed table
I followed this guide (https://docs.citusdata.com/en/stable/develop/integrations.html) to implement logical replication of the "items" table between two postgres db. On DB1 the "items&...
0
votes
1
answer
71
views
How to run a query against AWS RDS "locally"?
Our company has an RDS instance of a Postgres database in AWS. I don't have much experience with AWS.
I'd like to run a very lengthy query against the database (VACUUM FULL) that may take many hours ...
- 4,690
0
votes
0
answers
37
views
Error Trying to Replicate Database
I am getting the following errors in replication monitor when trying to do a Merge Replication between SQL in two locations
The subscription could not be initialized using an initial snapshot because ...
- 1
0
votes
1
answer
95
views
PostgreSQL logical replication startup on large tables has bursts of activity and long waits
I am attempting to move a large (4TB) Postgresql database from AWS RDS to Azure Database for Postgresql Flexible Server using logical replication (publication/subscription). I am performing the ...
1
vote
1
answer
317
views
MySQL 8.4 community version and replication process setup using caching_sha2_password and secure connection
Trying to setup a replication process between two MySQL Server 8.4.1 servers using a replication user with 'caching_sha2_password' I received the following error using the command "start replica ...
