Questions tagged [amazon-rds]

Amazon Relational Database Service is a web service that makes it easy to set up, operate, and scale a relational database in the cloud.

Filter by
Sorted by
Tagged with
0 votes
0 answers
4 views

AWS RDS: How do I enable connection for specific IP address?

I've been managing a site for over four years, and initially what I did to allow access to the database for some IP address was just editing an existing Security Group called specificip This is what I ...
  • 101
2 votes
0 answers
27 views

Error with pg_trgm indexes while upgrading postgres on RDS

I want to upgrade the major version of my prod Postgres RDS database, from 11.16 to 12.11. I restored a snapshot to do a dry run. When trying to modify the version on AWS, I have the following error: ...
  • 121
0 votes
0 answers
18 views

AWS RDS PostgreSQL suddenly consumed all free space

0 I am Migrating table from On-Prem to AWS using AWS DMS tasks. My On-Prem SQL server total DB's sizes are below 1TB But my RDS storage(PostgreSQL) is taking more space 8TB. still it is increasing. I ...
  • 1
0 votes
0 answers
4 views

Can I generate the commands/script to create an RDS Instance from an existing one?

I have a few development and test RDS instances that I need to drop, but would like to be able to recreate them again if so needed (with the same VPC, Options, etc...). Is there a way to, given an ...
  • 131
1 vote
0 answers
16 views

aws documentation for DMS CDC is confusing

I am following this documentation https://docs.aws.amazon.com/dms/latest/userguide/CHAP_Source.PostgreSQL.html#CHAP_Source.PostgreSQL.Security to enable CDC using logical replication. I have pglogical ...
  • 11
0 votes
1 answer
14 views

postgres 11.3 checksum validation post migration

I am in the process of migrating our AWS RDS postgresql from one account to another with zero downtime. I am going with pg_dump/pg_restore + AWS CDC for ongoing replication. I am looking for a way to ...
  • 11
0 votes
0 answers
32 views

Evaluating AWS RDS Proxy latency overhead

Evaluating some benchmark tests I noticed that there is latency overhead in the transactions to the database using the service provided by AWS: RDS Proxy. The tests were performed against a Postgres ...
  • 101
0 votes
2 answers
21 views

Is it possible to fetch AWS RDS MySQL transaction logs?

I have AWS RDS MySQL instance, without general query logs. Is it possible to get all transaction logs? I understand that MySQL binlog retention time is very short, but obviously, AWS RDS keeps all ...
-3 votes
0 answers
14 views

pg_dump in AWS RDS instance

I do have special case need to take backup (Explicitly pg_dump in compressed format) and push it to S3 bucket possibly. From there, I will take the backup and restore it in another equivalent ...
0 votes
2 answers
82 views

MariaDB 10.6 issue with blocked queries that can't be killed

We have AWS RDS database, MariaDB 10.6.8, and we are facing some issues with queries being blocked, the main issue is that queries would lock the table and this would cause more blocked queries: show ...
0 votes
0 answers
10 views

Match binlog position in 2 different MySQL replicas

I'm trying implement MySQL upgrade approach that would require either no downtime at all or it would be counted in seconds. One of the problems is that these databases are RDS MySQL databases so there ...
0 votes
0 answers
25 views

Fastest way to migrate largish (15 TB) PostgreSQL 11 instance to Aurora 14 in AWS

We have an AWS RDS PostgreSQL 11 cluster (currently version 11.13), in which we have a few databases and some 1500 tables. The RDS cluster is of size "db.r5.xlarge", with 4 vCPUs, 32 GB RAM ...
  • 3
0 votes
0 answers
24 views

Reducing Pg_largeobject size in AWS RDS

We have RDS PostgreSQL database originally ~35GB (now extended to 60 GB). All our core tables are not occupying more than 20MB space but our Pg_largeobject occupies ~35GB though we are not having any ...
  • 1
0 votes
1 answer
31 views

Why RDS MySQL on 100% CPU is still responding?

I sent an ALTER statement that took a long time and I killed some minutes after and then I noticed that CPU usage is almost 100% (98%, 99%, etc). The process is still being listed with "Killed&...
0 votes
0 answers
14 views

PostgreSQL text search with negation context

We have a managed PostgreSQL database on AWS (RDS) and we use it for text search using to_tsvector and phraseto_tsquery with the english configuration. All functions properly except from when looking ...
  • 103
0 votes
1 answer
18 views

AWS RDS MySQL limit connection

We have multiple databases in a single RDS instance. Because of any reason if we have load in 1 database it stops all the databases. I'm not able to move any of the database because of following ...
  • 115
0 votes
0 answers
15 views

Why is a user randomly created in AWS RDS even though the permissions from any host (%) exist?

I have a MySQL database in RDS. There are separate users which are allowed to connect from anywhere. To be more precise, using MySQL Workbench there are different users listed in "Users and ...
  • 1
0 votes
1 answer
16 views

About partition tables with Mysql 5.7 in RDS Amazon

I haven't found anything in the official amazon documentation that tells me at least the pros and cons of partitioning tables in non-IAAS environments. Has anyone of you had this experience, were ...
0 votes
1 answer
39 views

What is MySQL wait state 'wait/synch/mutex/innodb/lock_mutex'

We have an application (on Amazon RDS MySQL 5.7; db.m5.24xlarge; 96 cores) that takes in a lot of data, in parallel processors+queues. It mostly goes to one table, with primary keys not spreading over ...
  • 141
0 votes
0 answers
18 views

Execute SQL file from S3 in MySQL RDS

I have a large (~10Gb) .sql file that I need to run against a MySQL RDS instance. I have placed the file in a bucket in S3. How can I execute that large file against my RDS instance? This is a one-off ...
0 votes
1 answer
163 views

AWS RDS Postgresql and max_worker_processes

AWS RDS Postgresql 12.10 According to https://www.enterprisedb.com/postgres-tutorials/comprehensive-guide-how-tune-database-parameters-and-configuration-postgresql, max_worker_processes Set this to ...
  • 506
0 votes
0 answers
26 views

Loading a csv file in to remote Mysql DB

I have a 70Mb csv with 1.5 million rows with 270 columns and I would like to put it into a MySQL database that is hosted on AWS RDS with the minimum layer. I try to do it with the MySQL Workbench ...
0 votes
1 answer
62 views

Amazon RDS change collate for mysql database in production without downtime

I saw a solution like this below: create a new table like your source table. alter that new table the way you want. insert your data into the new table. create indexes etc. as needed on the new table....
  • 101
-2 votes
1 answer
25 views

AWS TO OCI GOLDENGATE REPLICATION

I want to use oracle Goldengate to my Multi cloud setup database, I'm just wondering if Im required to down my primary database to avoid data discrepancy? or goldengate can sync the data even if my ...
1 vote
1 answer
120 views

How to exceed max_execution_time when running a mysqldump?

Is there any way to exceed max_execution_time when running mysqldump, without changing global max_execution_time? My database is in AWS RDS and I can't change these parameters for the sake of the ...
0 votes
0 answers
37 views

AWS PostgreSQL RDS read-replica replication failing and lagging

I noticed earlier today that the replication from one of our production databases to the read replica was not instant as it usually is. I logged into the AWS console and could see that the replication ...
  • 145
0 votes
0 answers
48 views

What are space requirements for the Postgres database major version upgrade?

I'm using the RDS Postgres database and the current version is 11.13 and want to upgrade it to 12.10. My instance storage is 5000 GB and almost all storage is occupied. Now only ~500 GB are available. ...
1 vote
0 answers
143 views

Is there a way to set innodb_strict_mode on AWS RDS?

Moving an old app that was set up 8 years ago. I've run mysqldump and now I'm trying to load it into a new MySQL database running on AWS RDS. There was a mismatch in types. There was a text field that ...
1 vote
1 answer
117 views

How to Restore to AWS RDS SQL Server from TDE Enabled SQL DB(on-premises) backup file stored in S3

I have a on-premises TDE enabled SQL DB backup file available in S3 along with Cert and Pvt Key files. How to restore in AWS RDS SQL DB by utilizing the same master key password provided during source ...
1 vote
1 answer
128 views

AWS RDS Serverless-V2 Postgres restart issues

We have an RDS Serverless-V2 Postgres cluster setup with two instances (one read/write, and the other a read). Both instances are in the same AZ for now, although we plan on moving one to a different ...
  • 121
0 votes
0 answers
22 views

Upgrading PostgreSQL RDS fails because of "SET SESSION AUTHORIZATION"

We have an analytics database that was originally on-prem that we migrated to RDS 5 years ago. We have about 2 dozen users grouped into different project groups with their own schemas typically owned ...
  • 489
-1 votes
1 answer
80 views

Design database for history data

I want to create a database with history data score. For example in June 2011 the keyword had score 102. In July 2020 the same word had score 203. What would be the best database design for this. I ...
0 votes
0 answers
18 views

AWS RDS for MySQL and On-Prem MySQL multi-master replication error 1236 from master when reading data from binary log

I am trying to set up a GTID multi-master replication between On-Prem MySQL and AWS RDS MySQL, so RDS MySQL should act as replica for On-Prem MySQL and vice versa. Due to the fact that we have a ...
  • 1
0 votes
2 answers
97 views

AWS RDS Sql Server READ_COMMITTED_SNAPSHOT

We're currently running Multi-AZ SQL SERVER (Mirroring) and would like to turn READ_COMMITTED_SNAPSHOT on. It doesn't look like this option is available in the parameter group or rdsadmin stored ...
0 votes
0 answers
21 views

What issue will i run into for real time data writing and reading with lots of table using RDS PSQL

I have a solution that writes sensor data to a database every minute but I do not think the way we have our database is scalable. We are using one database and each sensor has its own table. We have ...
1 vote
0 answers
390 views

Why AWS RDS PostgreSQL suddenly consumed all free storage

I've got a AWS RDS PostgreSQL (13.x). The DB had 100 GB storage of which around 30 GB was used. Suddenly, during one day all the free storage was eaten by PostgreSQL (so it seems) and even after ...
0 votes
0 answers
50 views

Determining Correct DB power for AWS RDS MySQL

I'm no database expert so hoping someone can help - I currently have a dedicated server with 16CPUs which runs a MySQL database as well as my applications. My database size is about 10GB and want to ...
  • 101
2 votes
0 answers
93 views

Why is this DELETE causing my Aurora MySQL 5.7 instance to crash?

I have a large table (2.3TB of data, 1.9TB index, 33 billion rows). A user recently executed a DELETE statement (32k rows) against the table, which caused the server to eat up all memory and then fail ...
  • 121
0 votes
0 answers
102 views

How to reduce disk usage on a RDS Postgres instance after a significant increase following a VACUUM(FULL, ANALYZE, VERBOSE)?

We have a Postgres 13 database that has been slowly but steadily increasing its disk usage on Amazon RDS. Right before a VACUUM(FULL, ANALYZE, VERBOSE) command it was ~300 GB, but afterwards it jumped ...
1 vote
0 answers
698 views

Dbeaver restore database Error 1277 you need the SUPER, SYSTEM_VARIABLES_ADMIN or SESSION_VARIABLES_ADMIN privilege for this operation

I'm attempting to import a .sql file to restore a database(hosted on AWS RDS) however this error keeps coming up. ERROR 1227 (42000) at line 18: Access denied; you need (at least one of) the SUPER, ...
0 votes
1 answer
90 views

How to clear AWS RDS Aurora MySQL local storage?

I got a warning message about running out of AWS RDS local storage. The free storage capacity for DB Instance: {MY INSTANCE NAME} is low at 2% of the provisioned storage [Provisioned Storage: 157.36 ...
1 vote
2 answers
255 views

MySQL RDS: Drop formerly huge table without freezing DB?

I am using MySQL 5.6 in AWS RDS. I want to drop a table that used to have 8 billion rows. Hearing that dropping a large table can freeze the database, I instead chose to delete the rows using a loop. ...
0 votes
0 answers
37 views

why MySQL is trying to resolve '**ip**.client.mchsi.com'?

I have a mysql instance on Amazon RDS and recently I'm receiving this error message in: error/mysql-error-running.log. [Warning] [MY-010058] [Server] Hostname '<ip>.client.mchsi.com' does not ...
  • 1
0 votes
1 answer
41 views

php mysql aggregating/ combining queries to reduce db connections

I have a use case where a large number of clients are reporting their operational states every minute using an HTTP connection to a php script. For each client, I have a row in a mysql table with ...
  • 101
0 votes
0 answers
129 views

AWS RDS database replication replicates everything regardless my parameters group

I have a database in RDS that I want to replicate. I made a parameter group where I described which tables I want to be replicated. I applied it to my replica, and still it replicated the whole ...
0 votes
1 answer
168 views

fivetran replication from PostgreSQL (connector Broken with WAL log error)

PostgreSQL RDS instance having physical replication to multi-AZ, same instance also enabled for Fivetran replication copying data to BigQuery using WAL logical test-decoding. Multiple issues here: ...
0 votes
0 answers
249 views

How to understand and decrease Innodb_rows_read.avg (RDS INNODB)?

I am looking to understand what's behind Innodb_rows_read value and how to decrease it. For some unknown reasons my RDS server has been over 90% of CPU for more than 5 days and after investigation, ...
  • 109
1 vote
2 answers
704 views

How to restore a RDS Postgres instance from a snapshot exported to S3?

Amazon RDS Postgres database are backed up as snapshots automatically. Because of the high storage costs ($0.095 per GB-Month), I want to move them to S3 (Storage Class: Glacier Deep Archive: 0.00099 ...
0 votes
0 answers
83 views

LOAD DATA LOCAL INFILE - server's temporary file storage

While reading docs, I came across following: When LOCAL is used, the client program reads the file and sends its contents to the server. The server creates a copy of the file in the directory where ...
0 votes
0 answers
235 views

Refresh materialized view on Postgresql 11 on RDS

We are currently on Postgres 11.13 on AWS RDS. I am trying to create a materialized view that takes about 6-7 minutes to run. What is the best way to keep this MV mostly up to date? I was thinking of ...
  • 101

1
2 3 4 5
18