All Questions
Tagged with amazonrds or amazon-rds
337 questions with no upvoted or accepted answers
9
votes
1
answer
2k
views
AWS RDS postrgres massive disk use, small tables
I can't figure out why our AWS postgres server has consumed all of it's space. We just had to up the storage space allocated to it, but can't find any hint from postgres that it's using that much ...
- 621
8
votes
1
answer
1k
views
RDS MYSQL instance rebooted and won't load INNODB table
So my production db in RDS apparently either crashed or was rebooted during a version update, and upon being restarted mysql couldn't load one of the innodb tables: as evidenced by the following error ...
- 203
7
votes
0
answers
1k
views
What can cause slow planning times for "select 1"?
I have a database that is used by a Production application. It's an db.m3.medium on Amazon RDS. We've noticed that a lot of queries are starting to get slow that typically shouldn't be slow (e.g. ...
- 327
6
votes
0
answers
5k
views
AWS RDS Postgres Logical replication
I am using AWS RDS Postgres's and RDS's logical replication support
(Edit: Note, this is not the same as the logical replication featurein PostgreSQL 10. It's AWS RDS functionality based on the same ...
- 61
6
votes
0
answers
3k
views
Random Spikes in DB Connections - Amazon RDS
I'm running an EC2 instance (c3.large) with an RDS instance (db.t2.small). I'm frequently having issues with DB Connections spikes all of a sudden.
PROBLEM:
As you can see, I'm getting huge amounts ...
- 111
6
votes
1
answer
4k
views
Queries running very slowly in Amazon RDS PostgreSQL read-replica
We have been maintaining a project which has both web and mobile application platform. The backend of the project is developed in Django 1.10 and deployed in AWS.
At the beginning, when there were ...
5
votes
0
answers
570
views
Error with pg_trgm indexes while upgrading postgres on RDS
I want to upgrade the major version of my prod Postgres RDS database, from 11.16 to 12.11.
I restored a snapshot to do a dry run.
When trying to modify the version on AWS, I have the following error:
...
- 101
5
votes
1
answer
3k
views
Setting up cloud database for syncing to local SQLite database
Background
I have a SQL Server database hosted on AWS RDS and there are web applications and WEB APIs that talk to the database. The database is a multi-tenant database and we are currently using SQL ...
- 151
5
votes
0
answers
2k
views
Moving extensions in AWS RDS (Postgres)
Initially we installed all extensions in default "public" schema.
Now we have more and more other schemas - thus we want to add extensions and common functions to the schema common.
Unfortunately AWS ...
- 151
4
votes
0
answers
2k
views
Error in ALTER DEFAULT PRIVILEGES
I'm trying to create a new user in AWS Aurora Postgres DB.
Create user worked fine and I can login to the DB using that account.
granting permissions to it isn't.
First:
GRANT ALL on ALL tables in ...
- 149
4
votes
0
answers
1k
views
Using AWS RDS Postgres: Create a superuser with access to all tables (also future created ones)
In AWS RDS (A managed Database service), we cannot create real superusers. There is a user RDS calls Master User, which can create new users, databases, tables, etc.
However, when another user has ...
- 141
4
votes
0
answers
827
views
AWS RDS Performance Insights not showing SQL Server Queries
I enabled Performance Insights on an existing SQL Server database (Express, if it matters) in AWS RDS. If I look at the database load graph and table I do not see any of the queries I am doing in real ...
- 243
3
votes
0
answers
752
views
RDS MSSQL in-place upgrade how to update master db compatibility level when rdsa account is db owner
Background
My workplace infrastructure team ran a typical in-place upgrade of an RDS MSSQL instance to update the version from 2012 to 2017.
After the upgrade, while logged in as the "master ...
- 751
3
votes
0
answers
3k
views
Fast long-to-wide reshaping in PostgreSQL
I am trying to change a really long table (1955451890 rows -- 278 Gb on the DB) to a wide format using crosstab from the tablefunc extension. Following several examples from SO (i.e. Crosstab with ...
- 187
3
votes
0
answers
1k
views
Creating a custom thesaurus dictionary on RDS
We're deployed on RDS using Postgres 11.4, and I'm hoping that there is some way to define a custom thesaurus dictionary. I think the answer is a hard no, based on this StackOverflow thread
and this ...
- 909
3
votes
0
answers
2k
views
Grant Privileges on Production Database Throws "Error: tuple concurrently updated"
I would like to grant read access to all tables in my schema
GRANT SELECT ON ALL TABLES IN SCHEMA public TO XXX;
While it works on our alpha environment, it fails with our production database:
[...
- 183
3
votes
0
answers
6k
views
MySQL RDS Incompatible Restore while creating read replica
We have multiple m5 generation MySQL RDS instance. The problem we are facing is that while creating read replica for these instances we are repeatedly getting 'incompatible-restore' error. In the ...
- 438
3
votes
0
answers
1k
views
AWS Aurora Database Corruption
I'm running Aurora Postgres and noticed that metric Maximum Used Transaction IDs is increasing a lot. Trying to manually vacuum the tables that's was not automatically vacuumed lead me to the ...
- 131
3
votes
0
answers
338
views
User / Client IP restrictions in Postgres running on RDS
I'm looking to restrict connection access for specific accounts based on the client IP. All of our services are running on AWS so I want an account that has R/W permissions to only be able to connect ...
- 131
3
votes
0
answers
267
views
Query store works in dev, but not production in Amazon RDS
I'm having an issue getting query store to collect and record data on our production workload, however, it works as expected on our non-production instances (development and staging).
The only ...
- 31
3
votes
0
answers
2k
views
MySQL delete gradually locks more and more rows
I've encountered a strange problem that I can't explain. MySQL 5.6.34, RDS.
Basically, some delete from table where id in (...) queries are locking up indefinitely, but never truly deadlocking.
I ...
- 83
3
votes
0
answers
3k
views
RDS Aurora 5.6 died (randomly?)
Aurora MySQL 5.6.10a
I can see these events in the console:
February 20, 2018 at 4:27:24 PM UTC+11 <server>-production DB instance restarted
February 20, 2018 at 4:26:52 PM UTC+11 <server&...
- 397
3
votes
0
answers
2k
views
Query Store on Amazon RDS
I'm trying to use Query Store on SQL Server on Amazon RDS, and not having any luck. The query store works for a few hours after each failover, but then stops working. For example, our last manual ...
- 178
3
votes
1
answer
1k
views
AWS RDS Showing CPU spikes on a MySQL system every 5 minutes -- how can I track the cause?
I'm seeing a CPU spike every 5 minutes (though it's not FIXED on the 5 minutes, every so often it's 6 minutes between a spike, then 5, 5, 5 again). None of my code runs on a 5 minute interval (it ...
- 153
3
votes
0
answers
1k
views
Any way to squeeze performance from Postgres JSONB queries?
This is using RDS Postgres 9.5.2
We have a table which contains about 25 columns, and one is a jsonb col that essentially is a simple/flat json object (key/value, not complex objects). The data in ...
- 131
3
votes
0
answers
3k
views
Slow query caused by nested loop on simple join?
I've been struggling with the performance on a query. Trying to do a lookup of a large set of ids in a large table (500GB). I create a temporary table of the ids with the ids as a primary key and run ...
- 195
3
votes
0
answers
546
views
Modify slow query log rotation on Amazon RDS instance
Our Amazon RDS instance rotates slow logs every hour, and keeps only the last 20 of them.
This is not optimal for monitoring as it prevents us from seeing any slow query that might have been ...
- 1,334
3
votes
0
answers
474
views
How can i sync a table between two MySQL RDS insatance
I am trying to sync one table in two of mysql RDS instances
in AWS something like a db link or FEDERATED engine.
3
votes
0
answers
488
views
Best approach to maintain a clone of a db in Postgres RDS
We'd like to maintain a separate database for our dev environment that closely resembles the current state of our production database. What is the best way to do this in RDS? Our current process is to ...
- 31
3
votes
0
answers
1k
views
Slony with Amazon's RDS service?
Is it actually possible to somehow use Slony with Amazon’s RDS service? I’m aware that there’s no such thing as a host that you can log into to make Slony’s configurations, but perhaps it can be done ...
- 1,029
3
votes
0
answers
2k
views
amazon rds logs all queries
I have enabled slow query log on Amazon RDS with following configuration.
long_query_time = 0.5
general_log = 0
log_output = TABLE
min_examined_row_limit = 1000
slow_query_log = 1
...
- 263
3
votes
0
answers
2k
views
MySQL SSL using MariaDB JDBC Driver
We have the following setup:
Ec2 instance running a jboss server with mariadb (1.1.7) datasources setup to connect to an rds instance running MySQL 5.6.21.
We would like to turn on SSL on for this ...
- 131
3
votes
0
answers
2k
views
How to get the best write throughput during a MySQL import with Amazon RDS?
tl;dr - How can we get the maximum EBS throughput for a db.r3.2xlarge instance? We're only seeing about half of what it can supposedly do.
Apologies for the long length of this question. We've had ...
- 131
3
votes
0
answers
1k
views
Optimizing a single table, write-once, read-many PostgreSQL database
I've just finished constructing a table of ~835 million rows using Google's ngram dataset, aggregated on the years in which they occurred so that each 2-,3-,4-, and 5-gram is represented by a single ...
3
votes
0
answers
2k
views
What's causing Postgres to freeze?
I'm using Amazon RDS to run my Postgres database, v9.3.3.
Recently, I had 2 instances where updating the schema caused the database to stop responding and I had to restart it in order to put the site ...
- 377
2
votes
0
answers
76
views
AWS RDS PostgreSQL -
We have an AWS RDS PostgreSQL (v14.10) instance running on a db.t3.micro instance. Randomly throughout the day (some days more than others), our .NET Core application starts failing with the following ...
- 121
2
votes
0
answers
168
views
'Deadlock found when trying to get lock; try restarting transaction' in AWS RDS MySQL 8.0.36 after upgrading from MySQL 5.7.42. Django v4.1.6
Following an upgrade of our AWS RDS instance from MySQL version 5.7.42 to version 8.0.36, we are encountering persistent deadlock issues across concurrent transactions, affecting even basic read ...
- 21
2
votes
0
answers
190
views
force rds proxy to renew credentials on grant change?
I'm using Mysql flavored Aurora with an RDS proxy in front. Most of the time life is good. Sometimes, however, I update a grant giving new new permissions to an account. At these times if I were ...
- 121
2
votes
0
answers
509
views
Why AWS RDS Mysql is not keeping binlog files for "binlog retention hours" value?
I have an AWS RDS Mysql master with 1 AWS RDS slave and 1 ec2 mysql slave replicating this master instance. I already set the binlog retention hours to 7 days with the command:
CALL mysql....
- 21
2
votes
0
answers
123
views
Set custom postgresql.conf for one database on Mac using Postgres.app
I have ~20 PostgreSQL 14 databases on my local development machine running on Postgres.app.
I am trying to pg_restore a single 100GB database to Amazon RDS, but I'm getting some inconsistencies with ...
- 121
2
votes
0
answers
619
views
Why is this DELETE causing my Aurora MySQL 5.7 instance to crash?
I have a large table (2.3TB of data, 1.9TB index, 33 billion rows). A user recently executed a DELETE statement (32k rows) against the table, which caused the server to eat up all memory and then fail ...
- 143
2
votes
0
answers
2k
views
What is the fastest way to copy large postgres(>1TB) database?
Original Problem Statement:
Create a test DB with the latest production database(RDS Postgres)greater than 1.5 TB quickly.
We have 1 production database running in a single instance and we have 8 dev/...
- 121
2
votes
0
answers
607
views
AWS Postgres setting pg_trgm.word_similarity_threshold
Trying to set pg_trgm.word_similarity_threshold on an RDS postgres instance (postgres 12 if it matters):
ALTER SYSTEM SET pg_trgm.word_similarity_threshold = 0.3;
I get the error:
must be superuser ...
- 151
2
votes
0
answers
406
views
AWS RDS upgrade from 8.0.11 to 8.0.19 fails
I am trying to upgrade an RDS database from 8.0.11 to 8.0.17. or 8.0.19.
I started by creating a snapshot, restoring that snapshot, and then trying to upgrade to 8.0.17. The upgrade says it was ...
- 1,232
2
votes
0
answers
2k
views
Does the `hot_standby_feedback=on` may cause `SSL SYSCALL error: EOF detected` error?
On a AWS Master slave hot standby replication schema on Amazon RDS with a single master and a single slave. Both master and replica are being hosted over Amazon RDS on eu-central-1 and the master is ...
2
votes
0
answers
273
views
Is there a way to create tablespace in MySQL RDS
I'm using AWS RDS MySQL instance and using it. Now I want to create table space and assign table space to tables. Is it possible in MySQL RDS
- 41
2
votes
0
answers
980
views
ALTER TABLE ... ADD COLUMN ... NOT NULL is not instant in PostgreSQL 11?
I have read the documentation and it states that adding a column with a non-null and non-volatile default value should not require a table rewrite. However, this does require a rewrite and blocks all ...
- 308
2
votes
0
answers
295
views
AWS RDS Multi A-Z vs DigitalOcean Managed Databases
I am currently hosting my database inside a t2.large instance on AWS EC2 which provides 8GB RAM and 2 CPUs. I am now looking for better options which are more scalable and provides features like ...
- 121
2
votes
1
answer
2k
views
How to sync easily between a master database from Google Cloud SQL and a master database from Amazon RDS
I've created a master - slave (replication) in Google Cloud SQL.
I've also created a master - slave (replication) in Amazon RDS.
I want to sync two master MysQL from Google Cloud SQL and Amazon RDS....
- 161
2
votes
0
answers
205
views
AWS RDS PostgreSQL: Significant query runtime difference between two (identical?) instances
TL;DR: Solution
The problem was that one instance hat magnetic storage attached and was therefore significantly slower.
Original Question
I have two identical AWS RDS PostgreSQL 10.6 databases ...
- 121