All Questions
Tagged with amazonrds or amazon-rds
337 questions with no upvoted or accepted answers
2
votes
0
answers
390
views
How to backup a local database to cloud database?
I am about to start developing a POS software as my new project with python and electron js. It is going to be a desktop application.
However, my concern is it should work in both cases when desktop ...
- 121
2
votes
1
answer
162
views
Regularly updating table with huge amount of rows
I have a table containing (in addition to some metadata) a score and a boolean flag:
CREATE TABLE scores
(
score_id SERIAL NOT NULL
CONSTRAINT score_pkey
PRIMARY KEY,
user_id ...
- 371
2
votes
1
answer
282
views
How does an encrypted DynamoDB (the same question applies to RDS as well) query work?
I am trying to understand whether the primary key is encrypted when I choose to encrypt at rest for AWS DynamoDB
If the primary key is encrypted, how does a primary-key lookup get
performed under the ...
- 121
2
votes
0
answers
654
views
AWS RDS PostgreSQL - Managing Permissions
Relatively new to AWS RDS PostgreSQL environment. We are creating a database with multiple schemas. Users are grouped by "schema_role" that have privileges to create objects in assigned schemas.
My ...
- 21
2
votes
0
answers
582
views
understanding mysqlslap concurrency
I have a RDS instance running in AWS. By default
max_connections=45
so I used mysqlslap to see how it works. I ran:
mysqlslap --concurrency=20 --host=deleteme.ckn5fsf3nwqp.ca-central-1.rds....
2
votes
0
answers
612
views
Amazon AWS RDS 120GB free storage suddenly became 0GB within less than 2 hours
I've been using AWS RDS db.m4.large with 128GB storage for MySQL(InnoDB) for more than one year now.
The size of my database is now less than 2GB and the free storage had always been more than 125GB ...
2
votes
0
answers
919
views
AWS RDS POSTGRES - Japanese/Chinese Full Text Search support
I have a requirement to support FTS (Full Text Search) of Japanese and Chinese on PostgreSQL.
I am aware that there are extensions to handle this however AWS RDS PostgreSQL appears to restrict the ...
- 121
2
votes
0
answers
492
views
Workaround for lack of init-file on AWS RDS MYSQL
I'm trying to replicate my existing hosting configuration on AWS. My problem is that in the current MARIADB configuration, I have an init file that loads several memory tables. And apparently AWS ...
williamk
2
votes
0
answers
1k
views
Using PGPool with RDS Slave replicas, any advice?
I have a Postgres 9.4 RDS instance with Multi AZ, and there's a slave, read-only replica.
Up to this point the load balancing was made in the business layer of my app, but it's inneficient and I was ...
- 345
2
votes
0
answers
4k
views
Why does my AWS-RDS storage, under billing, say its approaching the limit (20GB) when my DB size is only 10MB?
I only have one instance running on my AWS RDS as Psql DB. The size of my DB, which has twenty tables but all the data amounts to 10MB. As for the screenshot I added, it says the month-end estimate of ...
- 121
2
votes
0
answers
529
views
MySQL replication RDS Master - RDS Slave
I have read many posts about replication from RDS to external and vice versa. But my need is actually a bit different. I need to set replication between two RDS instances.
Of course I know about ...
- 121
2
votes
0
answers
232
views
Debugging random slow query spikes on Index Only Scans
We have a query that for majority of requests (about 400rpm) executes in around 2ms but occasionally we have one request that will spike to 100ms+. My Googleing may be terrible but does anyone have ...
- 121
2
votes
0
answers
151
views
Mirror data on local SSD storage to conserve EBS I/O?
I have an AWS instance with local (ephemeral) SSD storage backed by a permanent EBS storage. Is it possible to configure the local storage to act as a mirror/cache for row data in MySQL? I do not wish ...
- 473
2
votes
0
answers
57
views
What is the best way to keep track of 1000 RDS hosted databases?
I want to know what is 'best-practices' for managing an extreme number of RDS instances. I have no problem managing five. But managing dozens or hundreds, that's another task. I'm thinking use a ...
2
votes
1
answer
524
views
High Write Count/sec in my RDS server
Recently we have encountered seriously problem since we moved our mysql database from EC2 to RDS.
We do have high cpu usage before moved to rds, but our website has a good speed for our customers. ...
- 29
2
votes
0
answers
189
views
Keep selected tables synchronized across MySQL databases
I've a need that requires me to keep a number of tables from a database (db1) synchronized with another database (db2). db1 & db2 have different structures and a set of tables and their data from ...
- 143
2
votes
0
answers
427
views
mysqldump restore error
I am getting the error below, while restoring a dump to RDS MySQL 5.6. Dump is taken from MySQL 5.5 originally. I tried restoring twice but same error. Can anyone help
ERROR 1064 (42000) at line ...
- 367
2
votes
0
answers
294
views
Postgres: missing disk space after truncate and re-insert
We've got a IP address range dataset stored in a table that was truncated and then re-populated with a slightly modified version of the dataset (almost identical in size).
However, after truncating ...
- 121
2
votes
0
answers
3k
views
Amazon RDS - Can't access MySQL DB from local machine
I read many questions/answers here but they are from a different interface from AWS Console. I created a DB Instance but can't create a rule in the security groups that's allows me to connect from my ...
- 21
2
votes
0
answers
474
views
MySql Very Slow Writes & Out of memory error
I am having a rds db instance in AWS which is used by Drupal 7 instatllation.
I am getting the below error messages in the log:
> 130912 11:57:39 [ERROR] /rdsdbbin/mysql/bin/mysqld: Out of memory
&...
- 133
2
votes
0
answers
7k
views
'Access Denied' in MySQL on AWS RDS
I'm trying to use an ETL (in my current case, the free version of Talend). I've successfully set up a MySQL on Amazon RDS, logged in through the MySQL Workbench for Mac, and uploaded my company's ...
- 143
1
vote
0
answers
45
views
How can I improve the performance of a "cold" (first) run of this seemingly simple query?
I'm working on a specific query which has been slowing down an application for some time. The table in question has about 55 million rows.
A "cold" (first) run of this query usually takes ...
- 193
1
vote
2
answers
102
views
How to work around "row is too big" for role definitions without recreating the database?
I am running into the row is too big (ERROR: 54000: row is too big: size 9976, maximum size 8160) error in Postgres related to role permissions on a couple of my instances. I understand that after ...
- 11
1
vote
1
answer
37
views
Decrease high response time when reading large table in MySQL
I have a table with around 80~ million rows called parts.
I have a simple query like this
SELECT line_code, part_number, compressed_part_number, ...[Others columns]
FROM parts
WHERE (@partNumber = ...
- 111
1
vote
0
answers
31
views
how to use Amazon SCT to connection to an Amazon RDS database?
Apparently, Amazon SCT can be used to compare two schemas for differences.
We have several RDS Postgres databases, using Native postres authentication.
SCT has the option to connect to an RDS database ...
- 213
1
vote
0
answers
191
views
AWS RDS MySQL "manual" read replica in "Waiting for dependent transaction to commit" state but lag is zero
I have an SOP I use to upgrade AWS RDS instances running MySQL with no downtime that I have been following since 2021. I'll outline my method below, but it involves manually hooking up a new master ...
- 111
1
vote
1
answer
107
views
DROP and TRUNCATE table on MySQL 8.0.35 freezes the DB
We recently upgraded from MySQL 5.7 to MySQL 8.0.35 in AWS RDS.
There is a log table that services write to and we rotate it daily, using RENAME TABLE command.
Later when we perform a DROP or TRUNCATE ...
- 125
1
vote
0
answers
40
views
AWS SQL - High CPU Usage from select * from #spproccol
SQL 13.x will intermittently spike a CPU usage (60-90%). It will stay high so we added AWS Performance Insights. These queries are not something we have defined or used but something is calling them ...
- 11
1
vote
0
answers
237
views
Aurora RDS - difference between ConnectionAttempts and DatabaseConnections
So I have read this a few times about these two metrics: ConnectionAttempts and DatabaseConnections.
Based on the above, is RDS rejecting lots of connections? Here are the graphs of these two metrics.
...
- 11
1
vote
0
answers
3k
views
AWS RDS Postgres: How to diagnose CheckpointLag and potential slowups using AWS' Monitoring suite?
We are currently hosting a postgres RDS database and our team is noticing slowup in our querying service. I'm noticing a spike in the metric, CheckpointLag and I've been tasked in trying to find where ...
1
vote
0
answers
320
views
RDS MySQL Cluster: Cannot Grant SET_USER_ID
On an RDS MySQL 8.0.33 cluster, I'm trying to grant the SET_USER_ID privilege to a migrations@% User so that that account can change the DEFINER on some views. I'm using the Master account, root, ...
- 111
1
vote
0
answers
203
views
MySQL -> MariaDB Replication throws Collation Error
We are moving from MySQL on AWS RDS to MariaDB on-premise. To do so without downtime, we planned to create a replication first between the MySQL master and the MariaDB slave and then promote the ...
1
vote
1
answer
2k
views
Reduce 'wait/sql/table/io/handler' load of high frequent updates on the same rows
We have a time-series application that also writes all the records to kind of a 'head' table in MySQL. This is somewhat of a legacy, but very interwoven and hard to get rid of. The problem is, that it'...
- 191
1
vote
0
answers
170
views
Ways to reduce latency in importing data from csv files into MySQL Workbench when connected to an RDS MySQL db Instance
This question is a follow-up to this question I asked on Stack Overflow yesterday after answering my own question by creating a Aurora MySQL db Instance and establishing a connection between it and ...
- 227
1
vote
0
answers
150
views
Persistent problems connecting MySQL Workbench to an AWS RDS DB
I started off my attempt to figure out how to connect my local MySQL Workbench (8.0.32) client/application to an RDS Database on my analytics team's AWS Account by asking Bing AI and this is what it ...
- 227
1
vote
2
answers
327
views
Does creating read replica in AWS RDS clear DATA_FREE of all the tables
We have a MySQL table where DATA_FREE has grown to TB in size. We are not in a position to run optimize on such larger table where we have Billions of Rows. We did POC in lower environment where we ...
- 111
1
vote
0
answers
67
views
DR - Missing binlogs in Maxwell
We have a standard db.r6g.2xlarge RDS MySQL instance running in production with 2 replicas. Maxwell CDC is setup to publish binlogs to a Kafka topic.
From a RPO point of view: in the worst case (say ...
- 111
1
vote
0
answers
126
views
How this performance graph may be interpreted?
My configuration is:
Compute
AWS ECS cluster with a Django based API (Using ORM). 1vCPU and 4GB of memory per container.
Database
RDS MariaDB db.t3.medium instance (2 vCPU, 4GB of memory)
gp3 type ...
- 111
1
vote
0
answers
97
views
How to encrypt a production unencrypted RDS Aurora MySQL 8 cluster
I have a running RDS Aurora MySQL 8.0.23 cluster running in production. The database is unencrypted and I need to enable encryption for it. As far as I understand, this is not possible to do directly. ...
- 111
1
vote
0
answers
146
views
Assign privileges to a postgres user
I am working on creating a postgres user and assign certain privileges to the user. These are privileges to execute certain functions with the end goal of being able to replicate data or change-data-...
- 111
1
vote
0
answers
144
views
Backup data from RDS to S3 and delete from RDS once copied to S3
We have a requirement werein we have to backup data from RDS(MYSQL and Postgres) to S3 incrementally and to delete the already copied data from RDS. I thought of using aws data-pipeline for this, ...
- 83
1
vote
0
answers
952
views
Does the "max vCPU" limit only apply to the "CPU" wait state?
In the Average Active Sessions chart of Performance Insights for Aurora MySQL 8, there is a horizontal Max vCPU (at 16, in my case). Now I wonder if this limit applies only to the CPU wait state (...
1
vote
2
answers
228
views
AWS RDS MariaDB update from 10.2 to 10.3 now has slowed my queries
This AWS RDS MariaDB server has been running for 5+years now.
After the automatic Amazon RDS update from 10.2 to 10.3, the server had downtime (during the update), then after it went online, the read ...
1
vote
2
answers
610
views
Automating MySQL replication using snapshots on AWS RDS (or Linux)
I'm currently working on a BASH script to build a new Aurora cluster based on the latest snapshot of an existing cluster, then set up MySQL replication from the old one to the new. In the past I've ...
- 143
1
vote
0
answers
162
views
aws documentation for DMS CDC is confusing
I am following this documentation https://docs.aws.amazon.com/dms/latest/userguide/CHAP_Source.PostgreSQL.html#CHAP_Source.PostgreSQL.Security to enable CDC using logical replication.
I have pglogical ...
- 101
1
vote
1
answer
145
views
Match binlog position in 2 different MySQL replicas
I'm trying implement MySQL upgrade approach that would require either no downtime at all or it would be counted in seconds. One of the problems is that these databases are RDS MySQL databases so there ...
- 181
1
vote
0
answers
3k
views
Dbeaver restore database Error 1277 you need the SUPER, SYSTEM_VARIABLES_ADMIN or SESSION_VARIABLES_ADMIN privilege for this operation
I'm attempting to import a .sql file to restore a database(hosted on AWS RDS) however this error keeps coming up.
ERROR 1227 (42000) at line 18: Access denied; you need (at least one of) the SUPER, ...
1
vote
1
answer
712
views
How to clear AWS RDS Aurora MySQL local storage?
I got a warning message about running out of AWS RDS local storage.
The free storage capacity for DB Instance: {MY INSTANCE NAME} is low
at 2% of the provisioned storage [Provisioned Storage: 157.36 ...
- 111
1
vote
0
answers
633
views
Refresh materialized view on Postgresql 11 on RDS
We are currently on Postgres 11.13 on AWS RDS. I am trying to create a materialized view that takes about 6-7 minutes to run. What is the best way to keep this MV mostly up to date? I was thinking of ...
- 111
1
vote
0
answers
112
views
Delete Temporary Tables from Abandoned ALTER Query
I had some big tables, where the running ALTER query timed out.
Is there a way to remove the temporary tables created by this ALTER query, as they are taking up a huge amount of storage.
I am on RDS.
...
- 123