Questions tagged [amazon-rds]

Amazon Relational Database Service is a web service that makes it easy to set up, operate, and scale a relational database in the cloud.

Filter by
Sorted by
Tagged with
1 vote
0 answers
26 views

AWS RDS MySQL "manual" read replica in "Waiting for dependent transaction to commit" state but lag is zero

I have an SOP I use to upgrade AWS RDS instances running MySQL with no downtime that I have been following since 2021. I'll outline my method below, but it involves manually hooking up a new master ...
Amer's user avatar
  • 111
2 votes
0 answers
30 views

'Deadlock found when trying to get lock; try restarting transaction' in AWS RDS MySQL 8.0.36 after upgrading from MySQL 5.7.42. Django v4.1.6

Following an upgrade of our AWS RDS instance from MySQL version 5.7.42 to version 8.0.36, we are encountering persistent deadlock issues across concurrent transactions, affecting even basic read ...
Karan Raj's user avatar
0 votes
0 answers
32 views

AWS RDS SQL Server 2019 Standard edition, everyday 3 am getting errors "insufficient system memory in resource pool 'internal' to run this query"

I have AWS RDS SQL Server 2019 Standard edition with 128GB RAM, everyday 3 am getting errors insufficient system memory in resource pool 'internal' to run this query There are few jobs that run at a ...
Praveen Suhalka's user avatar
0 votes
0 answers
32 views

How does AWS Data Migration Service actually work with MSSQL?

I'm very confused as to how AWS Data Migration Service is actually achieving it's replication from an on prem MS SQL 2019 instance to RDS 2019. I understand from the documentation that tables with a ...
RPD's user avatar
  • 1
0 votes
1 answer
24 views

drop database hangs with "Waiting for table metadata lock" in MySQL8 RDS on AWS

We have a large table in a database that a user tried to run DELETE * FROM table on. It was still running the next day so we killed the process. I tried renaming, dropping and truncating the affected ...
George's user avatar
  • 126
0 votes
1 answer
35 views

What could cause replication to break on MySQL when replicating from 5.7.40 to 8.0 replica

We have a MySQL primary running on 5.7.40. We are in process of testing the upgrade to 8.0.36 (this is on AWS RDS). We had 2 MySQL-8 replicas and 2 MySQL-5.7 replicas replicating from the primary. At ...
Rahul's user avatar
  • 119
0 votes
1 answer
74 views

Postgres: Investigate RAM usage of a connection

Via pg_proctab(), I can see that the connections from our application can use up to 800MB of RAM per connection in postgres. Usually up to 400MB. (Update to clarify after a comment: These connections ...
Peter's user avatar
  • 144
0 votes
1 answer
113 views

How to cancel vacuum process in AWS RDS PostgreSQL

Is there a way to cancel an automatic vacuum in rds postgresql? When running select pg_cancel_backend(...); select pg_terminate_backend(...); with a user that has the rds_superuser role an error ...
Vasileios Giannakidis's user avatar
1 vote
1 answer
55 views

DROP and TRUNCATE table on MySQL 8.0.35 freezes the DB

We recently upgraded from MySQL 5.7 to MySQL 8.0.35 in AWS RDS. There is a log table that services write to and we rotate it daily, using RENAME TABLE command. Later when we perform a DROP or TRUNCATE ...
AlexV's user avatar
  • 125
0 votes
1 answer
54 views

Select query with 90+ parameters intermittently 20x slower on RDS PostgreSQL instance when using connection pool

I'm running a select statement on a postgresql table (on an RDS instance) in order to sum up values across 2 mil rows. The select statement has about 100 parameters (mostly different countries we want ...
Arnfred's user avatar
  • 101
0 votes
1 answer
82 views

Aurora PostgreSQL TEMP TABLE creation taking more CPU than expected?

I'm running on an Aurora PostgreSQL on a db.x2g.2xlarge instance. Simply creating temporary table showed up as the third highest wait, which surprises me, as I expected it to be one of the lighest ...
Joe's user avatar
  • 1,635
1 vote
0 answers
30 views

AWS SQL - High CPU Usage from select * from #spproccol

SQL 13.x will intermittently spike a CPU usage (60-90%). It will stay high so we added AWS Performance Insights. These queries are not something we have defined or used but something is calling them ...
Brad G's user avatar
  • 11
0 votes
0 answers
70 views

Aurora RDS - difference between ConnectionAttempts and DatabaseConnections

So I have read this a few times about these two metrics: ConnectionAttempts and DatabaseConnections. Based on the above, is RDS rejecting lots of connections? Here are the graphs of these two metrics. ...
Abs's user avatar
  • 1
0 votes
0 answers
7 views

Aurora3 RDS MySQL Stored function/trigger performance when using information_schema

Since moving to Aurora3 RDS (MySQL 8 based) vs Aurora 2 (MySQL 5.7 based) noticed that execution time of certain triggers and stored functions performance has degraded. Correlation between triggers ...
BigKiwiDev's user avatar
0 votes
0 answers
26 views

What is the correct configuration for an RDS instance to allow for upgrades when the databases are very large?

I've been using Amazon RDS instances for Postgres databses for a while, but I haven't had to do a lot of upgrading on large databases until recently. I hit an issue where one database was hundreds of ...
trueCamelType's user avatar
0 votes
0 answers
38 views

MySQL - Can FLUSH TABLES Be Triggered Automatically by MySQL Itself?

As it says in the title, I am looking to determine whether MySQL itself will, on its own, issue a FLUSH TABLES command at any point. I have yet to find anything that points to a specific answer to ...
Marisa's user avatar
  • 23
0 votes
0 answers
5 views

Aurora RDS MySQL historical database recovery from historical snapshot and master snapshot?

I was able to simulate a transactional cluster replicating to a historical cluster and it does all the changes, inserts, updates, deletes. I was able to do an archiving delete so those deletes did ...
Dean Hiller's user avatar
0 votes
0 answers
46 views

Unable to connect to AWS mysql RDS instance

I created an AWS mySQL RDS instance (free tier), but i am unable to connect to it from workbench or cli. I have enabled public access to the DB while creation and allowed "All traffic" while ...
Ankit Rustagi's user avatar
0 votes
3 answers
65 views

select count(*) takes too much time in RDS/MySQL during high traffic

Setup: db.t3.xlarge RDS instance. MySQL 8.0.33 engine. Default parameter and options group. ~900k records table. RDS has no logging enabled at all, and we cannot restart the instance for now to ...
Nico's user avatar
  • 3
0 votes
0 answers
28 views

How to fix high px deq slave session stats in Oracle RDS

We are seeing some high percentage of "px deq slave session stats" waits in our Production database.(this maintained on AWS RDS). Due to which outage is happening many times from searching ...
Arun's user avatar
  • 13
1 vote
2 answers
84 views

SQL Server Combine Partioned Backups Files to One?

Scenario: Every day you receive a SQL Server 2016 database backup set that is composed of multiple partitioned .bak files of size 1GB each: backup1.bak (1GB) backup2.bak (1GB) backup3.bak (1GB) ... ...
gbeaven's user avatar
  • 213
2 votes
1 answer
178 views

Column used in the publication WHERE expression is not part of the replica identity

I'm trying to create a logical replication setup where I have a single large database with smaller read replicas branching of filtered on a sub id. For example, if I wanted a subset of items pushed to ...
goldfishalpha's user avatar
0 votes
1 answer
69 views

How to atomically update different databases?

I have a lambda function which receives data of newly signed up users from a message queue and insert that same data in two different databases. Those two databases belong to two different ...
Prerak Jain's user avatar
1 vote
1 answer
68 views

Upgrade Postgres RDS in AWS fails major version upgrade

I have been attempting to upgrade our AWS RDS Postgres from 11.22 to 12.17 and/or 15.5 In both instances I get the following error in the error log: executing: SELECT datname, datallowconn FROM ...
sweetfa's user avatar
  • 188
1 vote
0 answers
909 views

AWS RDS Postgres: How to diagnose CheckpointLag and potential slowups using AWS' Monitoring suite?

We are currently hosting a postgres RDS database and our team is noticing slowup in our querying service. I'm noticing a spike in the metric, CheckpointLag and I've been tasked in trying to find where ...
Andrew Narvaez's user avatar
8 votes
1 answer
554 views

How to add index to a big table with 60M records without downtime?

we have been struggling with one issue in the past few days. We want to add an index to a huge table with 60M records. At first we tried adding it with basic mysql syntax. But it clogged our ...
Rohan's user avatar
  • 33
0 votes
1 answer
260 views

Amazon Aurora RDS (serveless) - How to match an ACU in terms of CPU number and memory

I need to migrate an Amazon RDS back to on-premises envoriment. How to How to match an ACU in terms of CPU number and memory? My instance has: Minimum capacity 1 ACUs (2 GiB) Maximum capacity 10 ACUs (...
Astora's user avatar
  • 713
0 votes
2 answers
48 views

Oracle Batch Deletion

I have an Oracle table that has over 1.8 Billion rows, I need to delete up to 260 million of these rows. I am a Microsoft SQL DBA, so not fully comfortable with the Oracle syntax and best practices ...
Stockburn's user avatar
  • 419
0 votes
0 answers
116 views

RDS MySQL Cluster: Cannot Grant SET_USER_ID

On an RDS MySQL 8.0.33 cluster, I'm trying to grant the SET_USER_ID privilege to a migrations@% User so that that account can change the DEFINER on some views. I'm using the Master account, root, ...
benbotto's user avatar
  • 101
0 votes
0 answers
89 views

AWS ORACLE to AWS RDS -- Error ORA-01406 even with the InlineLobMaxSize parameter set to 63

I am making a full load of a table with a 9 million rows with a lob column BLOB. And is about 100G in space, with AWS DMS With a Full LOB mode it takes an eterniy (More than 2 days). I tried Inline ...
user avatar
0 votes
0 answers
38 views

How do I temporarily enable mysql.general_log in AWS Aurora Serverless V2?

I am trying to debug an issue and I just need to see the general log of a mysql instance. Is there any way of temporarily enabling or routing the logs to a file/cloudwatch for a minute or so? ...
Archimedes Trajano's user avatar
0 votes
0 answers
23 views

Managed database or docker image with data-volume?

I've mostly used managed database (AWS RDS) for production. I was fiddling with docker and was wondering if it's a good idea to have containerised postgres database with data-volume? I feel it may not ...
Indyarocks's user avatar
5 votes
1 answer
2k views

Adding a Primary Key to a Large PostgreSQL Table with High Traffic

I need to add a primary key to a large PostgreSQL table (approximately 2TB) with high traffic. This is a critical operation, and I'm looking for guidance on how to do it efficiently. I have already ...
sujeet's user avatar
  • 235
0 votes
0 answers
232 views

Database owner unable to create tables under Postgres 15 (RDS)

I realise a change was introduced relating to default permissions in Postgres 15: https://www.postgresql.org/about/news/postgresql-15-released-2526/, specifically PostgreSQL 15 also revokes the ...
whoasked's user avatar
  • 251
0 votes
0 answers
27 views

Enable syncing DB dump between tenants in a multi-tenant Postgres database

Our Java application stores data pertaining to multiple tenants in one single DB instance on AWS RDS. This setup is replicated across regions in prod. There are multiple schemas and each table within ...
deGee's user avatar
  • 111
0 votes
0 answers
59 views

Data validation for RDS PostgreSQL migration

I'm planning to replace a bunch of RDS PostgreSQL databases using this method defined by AWS. The DMS task will run will be CDC-only. I came up with data validation requirements for the migration and ...
trouble_bucket's user avatar
0 votes
1 answer
115 views

MySQL - AWS RDS - Replication node is stopped

I have a replication node on RDS that when shown on AWS Console it states that there's an error on RDS replication node (ERROR) and it has stopped replicating. What can I do to restart the replica? ...
JohnnyAce's user avatar
  • 101
1 vote
3 answers
450 views

Sudden spike in BinLogDiskUsage

Two days ago our MySQL RDS instance saw a sudden spike in BinLogDiskUsage, CPUUtilization, NetworkReceiveThroughput and NetworkTransmitThroughput. The result was a database that was extremely slow to ...
RED_Tom's user avatar
  • 13
0 votes
1 answer
331 views

Connecting to AWS RDS succeeds via terminal but fails in pgAdmin 4. Why?

I can establish an SSH tunnel using ssh -L 2222:<RDS-Endpoint>:5432 ec2-user@<EC2-IP> -i ~/.ssh/key.pem and then connect to my RDS using psql "host=localhost port=2222 user=postgres ...
Frikster's user avatar
  • 103
0 votes
1 answer
105 views

Is it possible to query Oracle system tables (DBA_USERS,dba_role_privs,dba_tab_privs) Using Db_link?

Is it possible to query Oracle system tables (DBA_USERS,dba_role_privs,dba_tab_privs) Using Db_link? I am getting ORA-00942: table or view does not exist when tried to query the same.
Arun's user avatar
  • 13
0 votes
0 answers
17 views

About error Error Code: 1872. Coordinator stopped because there were error(s) in the buffer_pool_size (s) RDS MYSQL 5.7

My replication instance is a read replica in rds Amazon, with those configurations select @@innodb_buffer_pool_size; 99857989632 SELECT @@innodb_buffer_pool_instances; 8 SELECT @@...
Marco Antonio's user avatar
0 votes
1 answer
41 views

Amazon AWS credits system for SQL Server Connections

I remember there was some credit system in 2019 in AWS Sql Server, which regulated how many times you could connect per second (minute?), based on how much you paid. Over night, during idle, you would ...
T.S.'s user avatar
  • 216
0 votes
0 answers
54 views

How to Restore RDS TDE enabled backup into another RDS SQL Server 2019?

I enabled TDE encryption on RDS SQL SERVER with default RDS CERTIFICATE. I took native backup of same RDS on S3 bucket and want to restore same backup file into another RDS SQL SERVER. Source - RDS ...
Md Mumtaz Alam's user avatar
0 votes
1 answer
146 views

IF EXISTS doesn't stop errors on RDS Postgres 11.19 instance

Recently one of our RDS Postgres databases was upgraded to version 11.19. Since then, we're receiving errors when running a database migration. I can't replicate this issue locally, it appears to be ...
Ben Hitchcock's user avatar
0 votes
0 answers
150 views

Assigning new role to already existing user in RDS

"We have an RDS instance hosted for Aurora PostgreSQL, specifically using the 'db.r5.xlarge' instance type. When we initially set up the RDS instance, a default user named 'rdsadmin' was ...
Naresh Barule's user avatar
0 votes
1 answer
173 views

How can I tell which query uses an index in MySQL?

I have investigated my indexes in MySQL using performance_schema.table_io_waits_summary_by_index_usage which has told me that one of my indexes is used in one database environment (Production EU) but ...
mjaggard's user avatar
  • 125
0 votes
1 answer
86 views

Improving bandwidth from RDS postgres

When I do $ time psql -c "select repeat('a', 123456789)" -o /dev/null -U postgres -h hostname I reliably get about 10 seconds, making the transfer speed ~12 MB/sec. I'd like to do better. I ...
Craig Younkins's user avatar
0 votes
0 answers
60 views

TDS-Protocol with pre-login failure message when connecting to Amazon RDS (SQL Server)

We are trying to connect from an application installed on a virtual machine to a database as part of an AWS RDS in the cloud. There are several routers and firewalls between the source and the target ...
Marek Margas's user avatar
0 votes
1 answer
377 views

MariaDB large number of sessions waiting on index_tree_rw_lock

I have a MariaDB RDS instance that is mostly saving batched insert statements to 4 tables. These inserts have batches of an average of 200/batch and each statement saves to a single table. However, ...
ryanrasa's user avatar
0 votes
0 answers
12 views

Migrating Access DB using SQL Server Migration AssistantAWS SQL Server RDS instance . I made sure that I have the correct port and instance name

Connection to SQL Server failed. A network-related or instance-specific error occurred while establishing a connection to SQL Server. The server was not found or was not accessible. Verify that the ...
Abiel Yemane's user avatar

1
2 3 4 5
20