Questions tagged [amazon-rds]
Amazon Relational Database Service is a web service that makes it easy to set up, operate, and scale a relational database in the cloud.
933
questions
0
votes
1
answer
16
views
Amazon Aurora RDS (serveless) - How to match an ACU in terms of CPU number and memory
I need to migrate an Amazon RDS back to on-premises envoriment. How to How to match an ACU in terms of CPU number and memory?
My instance has:
Minimum capacity
1 ACUs (2 GiB)
Maximum capacity
10 ACUs (...
- 630
0
votes
2
answers
37
views
Oracle Batch Deletion
I have an Oracle table that has over 1.8 Billion rows, I need to delete up to 260 million of these rows.
I am a Microsoft SQL DBA, so not fully comfortable with the Oracle syntax and best practices ...
- 429
0
votes
0
answers
22
views
RDS MySQL Cluster: Cannot Grant SET_USER_ID
On an RDS MySQL 8.0.33 cluster, I'm trying to grant the SET_USER_ID privilege to a migrations@% User so that that account can change the DEFINER on some views. I'm using the Master account, root, ...
- 101
0
votes
0
answers
18
views
AWS ORACLE to AWS RDS -- Error ORA-01406 even with the InlineLobMaxSize parameter set to 63
I am making a full load of a table with a 9 million rows with a lob column BLOB.
And is about 100G in space, with AWS DMS
With a Full LOB mode it takes an eterniy (More than 2 days).
I tried Inline ...
Centas
0
votes
1
answer
303
views
Connecting to MariaDB server: ERROR 2013 (HY000): Lost connection to server at 'handshake: reading initial communication packet', system error: 11 [closed]
I am trying to connect to an AWS hosted (RDS) MariaDB database (engine version 10.6.14). The database is hosted on a private subnet but it's accessible through a bastion host. I use an SSH tunnel to ...
0
votes
0
answers
18
views
How do I temporarily enable mysql.general_log in AWS Aurora Serverless V2?
I am trying to debug an issue and I just need to see the general log of a mysql instance. Is there any way of temporarily enabling or routing the logs to a file/cloudwatch for a minute or so?
...
0
votes
0
answers
20
views
Managed database or docker image with data-volume?
I've mostly used managed database (AWS RDS) for production. I was fiddling with docker and was wondering if it's a good idea to have containerised postgres database with data-volume?
I feel it may not ...
- 101
5
votes
1
answer
898
views
Adding a Primary Key to a Large PostgreSQL Table with High Traffic
I need to add a primary key to a large PostgreSQL table (approximately 2TB) with high traffic. This is a critical operation, and I'm looking for guidance on how to do it efficiently.
I have already ...
- 213
0
votes
0
answers
106
views
Database owner unable to create tables under Postgres 15 (RDS)
I realise a change was introduced relating to default permissions in Postgres 15: https://www.postgresql.org/about/news/postgresql-15-released-2526/, specifically
PostgreSQL 15 also revokes the ...
- 251
0
votes
0
answers
22
views
Enable syncing DB dump between tenants in a multi-tenant Postgres database
Our Java application stores data pertaining to multiple tenants in one single DB instance on AWS RDS. This setup is replicated across regions in prod. There are multiple schemas and each table within ...
- 101
0
votes
0
answers
25
views
Data validation for RDS PostgreSQL migration
I'm planning to replace a bunch of RDS PostgreSQL databases using this method defined by AWS.
The DMS task will run will be CDC-only. I came up with data validation requirements for the migration and ...
- 129
0
votes
1
answer
59
views
MySQL - AWS RDS - Replication node is stopped
I have a replication node on RDS that when shown on AWS Console it states that there's an error on RDS replication node (ERROR) and it has stopped replicating. What can I do to restart the replica?
...
- 101
1
vote
3
answers
174
views
Sudden spike in BinLogDiskUsage
Two days ago our MySQL RDS instance saw a sudden spike in BinLogDiskUsage, CPUUtilization, NetworkReceiveThroughput and NetworkTransmitThroughput.
The result was a database that was extremely slow to ...
- 13
0
votes
1
answer
139
views
Connecting to AWS RDS succeeds via terminal but fails in pgAdmin 4. Why?
I can establish an SSH tunnel using ssh -L 2222:<RDS-Endpoint>:5432 ec2-user@<EC2-IP> -i ~/.ssh/key.pem and then connect to my RDS using psql "host=localhost port=2222 user=postgres ...
- 103
0
votes
1
answer
56
views
Is it possible to query Oracle system tables (DBA_USERS,dba_role_privs,dba_tab_privs) Using Db_link?
Is it possible to query Oracle system tables (DBA_USERS,dba_role_privs,dba_tab_privs) Using Db_link?
I am getting ORA-00942: table or view does not exist when tried to query the same.
- 13
0
votes
0
answers
15
views
About error Error Code: 1872. Coordinator stopped because there were error(s) in the buffer_pool_size (s) RDS MYSQL 5.7
My replication instance is a read replica in rds Amazon, with those configurations
select @@innodb_buffer_pool_size;
99857989632
SELECT @@innodb_buffer_pool_instances;
8
SELECT @@...
0
votes
1
answer
33
views
Amazon AWS credits system for SQL Server Connections
I remember there was some credit system in 2019 in AWS Sql Server, which regulated how many times you could connect per second (minute?), based on how much you paid. Over night, during idle, you would ...
- 206
0
votes
0
answers
42
views
How to Restore RDS TDE enabled backup into another RDS SQL Server 2019?
I enabled TDE encryption on RDS SQL SERVER with default RDS CERTIFICATE.
I took native backup of same RDS on S3 bucket and want to restore same backup file into another RDS SQL SERVER.
Source - RDS ...
0
votes
1
answer
90
views
IF EXISTS doesn't stop errors on RDS Postgres 11.19 instance
Recently one of our RDS Postgres databases was upgraded to version 11.19. Since then, we're receiving errors when running a database migration.
I can't replicate this issue locally, it appears to be ...
0
votes
0
answers
106
views
Assigning new role to already existing user in RDS
"We have an RDS instance hosted for Aurora PostgreSQL, specifically using the 'db.r5.xlarge' instance type. When we initially set up the RDS instance, a default user named 'rdsadmin' was ...
0
votes
1
answer
87
views
How can I tell which query uses an index in MySQL?
I have investigated my indexes in MySQL using performance_schema.table_io_waits_summary_by_index_usage which has told me that one of my indexes is used in one database environment (Production EU) but ...
- 113
0
votes
1
answer
68
views
Improving bandwidth from RDS postgres
When I do $ time psql -c "select repeat('a', 123456789)" -o /dev/null -U postgres -h hostname I reliably get about 10 seconds, making the transfer speed ~12 MB/sec. I'd like to do better.
I ...
- 103
0
votes
0
answers
34
views
TDS-Protocol with pre-login failure message when connecting to Amazon RDS (SQL Server)
We are trying to connect from an application installed on a virtual machine to a database as part of an AWS RDS in the cloud.
There are several routers and firewalls between the source and the target ...
0
votes
1
answer
229
views
MariaDB large number of sessions waiting on index_tree_rw_lock
I have a MariaDB RDS instance that is mostly saving batched insert statements to 4 tables. These inserts have batches of an average of 200/batch and each statement saves to a single table. However, ...
- 1
0
votes
0
answers
10
views
Migrating Access DB using SQL Server Migration AssistantAWS SQL Server RDS instance . I made sure that I have the correct port and instance name
Connection to SQL Server failed.
A network-related or instance-specific error occurred while establishing a connection to SQL Server. The server was not found or was not accessible. Verify that the ...
0
votes
0
answers
14
views
RDS PostgresSQL
I have to replicate a database as close to a production db as possible.
The production DB is 300gb, in my demo rds db in my personal account I will most likely select roughly 150gb but is there anyway ...
- 1
0
votes
1
answer
190
views
Understanding RAM Usage, ReadThroughput, and Freeable Memory Metrics in PostgreSQL RDS
I'm facing an interesting issue related to RAM usage, ReadThroughput, and Freeable Memory metrics with my PostgreSQL database on an RDS instance, and I'm hoping to get some insights here.
Two months ...
- 11
0
votes
0
answers
87
views
How do RDS Proxy credentials work?
In AWS RDS, there exists an RDS Proxy managed service. The console requires supplying database credentials when setting up this proxy. Why is this?
That is, why doesn't the proxy simply pass through ...
- 101
1
vote
0
answers
96
views
MySQL -> MariaDB Replication throws Collation Error
We are moving from MySQL on AWS RDS to MariaDB on-premise. To do so without downtime, we planned to create a replication first between the MySQL master and the MariaDB slave and then promote the ...
1
vote
1
answer
571
views
AWS RDS MySQL upgrade from 5.7 to 8 failing due to ROW_FORMAT
We need to upgrade our DB to version 8, but we're getting an error in the migration log that's preventing us from upgrading.
Creating indexes larger than 767 bytes on tables with redundant row format ...
user3411972
0
votes
0
answers
22
views
Last GTID on replica matches source but data is not there
We have a following set up:
Multi A-Z source RDS instance (MySQL 8.0.32)
Single #1 A-Z replica RDS instance (MySQL 8.0.32)
Single #2 A-Z replica RDS instance (MySQL 8.0.32)
ProxySQL (2.5.2)
Binlog ...
- 97
0
votes
1
answer
93
views
How to reflect the change of `max_sync_workers_per_subscription` during replication
I've changed the parameter max_sync_workers_per_subscription in Amazon RDS Postgresql and verified that it changed in the master database:
db=> show max_sync_workers_per_subscription;
...
- 176
0
votes
0
answers
117
views
Amazon RDS MySQL - write throughput limited to 15 MB / s
We are duplicating the data inside a rather Amazon RDS MySQL big table, about 2 GB of data.
We are doing that by having batches of 30 entries moved at a time (INSERT INTO etc SELECT FROM ... LIMIT x ...
- 101
1
vote
1
answer
88
views
Migrate of Encrypt Columns from SQL Server 2005 To 2019 RDS AWS
good morning,
Perform a migration of an On Premise database:
Microsoft SQL Server 2005 - 9.00.5000.00 (X64) Dec 10, 2010 10:38:40 Copyright (c) 1988-2005 Microsoft Corporation Enterprise Edition (64-...
- 125
0
votes
0
answers
207
views
AWS RDS Postgres: How to see which query/process is using memory
Running a RDS Aurora Postgres cluster with two r6g.2xlarge instances that started fluctuating in memory usage around 6:50pm EST yesterday. Typically we are running with ~16gb headroom but it dips to ~...
- 101
0
votes
0
answers
900
views
Why we're getting so many idle connections in Postgres
We're running a Flask application with RDS Aurora Postgres and we've started to experience the following issue:
Traceback (most recent call last):
File "/usr/local/lib/python3.7/site-packages/...
- 101
0
votes
2
answers
117
views
Interpreting MySQL (AWS RDS) CPU load and IOWAIT wrt threading model
This is a general question, not to solve a problem: Since MySQL uses one thread per connection. That means if you do IO, and it has to wait for it, the CPU that the thread runs on will be in IOWAIT. ...
- 191
0
votes
0
answers
13
views
Procedural Question for Upgrading Hundreds of Critical RDS Databases
I am looking for some advice on a procedural issue I have been running into since moving to RDS.
In the last couple of years we have moved around 300 of our critical databases to Aurora RDS. I have ...
- 21
0
votes
0
answers
146
views
How to debug this tuple await events in RDS PostgreSQL
I have been noticing that sometimes we get a lot of open connections for a long time. Enabling enhanced metrics in RDS PostgreSQL I saw the following:
It seems this tuple wait event is making a lot ...
1
vote
1
answer
760
views
Reduce 'wait/sql/table/io/handler' load of high frequent updates on the same rows
We have a time-series application that also writes all the records to kind of a 'head' table in MySQL. This is somewhat of a legacy, but very interwoven and hard to get rid of. The problem is, that it'...
- 191
2
votes
1
answer
230
views
MySQL read replica using more storage and has more rows than master DB
We have a MySQL RDS instance, with a master and read replica setup. The master DB is used by the prod application, while the read replica is just for engineers to debug and analyse something.
One of ...
- 131
0
votes
0
answers
62
views
MySQL on RDS / AWS (Amazon): performance_schema has no SQL_TEXT and QUERY_SAMPLE_TEXT
We're using Mysql 8.0.32 on RDS, with Performance Insights and auto-managed performance_schema.
The performance_schema mostly works, but some fields are absent.
On performance_schema....
- 21
0
votes
1
answer
277
views
Can I run commands from aws_s3 extensions as non-root on PostgreSQL?
I'm trying to copy data from S3 to PostgreSQL (Amazon AWS RDS). I've set up the following:
CREATE EXTENSION aws_s3 cascade schema reporting;
CREATE DATABASE my_database;
\connect my_database; -- ...
0
votes
1
answer
144
views
How can I monitor and address fragmentation on RDS for Oracle database?
I'm planning to migrate my database from on-premises to AWS RDS for Oracle. However, I'm not sure if Amazon RDS supports tools such as Automatic Fragment Advisor or the Automatic Segment Space ...
0
votes
0
answers
251
views
Sudden momentary dips in aws rds free storage space available
I have been experiencing some sudden momentary dips in the available aws rds free storage space available. Once the free space dips it goes into the storage optimization mode.
I have a postgres table ...
- 1
1
vote
0
answers
97
views
Ways to reduce latency in importing data from csv files into MySQL Workbench when connected to an RDS MySQL db Instance
This question is a follow-up to this question I asked on Stack Overflow yesterday after answering my own question by creating a Aurora MySQL db Instance and establishing a connection between it and ...
- 227
0
votes
0
answers
85
views
AWS RDS CloudWatch vs Performance Insights connection count
My confusion arises from the fact that CloudWatch and Performance Insights seem to show very different metrics for the same time period and the same database instance: where CloudWatch shows ~300 ...
- 133
1
vote
0
answers
72
views
Persistent problems connecting MySQL Workbench to an AWS RDS DB
I started off my attempt to figure out how to connect my local MySQL Workbench (8.0.32) client/application to an RDS Database on my analytics team's AWS Account by asking Bing AI and this is what it ...
- 227
2
votes
1
answer
596
views
What permissions are needed to prevent ERROR: permission denied for pg_tablespace_size('pg_global') in RDS?
I'm looking for some help identifying a permission I need to grant to prevent an error in a proprietary app. The App is loading data into an AWS RDS postgresql database. Loading data is working fine....
- 161
0
votes
0
answers
50
views
We have lost permissions on the topology scheme
we have a postgresql database with postgis, with the following versions:
PostgreSQL 10.21 on x86_64-pc-linux-gnu, compiled by gcc (GCC) 7.3.1 20180712 (Red Hat 7.3.1-12), 64-bit
...