Questions tagged [amazon-rds]

Amazon Relational Database Service is a web service that makes it easy to set up, operate, and scale a relational database in the cloud.

Filter by
Sorted by
Tagged with
0
votes
0answers
13 views

Continous data replication between two databases(same RDS instance) in AWS RDS

We have multiple databases in a single RDS instance. Forex A, B, C A and B DB contains the plans table. But some of the fields will be missing under the plans table in B DB. What is the smart way to ...
0
votes
0answers
63 views

RDS PostgreSQL 12.5 bind slow

I have a PostgreSQL 12.5 db.r5.large instance on AWS RDS (16GB of RAM, 2 vCPU) While I'm troubleshooting some slow queries, I have seen these in log quite often: 2021-07-28 12:31:14 UTC:172.21.12.81(...
1
vote
1answer
45 views

RDS Postgres oldest replication lag increases during inactivity even though Fivetran connector keeps synchronizing

I'm in the process of setting-up a datawarehouse using Fivetran as the ETL layer. One of the source databases is a AWS RDS Postgres instance. I've configured the Postgres instance to perform Logical ...
0
votes
0answers
5 views

Optimal way of running hundreds of thousands of DDL/DML statements MySQL

I have about 500k DDL/DML statements that need to be run against a MySQL 5.7 INNODB RDS instance from scratch. A significant portion of these are created table statements. I'm currently employing a ...
-1
votes
0answers
21 views

Can we take pg_dump on Aurora PostgreSQL read replica?

I wondering to know Can we take pg_dump from Aurora PostgreSQL readonly replica? what are the possibilities on it, I don't want to bother writer replica. I want to take daily DB backup and its has ...
0
votes
1answer
25 views

Strange replication failure on date field under MySQL 5.7

This problem cropped up yesterday and I'm quite stumped. I have a primary RDS cluster that is running MySQL 5.6 and RDS is forcing everyone to 5.7 soon. I have a smaller standalone replication slave ...
0
votes
0answers
30 views

High CPU usage in AWS RDS

When I visit the woocommerce orders page in WordPress, MySQL RDS CPU usage goes to 100% but the website is working perfectly fine. In 'active sessions' section, "wait/io/tables/sql/handler" ...
0
votes
0answers
11 views

S3 .sql files to RDS postgres

I have 500 Gb of .sql files stored in an S3 folder and want to execute thoses files on my RDS PostgreSQL instance (.sql files contains insert queries). I have found a command to imports .csv files ...
0
votes
1answer
37 views

Adding index only on read replica of PostgreSQL RDS instance

We have read a replica of our main database that is being used by our data analytics. Now they want to create indexes on the read replica without affecting the main database. I've found that this is ...
0
votes
0answers
41 views

CROSSTAB / cannot extract elements from a scalar HELP PLEASE!

I'm kind of lost here and I really need some wisdom from a Data Expert: cf.item ->> 'name' AS "custom_field" they want everything as a column and not create them as a row and cf.item -...
0
votes
1answer
18 views

Mysql Replication trigger not executing on slave

Mixed replication is enabled. MySQL master has a table Products that has triggers on update and delete. On slave database we have different trigger on same table on update and delete. Master database ...
0
votes
1answer
16 views

Index maintenance on pg_catalog tables in AWS RDS

I have had some bad historical usage on my Aurora PostgreSQL instance. Namely, connections that create a lot of temporary objects and some very long running transactions (which limits autovacuum). Now ...
0
votes
2answers
73 views

10B rows table in MySQL

We have a table in MySQL (RDS) with 4B rows. It has 3 indexes, one of which is UNIQUE. Table size including indexes is around 400GB. Currently it's on db.r5.2x - 8 CPUs, 64GB RAM. Write patterns are a ...
0
votes
0answers
22 views

Is it possible to use check_user_proxy on AWS RDS?

My top-level goal is to enable two-user (zero-downtime) secret rotation for RDS users. To recap/summarize the approach, you always have two accounts in your DB that have equivalent access. You switch ...
0
votes
1answer
19 views

Is a connection from my SSL-secured server to an RDS instance automatically encrypted when using mysqli_connect?

I'm trying to determine if I need to use mysqli_ssl_set to encrypt my db layer. I have a standard Amazon RDS instance that I'm connecting to with MySQL user and pass, but I'm unsure if that connection ...
0
votes
0answers
19 views

Why is this logical replication slot using so much space?

I have 3 RDS postgres instances. Each has a single database, and in each database I've created a logical replication slot: SELECT pg_create_logical_replication_slot('test', 'wal2json'); Two of the ...
0
votes
0answers
23 views

AWS-RDS database catalog is restricted

I use PostgreSQL 13.2 in AWS-RDS. The database is up and working properly; I can connect with the user provided by Amazon. We need to alter the catalog to enable the implicit cast of integer to ...
-1
votes
1answer
16 views

AWS RDS snapshot restore from west to east

have query related to snapshot restore . my rds snasphot are copied everday from west to east region everyday after automated daily rds backups task gets completed. However however last one month ...
0
votes
1answer
39 views

delete obsolete archivelog

I have an oracle instance aws recently migrated to RDS aws I just noticed that my database is set by default in archivelog mode and that the archivelog are not deleted who has any idea how deleted the ...
0
votes
0answers
24 views

Python / AWS RDS - 300 insert statements taking 10 minutes to complete

I'm using Python 3.7 with SQLAlchemy on Ubuntu 18.04. I have two MySQL Databases - a local instance hosted on bare metal and an Amazon RDS instance. Both are accessible from MySQL Workbench on my ...
0
votes
1answer
82 views

How to fix file format in tables after upgrade of mysql 5.6 -> mysql 8.0.23 in AWS RDS?

I upgraded mysql 5.6 -> mysql 8.0.23 in AWS RDS. There is a warning: Creating indexes larger than 767 bytes on tables with redundant row format might cause the tables to be inaccessible. You have ...
0
votes
1answer
28 views

postgresql vacuum analyze on restored snapshot

Frequently we restore a Postgres DB from a RDS snapshot to an entirely new RDS instance. We notice that queries on certain tables perform really slowly but improve by a huge magnitude after running ...
0
votes
1answer
17 views

MySQL Replication from On-Premises to AWS

I have an on-premises DB server running MySQL 5.5.37 with multiple databases. I created database on the AWS RDS. The idea is to set the replication from on-premises to the AWS, but for only one ...
0
votes
1answer
16 views

How to reduce MySQL performance_schema memory usage caused by thousands of unique hosts?

I have a problem with some performance_schema tables (*_by_host_* and *_by_account_*) taking up too much RAM. It is caused by clients connecting from a /19 subnet (8190 unique addresses). The ...
0
votes
1answer
25 views

MySQL: Reason for Degraded performance of a single inner join

We have two tables in our MYSQL 5.7 Aurora database: CUSTOMER_ORDER and BATCH. Customer order can have only one batch associated and it is not mandatory to have one. Create table statement of ...
0
votes
0answers
7 views

AWS RDS MySQL: Strange difference between monitoring and actual processes?

I have an RDS Mysql instance with a reader and a writer. A while ago I set up a scheduled event, which copies the contents of information_schema.processlist to a log table, adding a timestamp. Now I ...
0
votes
1answer
20 views

Elusive problem on AWS RDS MySQL

I have a provisioned, single-master RDS DB (5.6.mysql_aurora.1.23.0) with a writer and a reader. The clients are a bunch of jetty applications with a pool of up to 250 connections each. I have for ...
0
votes
1answer
40 views

How can Amazon RDS grant CREATE EXTENSION to their RDS_SUPERUSER role?

I've been trying for some time to allow ordinary, non-superuser users to create extensions. While reading across RDS documentation, I find that their internal "master user", rds_superuser, ...
2
votes
2answers
111 views

Migrating MySQL 8.0.20 database to AWS Aurora

I originally posted this question on stack overflow as I did not know this service existed and someone suggested I may get a better answer here. I was trying to use the AWS RDS Proxy service and ...
0
votes
1answer
64 views

Unable to connect to an AWS RDS read replica of MySQL

I'm not able to connect to an AWS RDS MySQL read replica. $ mysql -h my-db-read-replica.qprdbd0pavr5.us-east-1.rds.amazonaws.com -umyname ERROR 2003 (HY000): Can't connect to MySQL server on 'my-db-...
0
votes
0answers
43 views

Is offsite replication from MySQL AWS RDS with encrypted RDS storage possible? How?

AWS RDS for MySQL now supports encrypted storage backends. This encrypts the MySQL data and binlogs with a key within AWS's key management system, thus causing offsite replication issues because we ...
0
votes
0answers
6 views

Why ephemeral port been used when connect to AWS RDS?

Among multiple accounts in AWS, from one EC2 in account 1 connect RDS in account 2, from the VPC flow logs, got this message 2 023910321035 eni-12309fdsaj0jf012 ACCOUNT_1_EC2_IP ACCOUNT_2_RDS_IP 45052 ...
1
vote
2answers
266 views

Performance issues from RDS Aurora 5.6 to Aurora 5.7

Recently upgraded one of my RDS instances to aurora mysql 5.7 from 5.6 and I've had to triple the instance class while I try to resolve this (cpu eventually pegs and never declines). Most reads are ...
0
votes
1answer
27 views

Amazon Athena database — is there a way to generate an Data Schema for Amazon ML in an automated way

Amazon Athena database -- is there a way to generate an Data Schema for Amazon ML in an automated way (e.g. a SQL command that would generate the Amazon-format) Please see: https://docs.aws.amazon.com/...
0
votes
1answer
43 views

Why does this simple select by primary key show such intensive CPU usage?

I have advanced performance metrics enabled for my m6g.xlarge MySQL instance in RDS. I'm noticing that the during CPU spikes (which are expected given our app), that it seems a simple query is ...
1
vote
1answer
33 views

What schema does this mean 'mysql - schema's default character set: utf8'?

While upgrading mysql from 5.6 -> 5.7 -> 8.0.23 in step 5.7 -> 8.0.23 I got a warning: The following objects use the utf8mb3 character set. It is recommended to convert them to use utf8mb4 ...
0
votes
0answers
20 views

Same query taking different execution times on equivalent RDS instances

The train table has around 60million records all of which have their updated_at timestamp in the year 2021. The schema of the table is as below. Table "public.train" ...
0
votes
1answer
81 views

What are some likely causes of high Client:ClientRead AAS in AWS RDS?

I have a particular query, its a simple select with an inner join. Seems to be pretty well indexed. But it's registering as a worst offender in performance insights. With a 0.13 on CPU and a 4.5 on ...
0
votes
0answers
32 views

Unable to replicate Postgres tables using logical replication in RDS

Tables in the destination database are empty even after subscription is successful. I am extremely new to logical replication within Postgres. I am trying to replicate three tables from the source ...
0
votes
0answers
58 views

Flushing hosts without being able to connect to the host

I'm seeing this dreaded error: Host '10.0.12.34' is blocked because of many connection errors; unblock with 'mysqladmin flush-hosts' The server is an RDS instance running in AWS. There are VPC rules ...
0
votes
0answers
222 views

Weird slow queries after update RDS from 5.7.26 to 8.0.21

We have ~500dbs having ~110 tables each. DB was running on t2.medium instance for multiple years. I noticed that IO was growing gradually and reached not really nice avg values of 220-250 iops. So we ...
1
vote
1answer
18 views

MsSql express export from local pc to RDS, how to transfer NDF/LDF files?

First time mssql admin here. Never worked with mssql before I might asked question improperly. Couldn't find any posts mentioning ndf/ldf files import to AWS RDS mssql database. Is data from these ...
0
votes
0answers
17 views

AWS RDS Database not in a VPC, no SSL

If an AWS EC2 Server is connecting to an AWS RDS Database, but the database + server are not part of a VPC, and there is no SSL setup on the database... Does that mean the data is being sent over HTTP ...
0
votes
1answer
32 views

Do MySQL limitations apply to MariaDB as well on AWS RDS

I am thinking of migrating MariaDB 10.3.13 to RDS, I want to do an analysis of what limitation can be caused by migrating to RDS, I could find no documentation by AWS for MariaDB for issues and ...
0
votes
1answer
158 views

AWS Postgres RDS “storage-full” and not responding. How to bring back online?

I cannot reboot nor stop the DB in AWS console. I cannot connect it with PG Admin. My Java app also print error like this. org.postgresql.util.PSQLException: Connection to xxxx.us-east-1.rds....
0
votes
1answer
17 views

What is the name of the process for creating a new DB from an exported snapshot? [closed]

I need to set up an automated process that: creates a snapshot of an AWS RDS (MySQL) DB uses that snapshot to create a new RDS instance that will be used as an "analytics playground" I'm ...
0
votes
0answers
79 views

Ideal CDC Latency for SQL Server Replication

I am seeking to understand what the ideal latency for an implementation of CDC in SQL Server Standard (2017) is. The latency I am referring to can be found from the sys.dm_cdc_log_scan_sessions DMV ...
1
vote
1answer
42 views

Same postgres query in two different instances with the same data but with different times

I have the same postgres query running in two different instances restored with the same dump file: one instance in aws rds => https://explain.depesz.com/s/USMO ('PostgreSQL 11.10 on x86_64-pc-...
1
vote
0answers
57 views

Ltree query performance optimization of Postgres RDS DB

I have a AWS RDS m5.large Postgres 10.13 database that performs a lot of the following queries SELECT "bundles".* FROM "bundles" WHERE "bundles"."version_id" = $...
0
votes
0answers
31 views

Performance Insights MySQL RDS cannot change Counter Metrics or download full SQL

This is probably some permissions issue but I am trying to use Performance Insights on the AWS console for several MySQL RDS instances that are supposedly configured for it. I am following the ...

1
2 3 4 5
16