Questions tagged [amazon-rds-aurora]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
0 votes
0 answers
23 views

Is there a parameter to help the query engine to ignore duplicate WHERE clause lines?

I have an Aurora PostgreSQL RDS version 13 database with 60+ million rows where a legacy wildfly / hibernate system generates a T-SQL query with two identical WHERE statements. (Line 3 and 4 below) ...
user avatar
  • 463
1 vote
0 answers
27 views

Aurora Serverless 2 MySQL 8.0 doing a mysqlpump to dump users

Recently i ask about using roles in MySQL 8.0 using aurora 3.0 in a Serverless 2 RDS cluster. They answered me that the correct way to do that is using mysqlpump with the --users parameters to dump ...
user avatar
0 votes
1 answer
211 views

Row size too large (> 8126) - 5.7.mysql_aurora.2.10.0

CreateTableConstraintStep ddlList = (CreateTableConstraintStep) dslContext .createTableIfNotExists(getDSLTableName(List)) .columns(fields) ...
user avatar
0 votes
0 answers
38 views

Does aurora PostgreSQL use wal_buffers?

Can someone shed some light as to whether aurora postgres uses wal buffers or not? Given the way the writes are handled differently, I would like to understand the same while it is being said in the ...
user avatar
0 votes
1 answer
240 views

Analyzing queries with high disk IO

RDS Aurora PostgreSQL 10.14 instance db.r5.4xlarge. I'm trying to figure out some high RDS IO costs in my machine. I'm looking at the pg_stat_statements and asking whether the following query make ...
user avatar
0 votes
0 answers
9 views

How to get names of connection pools from DB tables like INFORMATION SCHEMA?

We have multiple services connect to a database using Hikari. Is there a way to find which connection pools are connected to the DB? Would be ideal if we can see the name and count of connections.
user avatar
  • 101
0 votes
0 answers
33 views

RDS Aurora PostgreSQL took 400GB over time but the database size only 19MB

Already tried to query temporary files (all empty), also replication_slot all empty according to https://aws.amazon.com/premiumsupport/knowledge-center/diskfull-error-rds-postgresql/ Querying database ...
user avatar
  • 1,231
0 votes
1 answer
270 views

Slow query Mysql with Order By and JOIN

I've been investigating an issue with a slow query when trying to get the last 50 comments of a user. To give some context the database size is 9 TiB and the COMMENT table has about 7 billon of rows. ...
user avatar
0 votes
0 answers
374 views

AWS DMS Task failed with error: Error executing source loop; Stream component failed at subtask 0

I want to migrate my PostgresDB hosted in Citus cloud service to AWS RDS Aurora Postgres. I am using AWS DMS service. Have created task but getting following errors: Last failure message Last Error ...
user avatar
0 votes
1 answer
151 views

Parameter innodb_flush_log_at_trx_commit not available in AWS Aurora 5.7

I'm trying to modify the parameter innodb_flush_log_at_trx_commit on a RDS Aurora 5.7 instance from the AWS RDS Web Console and when I look through the parameters in the database I can not find it. ...
user avatar
  • 101
1 vote
1 answer
211 views

Aurora MySQL: how do I keep binlogs around after reboot?

We have a request to enable binlogs on an Aurora MySQL instance and to keep those logs around for a certain amount of time. To test, we enabled binlogging with binlog_format=ROW and set our retention ...
user avatar
  • 31
0 votes
0 answers
481 views

AWS DMS migration not migrated Foreign keys, sequences and indexes got renamed

I have used DMS for AURORA PostgreSQL to PostgreSQL SCHEMA Migration. Migrate Data only type is used for DMS activity. After a Full load of Data, all tables were created on the target endpoint with ...
user avatar
0 votes
0 answers
884 views

How can I downgrade an AWS Aurora MySQL 5.7 2.09.2 to an earlier 5.7 version?

During a test, I applied a branch of our Terraform description that upgraded a couple Auroras from 5.7 2.04.x to 5.7 2.09.2 without losing the data (as expected). When attempting to apply the main ...
user avatar
  • 101
2 votes
2 answers
1k views

Performance issues from RDS Aurora 5.6 to Aurora 5.7

Recently upgraded one of my RDS instances to aurora mysql 5.7 from 5.6 and I've had to triple the instance class while I try to resolve this (cpu eventually pegs and never declines). Most reads are ...
user avatar
  • 121
0 votes
1 answer
371 views

AWS Aurora Mysql different instance types for writer/reader

I have a db.r5.large for the master/writer. I want to add some readers. Do they need to be the same instance type as the master? Or can i add for example 3x db.t3.medium ?
user avatar
  • 101
1 vote
2 answers
1k views

Which AWS RDS; current t3.medium over CPU baseline, but not sure what's the next best option

I currently have one RDS instance, db.t3.medium running Aurora MySQL. Due to increase workload (expected), the CPU is, on average running just over its baseline and therefore in about 10 days will run ...
user avatar
0 votes
0 answers
123 views

AWS Aurora/MySQL server crashes with spatial query

We are using AWS Aurora/MySQL, engine version 5.7.mysql_aurora.2.09.0 and we have a spatial index on a table with ~10,000,000 rows: CREATE TABLE `foo` ( ... `lat` decimal(10,6) DEFAULT NULL, `...
user avatar
  • 1
0 votes
1 answer
1k views

Is there any significant performance difference when using string vs bigint as a primary key in Postgres (Aurora)? [duplicate]

We can use same logic for both types (string/bigint) to generate consecutive ids (e.g. like https://instagram-engineering.com/sharding-ids-at-instagram-1cf5a71e5a5c). This way both are naturally ...
user avatar
1 vote
1 answer
4k views

Is it possible to add Postgres extensions to AWS Aurora?

I am trying to futureproof a Postgres database so it can be transferred to AWS Aurora. I am using the guide extension uuid-ossp. Is it possible to add PostGres extensions to AWS Aurora? In ...
user avatar
  • 303
0 votes
1 answer
271 views

Aurora vacuum not deleting frozen empty pages?

I recently ended up deleting most of the data in one of our tables, on purpose. Normally the table is append-mostly, with a short window during which updates might happen after the original insert. ...
user avatar
0 votes
0 answers
110 views

Why isn't autovaccum running/completing?

My PostgreSQL instance (AWS Aurora) isn't autovacuuming. Or it is, but it is somehow being interrupted or stopped. I'm not canceling any autovacuum queries (though I suppose AWS itself could be). The ...
user avatar
2 votes
1 answer
104 views

Large MySQL database dump/restore [closed]

Got a quite interesting task: Have to dump mysql databases from AWS and restore on a private cloud. Databases are quite big: 160GB, 120GB and 21GB each db.sql dump - all 3 in the same aurora rds ...
user avatar
0 votes
1 answer
971 views

Create row level trigger for Partitioned table

I have created a partitioned table (base), and an audit table for it(base_audit) and then created child tables (c1,c2,c3,..cn). To populate entries in base_audit, I have created a function and a row ...
user avatar
  • 735
0 votes
1 answer
318 views

Limiting user access by subnet to Amazon Aurora PostgreSQL

How do I limit user access by IP? For example, assuming I have two non-superusers (user1 and user2), how can allow general access (only limited by security groups) to the instance/cluster by user1 but ...
user avatar
-1 votes
2 answers
139 views

MySQL Select Query not using Required Index

I have a Table which has 2 Million Records and No primary or Unique Keys. I added Two Indexes and I'm expecting an Index to be used for my Select Query. When I saw the Explain Plan , Optimizer is not ...
user avatar
0 votes
0 answers
861 views

SSHtunnelForwarder to Linux Box, then connect to Postgres RDS (AWS)

I'm trying to write a python script to update DDL in a Aurora RDS (postgres) on AWS. In Order to do this, I need to SSHTunnel to a linux box that sits at the edge of the VPC, then do another jump to ...
user avatar
2 votes
0 answers
348 views

Migrate cluster Aurora RDS postgres from 9.X to 10 without downtime

Ok, this question is to find some strategy or tool that helps me to migrate from cluster Aurora RDS postgres from 9.6 to 10 without downtime. What I find until now Aurora RDS is allowed to do major ...
user avatar
  • 554
1 vote
0 answers
393 views

Constraint creation on a large table is too slow

There's a table with 723M rows, large amount of data and not partitioned. We're adding a constraint to the table as follows: ALTER TABLE ONLY my_table ADD CONSTRAINT partial_constraint EXCLUDE USING ...
user avatar
0 votes
1 answer
2k views

Why and When the pg_stat_activity's most of the columns are null?

Recently, I have noticed that when I query the pg_stat_activity for few users most of the columns are [null] (pgAdmin 4) in the result. Only thing I can see is datid, datname, pid, usesysid, usename,...
user avatar
  • 735
1 vote
1 answer
777 views

mysql/aurora not immediately seeing results of committed transactions

In a system running against an AWS aurora-mysql database, the following (obviously extremely simplified) code runs. It's a highly concurrent system, multiple threads, multiple connections to db. The ...
user avatar
0 votes
0 answers
641 views

AWS DMS: Table Mapping?

We are moving from SQL Server to AuroraDB (mySQL). Both our source database (SQL Server) and our target (AuroraDB) are on AWS RDS so we are naturally using DMS for the migration. We make heavy use ...
user avatar
  • 173
0 votes
0 answers
187 views

AWS aurora mysql is restarted unexpectedly

In our system one of aurora mysql instances was't available for short period. because this instance suddenly restarted at 08/14/2019 3:56JST. we already checked error log for aurora. but i found ...
user avatar
0 votes
2 answers
1k views

Hints on bulk loading 3.6 billion rows to InnoDB on Aurora MySQL

everyone! I'm struggling for a week to bulk load 3.6 billion rows to an InnoDB table on Aurora MySQL 5.6.10a. This table has one FK to a "Main" table and has 12 columns. The first 1.4 billion were ...
user avatar
2 votes
1 answer
966 views

AWS Aurora MySQL Serverless CPU utilization is growing for unknown reason

We have been using Aurora serverless databases in staging and production environments for a few months now, and find the CPU remains in the range 15-20% almost all the time. However in the past week ...
user avatar
  • 21
0 votes
0 answers
457 views

What database should I use locally if I'm going to use Aurora Serverless?

I'm planning to use Aurora Serverless in QA/PROD and then a docker container for running a compatible engine locally. Should I use MariaDB 10.0 or MySQL 5.6? Database need is low, we're not doing ...
user avatar
1 vote
0 answers
615 views

Predicting AWS RDS MySQL Instance Performance

I have a small MySQL db running on AWS RDS t2.small instance. So far, the CPU usage has been very predictable based on the traffic from my app. Example: 1000 concurrent users = 15% CPU 2000 ...
user avatar
  • 111
0 votes
1 answer
562 views

Aws RDS cpu Spike to 100% because of running set isolation command and set

My application running with the AWS RDS as a backend. currently i am doing a performance test. While doing that i am seeing RDS cpu usage goes 100% after 20min. While seeing the performance insights ...
user avatar
1 vote
1 answer
3k views

Error log flooding with aborted connections (Aurora 2.03 - MySQL 5.7.12)

Here's some contextual information: I have a multi-tenant, WordPress MU installation running on Elastic Beanstalk, scaled up to 2 instances minimum. These are connected to the RDS database and are ...
user avatar
  • 13
0 votes
1 answer
816 views

Multi-AZ failover - replica still read only after failover

Setup: I have a single RDS cluster. This cluster has two instances, one in each zone. Naturally, one "replication role" reader and one writer. What happened: I manually triggered a failover of the ...
user avatar
1 vote
0 answers
53 views

Aurora PostgreSQL fail over process

Aurora PostgreSQL: How the process work on failover,I have a primary DB-prod for transaction database and read replica for reporting. where reporting will be pointed if primary fail. similar question ...
user avatar
1 vote
2 answers
985 views

Can AWS Aurora High Availability allow different Schema on Replicas?

Our company is thinking of migrating from SQL Server to Amazon AuroraDB. In SQL Server, there are AlwaysOn and Transactional Replication - two different things. AlwaysOn is utilized more for ...
user avatar