Questions tagged [amazon-rds-aurora]
The amazon-rds-aurora tag has no usage guidance.
41
questions
0
votes
0
answers
23
views
Is there a parameter to help the query engine to ignore duplicate WHERE clause lines?
I have an Aurora PostgreSQL RDS version 13 database with 60+ million rows where a legacy wildfly / hibernate system generates a T-SQL query with two identical WHERE statements. (Line 3 and 4 below)
...
- 463
1
vote
0
answers
27
views
Aurora Serverless 2 MySQL 8.0 doing a mysqlpump to dump users
Recently i ask about using roles in MySQL 8.0 using aurora 3.0 in a Serverless 2 RDS cluster.
They answered me that the correct way to do that is using mysqlpump with the --users parameters to dump ...
0
votes
1
answer
211
views
Row size too large (> 8126) - 5.7.mysql_aurora.2.10.0
CreateTableConstraintStep ddlList =
(CreateTableConstraintStep) dslContext
.createTableIfNotExists(getDSLTableName(List))
.columns(fields)
...
0
votes
0
answers
38
views
Does aurora PostgreSQL use wal_buffers?
Can someone shed some light as to whether aurora postgres uses wal buffers or not? Given the way the writes are handled differently, I would like to understand the same while it is being said in the ...
0
votes
1
answer
240
views
Analyzing queries with high disk IO
RDS Aurora PostgreSQL 10.14 instance db.r5.4xlarge.
I'm trying to figure out some high RDS IO costs in my machine.
I'm looking at the pg_stat_statements and asking whether the following query make ...
0
votes
0
answers
9
views
How to get names of connection pools from DB tables like INFORMATION SCHEMA?
We have multiple services connect to a database using Hikari. Is there a way to find which connection pools are connected to the DB? Would be ideal if we can see the name and count of connections.
- 101
0
votes
0
answers
33
views
RDS Aurora PostgreSQL took 400GB over time but the database size only 19MB
Already tried to query temporary files (all empty), also replication_slot all empty according to https://aws.amazon.com/premiumsupport/knowledge-center/diskfull-error-rds-postgresql/
Querying database ...
- 1,231
0
votes
1
answer
270
views
Slow query Mysql with Order By and JOIN
I've been investigating an issue with a slow query when trying to get the last 50 comments of a user.
To give some context the database size is 9 TiB and the COMMENT table has about 7 billon of rows.
...
0
votes
0
answers
374
views
AWS DMS Task failed with error: Error executing source loop; Stream component failed at subtask 0
I want to migrate my PostgresDB hosted in Citus cloud service to AWS RDS Aurora Postgres. I am using AWS DMS service. Have created task but getting following errors:
Last failure message Last Error ...
- 101
0
votes
1
answer
151
views
Parameter innodb_flush_log_at_trx_commit not available in AWS Aurora 5.7
I'm trying to modify the parameter innodb_flush_log_at_trx_commit on a RDS Aurora 5.7 instance from the AWS RDS Web Console and when I look through the parameters in the database I can not find it.
...
- 101
1
vote
1
answer
211
views
Aurora MySQL: how do I keep binlogs around after reboot?
We have a request to enable binlogs on an Aurora MySQL instance and to keep those logs around for a certain amount of time. To test, we enabled binlogging with binlog_format=ROW and set our retention ...
- 31
0
votes
0
answers
481
views
AWS DMS migration not migrated Foreign keys, sequences and indexes got renamed
I have used DMS for AURORA PostgreSQL to PostgreSQL SCHEMA Migration. Migrate Data only type is used for DMS activity.
After a Full load of Data, all tables were created on the target endpoint with ...
0
votes
0
answers
884
views
How can I downgrade an AWS Aurora MySQL 5.7 2.09.2 to an earlier 5.7 version?
During a test, I applied a branch of our Terraform description that upgraded a couple Auroras from 5.7 2.04.x to 5.7 2.09.2 without losing the data (as expected). When attempting to apply the main ...
- 101
2
votes
2
answers
1k
views
Performance issues from RDS Aurora 5.6 to Aurora 5.7
Recently upgraded one of my RDS instances to aurora mysql 5.7 from 5.6 and I've had to triple the instance class while I try to resolve this (cpu eventually pegs and never declines).
Most reads are ...
- 121
0
votes
1
answer
371
views
AWS Aurora Mysql different instance types for writer/reader
I have a db.r5.large for the master/writer.
I want to add some readers.
Do they need to be the same instance type as the master? Or can i add for example 3x db.t3.medium ?
- 101
1
vote
2
answers
1k
views
Which AWS RDS; current t3.medium over CPU baseline, but not sure what's the next best option
I currently have one RDS instance, db.t3.medium running Aurora MySQL.
Due to increase workload (expected), the CPU is, on average running just over its baseline and therefore in about 10 days will run ...
- 31
0
votes
0
answers
123
views
AWS Aurora/MySQL server crashes with spatial query
We are using AWS Aurora/MySQL, engine version 5.7.mysql_aurora.2.09.0 and we have a spatial index on a table with ~10,000,000 rows:
CREATE TABLE `foo` (
...
`lat` decimal(10,6) DEFAULT NULL,
`...
- 1
0
votes
1
answer
1k
views
Is there any significant performance difference when using string vs bigint as a primary key in Postgres (Aurora)? [duplicate]
We can use same logic for both types (string/bigint) to generate consecutive ids (e.g. like https://instagram-engineering.com/sharding-ids-at-instagram-1cf5a71e5a5c). This way both are naturally ...
- 103
1
vote
1
answer
4k
views
Is it possible to add Postgres extensions to AWS Aurora?
I am trying to futureproof a Postgres database so it can be transferred to AWS Aurora.
I am using the guide extension uuid-ossp.
Is it possible to add PostGres extensions to AWS Aurora?
In ...
- 303
0
votes
1
answer
271
views
Aurora vacuum not deleting frozen empty pages?
I recently ended up deleting most of the data in one of our tables, on purpose. Normally the table is append-mostly, with a short window during which updates might happen after the original insert. ...
- 103
0
votes
0
answers
110
views
Why isn't autovaccum running/completing?
My PostgreSQL instance (AWS Aurora) isn't autovacuuming. Or it is, but it is somehow being interrupted or stopped. I'm not canceling any autovacuum queries (though I suppose AWS itself could be).
The ...
- 640
2
votes
1
answer
104
views
Large MySQL database dump/restore [closed]
Got a quite interesting task: Have to dump mysql databases from AWS and restore on a private cloud. Databases are quite big: 160GB, 120GB and 21GB each db.sql dump - all 3 in the same aurora rds ...
0
votes
1
answer
971
views
Create row level trigger for Partitioned table
I have created a partitioned table (base), and an audit table for it(base_audit) and then created child tables (c1,c2,c3,..cn). To populate entries in base_audit, I have created a function and a row ...
- 735
0
votes
1
answer
318
views
Limiting user access by subnet to Amazon Aurora PostgreSQL
How do I limit user access by IP? For example, assuming I have two non-superusers (user1 and user2), how can allow general access (only limited by security groups) to the instance/cluster by user1 but ...
- 111
-1
votes
2
answers
139
views
MySQL Select Query not using Required Index
I have a Table which has 2 Million Records and No primary or Unique Keys.
I added Two Indexes and I'm expecting an Index to be used for my Select Query.
When I saw the Explain Plan , Optimizer is not ...
0
votes
0
answers
861
views
SSHtunnelForwarder to Linux Box, then connect to Postgres RDS (AWS)
I'm trying to write a python script to update DDL in a Aurora RDS (postgres) on AWS. In Order to do this, I need to SSHTunnel to a linux box that sits at the edge of the VPC, then do another jump to ...
2
votes
0
answers
348
views
Migrate cluster Aurora RDS postgres from 9.X to 10 without downtime
Ok, this question is to find some strategy or tool that helps me to migrate from cluster Aurora RDS postgres from 9.6 to 10 without downtime.
What I find until now
Aurora RDS is allowed to do major ...
- 554
1
vote
0
answers
393
views
Constraint creation on a large table is too slow
There's a table with 723M rows, large amount of data and not partitioned. We're adding a constraint to the table as follows:
ALTER TABLE ONLY my_table ADD CONSTRAINT partial_constraint EXCLUDE USING ...
- 159
0
votes
1
answer
2k
views
Why and When the pg_stat_activity's most of the columns are null?
Recently, I have noticed that when I query the pg_stat_activity for few users most of the columns are [null] (pgAdmin 4) in the result.
Only thing I can see is datid, datname, pid, usesysid, usename,...
- 735
1
vote
1
answer
777
views
mysql/aurora not immediately seeing results of committed transactions
In a system running against an AWS aurora-mysql database, the following (obviously extremely simplified) code runs. It's a highly concurrent system, multiple threads, multiple connections to db. The ...
- 11
0
votes
0
answers
641
views
AWS DMS: Table Mapping?
We are moving from SQL Server to AuroraDB (mySQL). Both our source database (SQL Server) and our target (AuroraDB) are on AWS RDS so we are naturally using DMS for the migration.
We make heavy use ...
- 173
0
votes
0
answers
187
views
AWS aurora mysql is restarted unexpectedly
In our system
one of aurora mysql instances was't available for short period.
because this instance suddenly restarted at 08/14/2019 3:56JST.
we already checked error log for aurora.
but i found ...
0
votes
2
answers
1k
views
Hints on bulk loading 3.6 billion rows to InnoDB on Aurora MySQL
everyone!
I'm struggling for a week to bulk load 3.6 billion rows to an InnoDB table on Aurora MySQL 5.6.10a. This table has one FK to a "Main" table and has 12 columns. The first 1.4 billion were ...
2
votes
1
answer
966
views
AWS Aurora MySQL Serverless CPU utilization is growing for unknown reason
We have been using Aurora serverless databases in staging and production environments for a few months now, and find the CPU remains in the range 15-20% almost all the time. However in the past week ...
- 21
0
votes
0
answers
457
views
What database should I use locally if I'm going to use Aurora Serverless?
I'm planning to use Aurora Serverless in QA/PROD and then a docker container for running a compatible engine locally. Should I use MariaDB 10.0 or MySQL 5.6?
Database need is low, we're not doing ...
- 101
1
vote
0
answers
615
views
Predicting AWS RDS MySQL Instance Performance
I have a small MySQL db running on AWS RDS t2.small instance.
So far, the CPU usage has been very predictable based on the traffic from my app.
Example:
1000 concurrent users = 15% CPU
2000 ...
- 111
0
votes
1
answer
562
views
Aws RDS cpu Spike to 100% because of running set isolation command and set
My application running with the AWS RDS as a backend.
currently i am doing a performance test.
While doing that i am seeing RDS cpu usage goes 100% after 20min.
While seeing the performance insights ...
- 113
1
vote
1
answer
3k
views
Error log flooding with aborted connections (Aurora 2.03 - MySQL 5.7.12)
Here's some contextual information: I have a multi-tenant, WordPress MU installation running on Elastic Beanstalk, scaled up to 2 instances minimum. These are connected to the RDS database and are ...
- 13
0
votes
1
answer
816
views
Multi-AZ failover - replica still read only after failover
Setup:
I have a single RDS cluster. This cluster has two instances, one in each zone. Naturally, one "replication role" reader and one writer.
What happened:
I manually triggered a failover of the ...
- 3
1
vote
0
answers
53
views
Aurora PostgreSQL fail over process
Aurora PostgreSQL: How the process work on failover,I have a primary DB-prod for transaction database and read replica for reporting.
where reporting will be pointed if primary fail.
similar question ...
- 11
1
vote
2
answers
985
views
Can AWS Aurora High Availability allow different Schema on Replicas?
Our company is thinking of migrating from SQL Server to Amazon AuroraDB.
In SQL Server, there are AlwaysOn and Transactional Replication - two different things.
AlwaysOn is utilized more for ...
user129291