Skip to main content

Questions tagged [aws-aurora]

Managed cloud database service‎ from Amazon Web Services, available for Postgres or MySQL.

92 questions with no upvoted or accepted answers
Filter by
Sorted by
Tagged with
3 votes
1 answer
73 views

Row Locks in Partitioned Aurora MySQL Table

I'm experiencing many row locks in a AWS Aurora AWS MySQL MySQL version=8.0 Aurora Version=3.04.0 The table is pretty big close to 1 Billion rows. The table is partitioned in 24 partitions based on ...
sonus21's user avatar
  • 131
3 votes
1 answer
3k views

How to performance tune high /wait/io/redo_log_flush values in "commit"

According to the "Top SQL" view in AWS Performance Insights, commit tops the list of SQL statements in terms of average active session (AAS). And most of the time seems to be spent in wait/...
Evgeniy Berezovsky's user avatar
3 votes
0 answers
73 views

Is there any way to optimize this query (generated by Drupal)?

I have an older system built on drupal, and there is a particular (generated) query that takes a long time - never completing in some cases. The query: SELECT node.nid, node.created, node....
chris's user avatar
  • 1,222
3 votes
0 answers
237 views

Logical Replication/Foreign Data Wrapper Connectivity between Two Aurora Serverless Databases (PostgreSQL 10.7)

I have two Aurora PostgreSQL Serverless databases running in the same region and have PostgreSQL version 10.7. I'm wondering if logical replication is available? The official docs say that it's ...
gogofan's user avatar
  • 131
3 votes
1 answer
1k views

How can I find the cause of pg_catalog.pg_attribute constantly being vacuumed?

autovacuum seems to constantly run against pg_catalog.pg_attribute for the past week+. This seems pretty odd since we aren't doing constant table changes. How can I understand why it's doing this and ...
Kit Sunde's user avatar
  • 333
3 votes
0 answers
1k views

AWS Aurora Database Corruption

I'm running Aurora Postgres and noticed that metric Maximum Used Transaction IDs is increasing a lot. Trying to manually vacuum the tables that's was not automatically vacuumed lead me to the ...
regisxp's user avatar
  • 131
2 votes
0 answers
21 views

Aurora mysql throttle during writes

I came across a situation where I need expert opinion. Our application ingests data into table A in aurora mysql 3.02 every 5 seconds. This is a write intensive process. During this time, I am using ...
Falcon's user avatar
  • 101
2 votes
0 answers
586 views

Why is this DELETE causing my Aurora MySQL 5.7 instance to crash?

I have a large table (2.3TB of data, 1.9TB index, 33 billion rows). A user recently executed a DELETE statement (32k rows) against the table, which caused the server to eat up all memory and then fail ...
Swechsler's user avatar
  • 143
2 votes
0 answers
1k views

MySQL DB stuck with constantly rolling back transaction but no associated query

Ran into a problem on a website with a very slow site and tracked it down to the database responding very slowly, even for simple select queries. There seems to be spikes of activity every 9-12 ...
Josh Coady's user avatar
2 votes
0 answers
911 views

RAISE NOTICE doesn't work as expected while using within Dynamic SQL block

I have a small piece of code to get all sequences and the current and maximum value of all sequences in a database. I have tried with recursive and some other alternatives through plain sqls, however ...
RBB's user avatar
  • 785
2 votes
0 answers
9k views

AWS DMS Fails with "Command failed to load data with exit error code 1"

I am trying to Migrate my Postgresql RDS to Aurora Postgresql using DMS. All my tasks are failing, and I am unable to understand what can be done to help the tasks progress. The error from cloud ...
gvatreya's user avatar
  • 203
2 votes
0 answers
938 views

AWS Aurora queries much slower in "sending data" phase than RDS instance

I've been using an RDS instance during the development phase of a project. This was a db.t2.micro instance, so not very powerful at all. Today I have created a new Aurora (5.6) [serverless] database ...
Ian Bale's user avatar
2 votes
0 answers
143 views

MySQL Queries Truncate Causing Connection Spikes

We have a MySQL Master Instance & Read (failover only) on AWS. MySQL 5.6 Aurora running Magento. Performance is great, and better than standard MySQL (we have high traffic site so see the benefits)...
Mark's user avatar
  • 21
1 vote
0 answers
86 views

Force index not working in Aurora MySQL 8

I have recently upgraded to Aurora MySQL engine version 8.0.mysql_aurora.3.05.2 from Aurora MySQL 5.7. I see huge performance issue after upgrading. Recently I found that I have queries whose indexes ...
Ali Mehdi's user avatar
1 vote
0 answers
110 views

AWS Mysql unknown variable Warning Log

I upgraded AWS Aurora Mysql 5.7 to 8, but aws aurora log outputs like this. 2024-01-19T00:24:16.179185Z 0 [Warning] [MY-000067] [Server] unknown variable '...
B_B_Tod's user avatar
  • 11
1 vote
0 answers
63 views

MySQL slow running query - Need help with tuning

I am using the Aurora MySQL Serverless V2 database and facing an issue with the below query taking longer. In the end, I have listed different approaches that I tried to fix this. The table has around ...
Ravindra's user avatar
1 vote
1 answer
161 views

Can't use performance_schema in my mysql server

I am using AWS RDS aurora mysql 5.7 serverless but in RDS I have enabled the performance_schema parameter, I have connected my RDS to mysql workbench version 6.3 in mysql workbench when I am checking ...
Paras Sahu's user avatar
1 vote
0 answers
138 views

Ways to reduce latency in importing data from csv files into MySQL Workbench when connected to an RDS MySQL db Instance

This question is a follow-up to this question I asked on Stack Overflow yesterday after answering my own question by creating a Aurora MySQL db Instance and establishing a connection between it and ...
Marlen's user avatar
  • 227
1 vote
0 answers
84 views

How to encrypt a production unencrypted RDS Aurora MySQL 8 cluster

I have a running RDS Aurora MySQL 8.0.23 cluster running in production. The database is unencrypted and I need to enable encryption for it. As far as I understand, this is not possible to do directly. ...
revy's user avatar
  • 111
1 vote
0 answers
128 views

Assign privileges to a postgres user

I am working on creating a postgres user and assign certain privileges to the user. These are privileges to execute certain functions with the end goal of being able to replicate data or change-data-...
Abhi's user avatar
  • 111
1 vote
0 answers
768 views

Does the "max vCPU" limit only apply to the "CPU" wait state?

In the Average Active Sessions chart of Performance Insights for Aurora MySQL 8, there is a horizontal Max vCPU (at 16, in my case). Now I wonder if this limit applies only to the CPU wait state (...
Evgeniy Berezovsky's user avatar
1 vote
2 answers
501 views

Automating MySQL replication using snapshots on AWS RDS (or Linux)

I'm currently working on a BASH script to build a new Aurora cluster based on the latest snapshot of an existing cluster, then set up MySQL replication from the old one to the new. In the past I've ...
Swechsler's user avatar
  • 143
1 vote
0 answers
409 views

Explain Analyze output has much higher execution time than the actual time

Execution time on Aurora postgres is much higher than the actual query execution time from the line 1 of the explain analyze output. actual time = 0.408..0.415 Planning time = 2.293 ms Execution ...
Mahesh's user avatar
  • 111
1 vote
0 answers
550 views

Is there a way to get AWS Aurora Mysql 5.7 compatible to cause timestamps to be updated to current timestamp when null is explicitly passed in?

All examples are technically from AWS RDS Aurora Mysql compatible, however I believe the issue is the same for non-aws mysql. In Mysql 5.6 and 5.7 with the exact same values for sql_mode (the 5.6 ...
Robert's user avatar
  • 111
1 vote
0 answers
147 views

Aurora Serverless 2 MySQL 8.0 doing a mysqlpump to dump users

Recently i ask about using roles in MySQL 8.0 using aurora 3.0 in a Serverless 2 RDS cluster. They answered me that the correct way to do that is using mysqlpump with the --users parameters to dump ...
Mariano Dabove's user avatar
1 vote
1 answer
638 views

How to clear AWS RDS Aurora MySQL local storage?

I got a warning message about running out of AWS RDS local storage. The free storage capacity for DB Instance: {MY INSTANCE NAME} is low at 2% of the provisioned storage [Provisioned Storage: 157.36 ...
BingbongKim's user avatar
1 vote
0 answers
2k views

AWS Lambda to RDS PostgreSQL connection

Hello fellow AWS contributors, I’m currently working on a project to set up an example of connecting a Lambda function to our PostgreSQL database hosted on RDS. I tested my Python + SQL code locally (...
Allen Yang's user avatar
1 vote
3 answers
62 views

Will a query which uses IS NULL always perform bad on large tables?

I've got the following table : CREATE TABLE `file` ( `id` char(36) CHARACTER SET utf8 COLLATE utf8_general_ci NOT NULL, `track_id` char(36) CHARACTER SET utf8 COLLATE utf8_general_ci NOT NULL, `...
sbrattla's user avatar
  • 183
1 vote
0 answers
301 views

Does AWS Aurora MySQL not support encrypted binary log replication with RDS MySQL master?

Trying to setup replication between an RDS MySQL (5.6) master with an Aurora MySQL (also 5.6) replica cluster in the same region via binary log replication for a work project. However, this doesn't ...
OceanMountains's user avatar
1 vote
0 answers
3k views

How can I downgrade an AWS Aurora MySQL 5.7 2.09.2 to an earlier 5.7 version?

During a test, I applied a branch of our Terraform description that upgraded a couple Auroras from 5.7 2.04.x to 5.7 2.09.2 without losing the data (as expected). When attempting to apply the main ...
rbanffy's user avatar
  • 111
1 vote
2 answers
1k views

Intermittent only_full_group_by errors in AWS Aurora MySQL cluster db

We recently upgraded from MySQL 5.6 to 5.7 and are running into errors related to only_full_group_by sql mode. We are only seeing the problem intermittently. Our database lives in an AWS Aurora MySQL ...
iresearchhere's user avatar
1 vote
0 answers
466 views

AWS Aurora for PostgreSQL strange vacuum cost parameters

Today, I found out that in AWS Aurora for PostgreSQL 11 the default cluster parameter vacuum_cost_page_miss = 0 whereas vacuum_cost_page_hit = 1. I'd love to understand the logic behind pricing a page ...
Jonathan Jacobson's user avatar
1 vote
2 answers
631 views

How to enable Cloud Watch logs for AWS DMS task?

I am creating AWS DMS task for migrating data from GCP SQL server to AWS Aurora MySQL. How can I attach log group which I created? I could able to enable cloud watch logs for the task but when I click ...
Pand005's user avatar
  • 151
1 vote
0 answers
1k views

Postgresql Logical Replication Initial Table Sync Stage Restarting

I'm using logical replication on a Postgres 10 DB (Amazon Linux 2) to Aurora Postgres 11 RDS. There are 256 tables that need replicating and a few are pretty large (millions to 100s of millions of ...
SciGuyMcQ's user avatar
  • 143
1 vote
0 answers
154 views

Processing data in chunks with window function and where clause

I have a timeseries table where I need to process data in partitions of hours and processing of each individual row depends on the previous row. Please consider this simple table. CREATE TABLE IF NOT ...
user's user avatar
  • 131
1 vote
0 answers
788 views

Non-existent table that actually exists?

I've been tasked to solve a very difficult and interesting problem. Given is a MySQL database created on the AWS-Aurora service. The MySQL version reported when connecting is 5.6.10. We have an ...
Radu Murzea's user avatar
1 vote
2 answers
2k views

Index creation in extremely slow in Mysql Aurora 5.7

I have a table in mysql Aurora 5.7 version . The db instance has very good configuration 488 GB ram (db.r4.16xlarge). Data base is static data base no application is running on this . I have 1.5 ...
Atharv Thakur's user avatar
1 vote
1 answer
1k views

Aurora Serverless alter table Error 1114 table is full

Using Aurora Serverless, when attempting to alter table mytable add column mynewcolumn decimal(10,3) after myoldcolumn I receive "ERROR 1114 (HY000): The Table 'mytable' is full". The table has ...
enharmonic's user avatar
1 vote
1 answer
1k views

mysql/aurora not immediately seeing results of committed transactions

In a system running against an AWS aurora-mysql database, the following (obviously extremely simplified) code runs. It's a highly concurrent system, multiple threads, multiple connections to db. The ...
Inukshuk's user avatar
  • 111
1 vote
0 answers
756 views

Predicting AWS RDS MySQL Instance Performance

I have a small MySQL db running on AWS RDS t2.small instance. So far, the CPU usage has been very predictable based on the traffic from my app. Example: 1000 concurrent users = 15% CPU 2000 ...
WayBehind's user avatar
  • 111
1 vote
0 answers
745 views

Got an error reading communication packets on writer instance only

So I am connecting with aurora MySQL 5.7.12-log with Django. Below (1) is the query auto-generated by Django when I hit runserver. SELECT `django_migrations`.`app`, `django_migrations`.`name` FROM `...
sprksh's user avatar
  • 113
1 vote
1 answer
103 views

MySQL Amazon Aurora - a few slow queries causing extreme performance issues

I'm a dev, not a DBA, so pardon my ignorance. I'm running on MySQL Amazon Aurora, single-instance (with a replica for failover). A few days ago, my application had a handful of extremely slow queries (...
mstrom's user avatar
  • 133
0 votes
0 answers
42 views

database "template0" is not currently accepting connections

i got the following error database "template0" is not currently accepting connections How to vaccum it? Thanks UPDATE i got the following yesterday postgres=> select * from public.test; ...
BAE's user avatar
  • 259
0 votes
0 answers
41 views

Reduce varchar column size in a production database

We have a database running on AWS Aurora Mysql with version 8.0.mysql_aurora.3.04.1 as a regional database. There is a table in it with a column with varchar size 200. We want to reduce it to varchar(...
Tanmay Sule's user avatar
0 votes
0 answers
34 views

MySQL 5.7 on Amazon Aurora - how to read the IO Cache vs. Disk Read metric?

I'm trying to determine how often InnoDB is hitting RAM vs. disk. Does db.Cache.innoDB_buffer_pool_hits.avg mean InnoDB went to the buffer pool? Does db.Cache.Innodb_buffer_pool_reads.avg mean that ...
mstrom's user avatar
  • 133
0 votes
1 answer
32 views

MySQL Amazon Aurora - why is CPU low while max vCPU is high?

In MySQL Amazon Aurora, is it normal for CPU to be be low while other metrics are above the max vCPU line?
mstrom's user avatar
  • 133
0 votes
1 answer
50 views

MariaDB to MySQL migration using AWS DMS

I have a master-slave mariadb 10.3.29 running on AWS EC2 and needs to be migrated to AWS Aurora MySQL using DMS. In order to do that i need to change the binlog_format to ROW(both master and slave) ...
JollyRoger's user avatar
0 votes
0 answers
101 views

Aurora RDS - difference between ConnectionAttempts and DatabaseConnections

So I have read this a few times about these two metrics: ConnectionAttempts and DatabaseConnections. Based on the above, is RDS rejecting lots of connections? Here are the graphs of these two metrics. ...
Abs's user avatar
  • 1
0 votes
0 answers
39 views

Best practice for applying complex business logic during transformation in ETL from Aurora db to Redshift data warehouse

I'll be pushing data from an Amazon Aurora db to a Redshift data warehouse. The painful part is that the transformation portion of the ETL workflow relies heavily on business logic, that lives within ...
mstrom's user avatar
  • 133
0 votes
1 answer
74 views

Query Optimization | Improve Query Time with LIKE Statement in Use

I have the following query; SELECT `e`.`entity_id` FROM `catalog_category_entity` AS `e` LEFT JOIN `catalog_category_entity_varchar` AS `at_url_path_default` ON (`at_url_path_default`.`row_id` = `e`.`...
Marisa's user avatar
  • 23