Skip to main content
OverflowAI is here! AI power for your Stack Overflow for Teams knowledge community. Learn more

Questions tagged [aws-aurora]

Managed cloud database service‎ from Amazon Web Services, available for Postgres or MySQL.

Filter by
Sorted by
Tagged with
2 votes
1 answer
236 views

Most efficient way to UPDATE a billion rows in AWS Aurora PostgreSQL?

I'm using an AWS-managed Aurora PostgreSQL v15 instance as catalog for a large number of S3 objects. The level1_dataset table has about 2 billion rows and its schema has a metadata JSONB column. An ...
Sotosoul's user avatar
0 votes
0 answers
20 views

database "template0" is not currently accepting connections

i got the following error database "template0" is not currently accepting connections How to vaccum it? Thanks UPDATE i got the following yesterday postgres=> select * from public.test; ...
BAE's user avatar
  • 259
1 vote
1 answer
42 views

What does psql do on connect (that could be taking 1 to 10 minutes)?

In some cases psql is taking ~1 to 10 minutes to connect to PostgreSQL, with no queries that it seems to be running while doing so (according to pg_activity that I think queries pg_stat_activity) I'm ...
Michal Charemza's user avatar
0 votes
1 answer
29 views

Difference between Authentication, session, outer and current user in postgres

I know about the users in postgres but don't have correct idea about them. The difference I know is Authenticated user - The user who enters his credentials to login into postgres database. Session ...
Ayush Vatsa's user avatar
0 votes
0 answers
35 views

Reduce varchar column size in a production database

We have a database running on AWS Aurora Mysql with version 8.0.mysql_aurora.3.04.1 as a regional database. There is a table in it with a column with varchar size 200. We want to reduce it to varchar(...
Tanmay Sule's user avatar
0 votes
0 answers
25 views

MySQL 5.7 on Amazon Aurora - how to read the IO Cache vs. Disk Read metric?

I'm trying to determine how often InnoDB is hitting RAM vs. disk. Does db.Cache.innoDB_buffer_pool_hits.avg mean InnoDB went to the buffer pool? Does db.Cache.Innodb_buffer_pool_reads.avg mean that ...
mstrom's user avatar
  • 133
0 votes
1 answer
25 views

MySQL Amazon Aurora - why is CPU low while max vCPU is high?

In MySQL Amazon Aurora, is it normal for CPU to be be low while other metrics are above the max vCPU line?
mstrom's user avatar
  • 133
2 votes
1 answer
117 views

MySql Aurora - how often to run ANALYZE TABLE?

I have a database that has existed for about 10 years, with hundreds of tables, many of which have several million rows. We don't have a DBA and we have an increasing number of slow queries. We're ...
mstrom's user avatar
  • 133
1 vote
1 answer
58 views

MySQL Amazon Aurora - a few slow queries causing extreme performance issues

I'm a dev, not a DBA, so pardon my ignorance. I'm running on MySQL Amazon Aurora, single-instance (with a replica for failover). A few days ago, my application had a handful of extremely slow queries (...
mstrom's user avatar
  • 133
0 votes
1 answer
48 views

MariaDB to MySQL migration using AWS DMS

I have a master-slave mariadb 10.3.29 running on AWS EC2 and needs to be migrated to AWS Aurora MySQL using DMS. In order to do that i need to change the binlog_format to ROW(both master and slave) ...
JollyRoger's user avatar
1 vote
0 answers
75 views

Force index not working in Aurora MySQL 8

I have recently upgraded to Aurora MySQL engine version 8.0.mysql_aurora.3.05.2 from Aurora MySQL 5.7. I see huge performance issue after upgrading. Recently I found that I have queries whose indexes ...
Ali Mehdi's user avatar
0 votes
1 answer
114 views

Aurora PostgreSQL TEMP TABLE creation taking more CPU than expected?

I'm running on an Aurora PostgreSQL on a db.x2g.2xlarge instance. Simply creating temporary table showed up as the third highest wait, which surprises me, as I expected it to be one of the lighest ...
Joe's user avatar
  • 1,635
0 votes
0 answers
84 views

Aurora RDS - difference between ConnectionAttempts and DatabaseConnections

So I have read this a few times about these two metrics: ConnectionAttempts and DatabaseConnections. Based on the above, is RDS rejecting lots of connections? Here are the graphs of these two metrics. ...
Abs's user avatar
  • 1
0 votes
0 answers
24 views

Best practice for applying complex business logic during transformation in ETL from Aurora db to Redshift data warehouse

I'll be pushing data from an Amazon Aurora db to a Redshift data warehouse. The painful part is that the transformation portion of the ETL workflow relies heavily on business logic, that lives within ...
mstrom's user avatar
  • 133
1 vote
0 answers
87 views

AWS Mysql unknown variable Warning Log

I upgraded AWS Aurora Mysql 5.7 to 8, but aws aurora log outputs like this. 2024-01-19T00:24:16.179185Z 0 [Warning] [MY-000067] [Server] unknown variable '...
B_B_Tod's user avatar
  • 11
0 votes
1 answer
70 views

Query Optimization | Improve Query Time with LIKE Statement in Use

I have the following query; SELECT `e`.`entity_id` FROM `catalog_category_entity` AS `e` LEFT JOIN `catalog_category_entity_varchar` AS `at_url_path_default` ON (`at_url_path_default`.`row_id` = `e`.`...
Marisa's user avatar
  • 23
-1 votes
1 answer
26 views

How Aurora postgres serverless v2 manage read consistency?

Vanilla Postgres relies on the Database Master to enforce read consistency by applying uncheckpointed TXs or 'hiding' the result of transactions committed after a query has started. Does this logic ...
dropofahat's user avatar
3 votes
1 answer
58 views

Row Locks in Partitioned Aurora MySQL Table

I'm experiencing many row locks in a AWS Aurora AWS MySQL MySQL version=8.0 Aurora Version=3.04.0 The table is pretty big close to 1 Billion rows. The table is partitioned in 24 partitions based on ...
sonus21's user avatar
  • 131
2 votes
0 answers
18 views

Aurora mysql throttle during writes

I came across a situation where I need expert opinion. Our application ingests data into table A in aurora mysql 3.02 every 5 seconds. This is a write intensive process. During this time, I am using ...
Falcon's user avatar
  • 101
0 votes
1 answer
413 views

Amazon Aurora RDS (serveless) - How to match an ACU in terms of CPU number and memory

I need to migrate an Amazon RDS back to on-premises envoriment. How to How to match an ACU in terms of CPU number and memory? My instance has: Minimum capacity 1 ACUs (2 GiB) Maximum capacity 10 ACUs (...
Astora's user avatar
  • 723
0 votes
1 answer
26 views

aurora mysql - migrating large tables

We have write intensive application using aurora mysql 3.02 with 2xlarge instance size in prod. I want to migrate 10 tables (biggest one being 450GB) from 2nd aurora mysql into this prod db. Tried ...
JollyRoger's user avatar
0 votes
1 answer
43 views

on-prem sybase to aws aurora

I want to migrate from on-Prem Sybase to AWS Aurora Postgres database. I came across tools like AWS SCT and AWS DMS, but I am not sure , if the source Sybase database should be in AWS cloud as a pre-...
Pavankumar's user avatar
1 vote
2 answers
232 views

Extremely slow COUNT query on Aurora Postgress Serverless v2 with two tables

I'm designing a web application where sellers can offer their cars, banks provide various financing offers (e.g. 36 months, 25% downpayment, 25% final payment). Buyers come to this web app and they ...
bdadam's user avatar
  • 111
0 votes
1 answer
126 views

Using logical replication to migrate a large Aurora database from AWS to on-premises PostgreSQL

After 5 years and many $$$ spent on keeping our data in an AWS RDS Aurora PostgreSQL cluster, we now want to bring the 12 TB of data back to an on-premises PostgreSQL instance, specifically a Crunchy ...
Robert's user avatar
  • 13
0 votes
2 answers
425 views

What is the difference between CREATE INDEX and CREATE INDEX CONCURRENTLY in PostgreSQL?

I would like to know what the difference is between CREATE INDEX and CREATE INDEX CONCURRENTLY (if any) after the creation of the index has built. I have been having a discussion with a colleague ...
Aaron Gonzalez's user avatar
0 votes
0 answers
16 views

Does AWS Aurora MySQL Load Balance Reads Across Availability Zones?

I am running an AWS Aurora MySQL multi-AZ cluster with four nodes in two availability zone reader A and writer C are in one AZ, and reader B and D are in another AZ. It seems like reader A is ...
db_guy's user avatar
  • 1
1 vote
1 answer
475 views

AWS Blue/Green stuck at "Replica creation is canceled due to external replication"

I'm trying to perform a Blue/Green upgrade of PostgreSQL 11.21 in AWS RDS. The DB cluster has no replication slots. However every attempt failed in Incompatible-create state and the log message is &...
Aleksandar's user avatar
0 votes
0 answers
30 views

Slow execution even with proper indexes defined

I am using AWS Aurora Serverless V2 with MySql. I have a table with 10M rows as shown below. CREATE TABLE 'VCont' ( 'id' varchar(64) NOT NULL, 'version' int NOT NULL, 'colId' bigint unsigned ...
Ravindra's user avatar
1 vote
1 answer
383 views

Why would reads block other reads in Aurora PostgreSQL?

We're running an AWS Aurora PostgreSQL version 13 database. The other day, I was trying to set up a backup job to run from the read replica, and I ended up encountering the error "User was ...
Brad's user avatar
  • 113
1 vote
0 answers
61 views

MySQL slow running query - Need help with tuning

I am using the Aurora MySQL Serverless V2 database and facing an issue with the below query taking longer. In the end, I have listed different approaches that I tried to fix this. The table has around ...
Ravindra's user avatar
0 votes
0 answers
29 views

Is it possible to backup AWS RDS Aurora MySQL per database by any AWS services?

I have several AWS RDS Aurora clusters, and user data is stored in different database. Currently I have my own script to backup per database, but I am considering to backup through AWS provided ...
Tony Chan's user avatar
0 votes
0 answers
39 views

How do I temporarily enable mysql.general_log in AWS Aurora Serverless V2?

I am trying to debug an issue and I just need to see the general log of a mysql instance. Is there any way of temporarily enabling or routing the logs to a file/cloudwatch for a minute or so? ...
Archimedes Trajano's user avatar
1 vote
1 answer
150 views

Can't use performance_schema in my mysql server

I am using AWS RDS aurora mysql 5.7 serverless but in RDS I have enabled the performance_schema parameter, I have connected my RDS to mysql workbench version 6.3 in mysql workbench when I am checking ...
Paras Sahu's user avatar
0 votes
0 answers
508 views

TempTable Memory Storage Engine Issue

I have a db.r5.2xlarge (64GB) AWS Aurora-MySQL instance (8.0.26 equivalent) and I have a long-running SQL which gives this error: ERROR 1114 (HY000) at line 1: The table '/rdsdbdata/tmp/#sqlfe_130_0' ...
Brian Estrada's user avatar
0 votes
0 answers
160 views

mysqldump-like process for Amazon Aurora MySQL?

I believe that mysqldump does not work with Amazon Aurora MySQL. This is a bit of a problem for us as we used use that tool - before moving to Amazon hosting - to extract information across tables to ...
phil's user avatar
  • 153
0 votes
1 answer
263 views

High CPU Usage and MySQL Server Inaccessibility during Magento flat reindexing

We use the following configuration: Engine: Aurora MySQL v8.0 Instance Type: db.r6g.4xlarge vCPU: 16 Memory: 128.0 GiB Role: Writer Instance I'm encountering a critical issue during the reindexing ...
Winfle's user avatar
  • 1
0 votes
1 answer
183 views

Charset Questions on Aurora-MySQL 5.7 as a Replica to a Aurora-MySQL 8.0 Primary

We are planning to upgrade from Aurora MySQL 2.10.2 (MySQL 5.7 equivalent) to Aurora MySQL 3.03.0 (MySQL 8 equivalent). One of the rollback plans that we are considering is having another Aurora MySQL ...
Brian Estrada's user avatar
1 vote
0 answers
123 views

Ways to reduce latency in importing data from csv files into MySQL Workbench when connected to an RDS MySQL db Instance

This question is a follow-up to this question I asked on Stack Overflow yesterday after answering my own question by creating a Aurora MySQL db Instance and establishing a connection between it and ...
Marlen's user avatar
  • 227
0 votes
0 answers
267 views

Create index on big table increase IO:XactSync wait event for other sessions

AWS Aurora (postgres 11.9) after downgrading instance from db.r6g.8xlarge to db.r6g.4xlarge instance and enabling logical_replication I'm trying to rebuild indexes (cause of bloat) for table size 30GB ...
Nevermind's user avatar
3 votes
1 answer
842 views

Aurora / PostgreSQL Mass Update on 100 Million Rows Coming to a Halt

During the migration of a 300 million rows table I have encountered a strange behaviour on our AWS Aurora database: Around 25 minutes into the migration, the total IOPS of the database dropped to ...
Philipp Bzdok's user avatar
0 votes
1 answer
569 views

Postgresql Sequence Hopping

I have recently migrated (dump and restore) my database from AWS RDS PostgreSQL v12 to Aurora Serverless v2 PostgreSQL v14.6. The issue is we have setup sequencing in a table on old RDS, now in the ...
sam's user avatar
  • 11
1 vote
1 answer
335 views

Time zone conversion in DMS from DB2 to Aurora Postgres

Challenge We are using AWS DMS to convert data from IBM DB2 into AWS Auroa Postgres IBM DB2 server is set to Eastern time (ET) zone. Timestamp related data inside DB2 is therefore in ET. Findings AWS ...
Padraic Renaghan's user avatar
1 vote
0 answers
83 views

How to encrypt a production unencrypted RDS Aurora MySQL 8 cluster

I have a running RDS Aurora MySQL 8.0.23 cluster running in production. The database is unencrypted and I need to enable encryption for it. As far as I understand, this is not possible to do directly. ...
revy's user avatar
  • 111
2 votes
1 answer
885 views

Creating indexes in an amazon aws aurora mysql does have a cost?

I am looking for informations without finding them. If I create indexes in a aws aurora mysql instance, do I have to pay? The only things I found is that you pay for all I/O operations (and for ...
Giacomo M's user avatar
  • 163
1 vote
0 answers
125 views

Assign privileges to a postgres user

I am working on creating a postgres user and assign certain privileges to the user. These are privileges to execute certain functions with the end goal of being able to replicate data or change-data-...
Abhi's user avatar
  • 111
1 vote
1 answer
789 views

Aurora MySQL 5.7 to 8.0 Upgrade Issue with general_log_backup

I am upgrading our Amazon Aurora from 5.7 to 8.0 and I got this error in the precheck logs. 20) Tables recognized by InnoDB that belong to a different engine Error: Following tables are ...
bichonfrise74's user avatar
0 votes
0 answers
216 views

Postgres/Aurora query response time unexplained

I have AWS Postgres Aurora RDS version 11 running with db.r6g.12xlarge instances in a 3-node cluster with 1 writer, 2 readers. It should be noted though that this also occurs on our on-premises Ubuntu/...
Diane's user avatar
  • 151
2 votes
1 answer
777 views

How to reap benefits of parallelism for PostgreSQL DELETE?

I have a fairly niche use case of a (AWS Aurora) PostgreSQL database and we are running into performance issues that I have discovered a "clever hack" (not actually clever) to work around ...
Alistair Hutton's user avatar
2 votes
3 answers
581 views

Is it safe to enable Fast DDL in Production

We have a Database running Aurora MySql V5.7. We would like to enable Fast DDL to improve the speed of Adding a Column to a large database. According to the documentation, this feature is Enabled in ...
Captain Cool's user avatar
0 votes
1 answer
2k views

pg_stat_statements slows down the database

I have an aws aurora postgresql cluster running posgresql 13.7 engine. The cluster is using the default parameter group. These are the default settings used for pg_stat_statements in the parameter ...
mario's user avatar
  • 3