Questions tagged [aws]

Amazon Web Services.

Filter by
Sorted by
Tagged with
1 vote
0 answers
16 views

aws rds password change triggers updates to which fields in mysql.user?

I'm using AWS RDS with MySql (5.7.mysql_aurora.2.10.2) Due to internal policy I updated db password via AWS RDS modify DB instance menu. What I can't grasp is, when I updated pw for dev db instance, ...
  • 33
0 votes
0 answers
13 views

Is there a difference in performance loading different datatypes

Context: loading (COPY) a high volume of data to a warehouse (Redshift specifically however curious about all) Question: Is there a performance difference in the different datatypes that I am loading? ...
0 votes
0 answers
12 views

AWS RDS: How do I enable connection for specific IP address?

I've been managing a site for over four years, and initially what I did to allow access to the database for some IP address was just editing an existing Security Group called specificip This is what I ...
  • 101
0 votes
0 answers
19 views

AWS RDS PostgreSQL suddenly consumed all free space

0 I am Migrating table from On-Prem to AWS using AWS DMS tasks. My On-Prem SQL server total DB's sizes are below 1TB But my RDS storage(PostgreSQL) is taking more space 8TB. still it is increasing. I ...
  • 1
0 votes
0 answers
6 views

Can I generate the commands/script to create an RDS Instance from an existing one?

I have a few development and test RDS instances that I need to drop, but would like to be able to recreate them again if so needed (with the same VPC, Options, etc...). Is there a way to, given an ...
  • 131
0 votes
0 answers
37 views

Evaluating AWS RDS Proxy latency overhead

Evaluating some benchmark tests I noticed that there is latency overhead in the transactions to the database using the service provided by AWS: RDS Proxy. The tests were performed against a Postgres ...
  • 101
0 votes
0 answers
9 views

Are AWS Lambda functions actually EC2 instances under the hood?

I’ve heard that AWS security groups are essentially firewalls that can be applied to EC2 instances. Since you can apply security groups to many things in AWS, including Lambdas, I’m wondering if many ...
0 votes
2 answers
21 views

Is it possible to fetch AWS RDS MySQL transaction logs?

I have AWS RDS MySQL instance, without general query logs. Is it possible to get all transaction logs? I understand that MySQL binlog retention time is very short, but obviously, AWS RDS keeps all ...
0 votes
0 answers
26 views

Fastest way to migrate largish (15 TB) PostgreSQL 11 instance to Aurora 14 in AWS

We have an AWS RDS PostgreSQL 11 cluster (currently version 11.13), in which we have a few databases and some 1500 tables. The RDS cluster is of size "db.r5.xlarge", with 4 vCPUs, 32 GB RAM ...
  • 3
0 votes
0 answers
16 views

Migrating AWS RDS SQL Server Express to Azure SQL DB

I have a task to migrate an AWS RDS SQL Server Express instance to an Azure SQL Database. I already assessed the RDS db using Data Migration Assessment Tool and there are not compatibility issues, ...
0 votes
1 answer
19 views

AWS RDS MySQL limit connection

We have multiple databases in a single RDS instance. Because of any reason if we have load in 1 database it stops all the databases. I'm not able to move any of the database because of following ...
  • 115
0 votes
0 answers
15 views

Why is a user randomly created in AWS RDS even though the permissions from any host (%) exist?

I have a MySQL database in RDS. There are separate users which are allowed to connect from anywhere. To be more precise, using MySQL Workbench there are different users listed in "Users and ...
  • 1
0 votes
0 answers
46 views

How to enable replication filters in AWS Aurora 2 (5.7.mysql_aurora.2.10.2)?

I enabled binary log replication in Aurora to replicate from one cluster to another. I went to use the CHANGE REPLICATION FILTER command but get a 1227 error saying I must have the SUPER privilege, ...
1 vote
0 answers
51 views

How to debug a huge MySQL replication lag?

We have an AWS RDS and a corresponding Replica. Once or twice a month the replication lags and does not recover from its own. Our "solution" is to create a new replica and delete the old one....
  • 111
1 vote
1 answer
44 views

dsbulk unload fails on a specific row after running for nearly 2 minutes

We would like to export all data from a Cassandra Keyspace table to CSV with dsbulk. dsbulk unload -k KEYSPACE -t TABLE -f ./application.conf > export_TABLE.csv If we do so, it completes with 1 ...
0 votes
0 answers
29 views

Why does my query take longer when Aurora Serverless is under load?

I have a Aurora Serverless Postgres database (8 to max ACU). I'm running some stress testing against it with about 500 active connections over a period of about 20 minutes. During this time period I'...
  • 678
0 votes
0 answers
21 views

Are there any unintended side effects of limiting a mongodb docker container's CPU or RAM?

It's easy to limit RAM and CPU usage for a docker container with the docker update -m command. We have limited RAM and CPU using docker update on multiple docker mongodb containers, particularly on an ...
  • 101
0 votes
0 answers
59 views

Best way to duplicate an huge Amazon Aurora 2 (MySQL 5.7) DB into an Amazon Aurora 3 (MySQL 8.0)?

I would like to upgrade to Amazon Aurora 3 (MySQL 8.0) an Amazon Aurora 2 (MySQL 5.7). In-place upgrade isn't available, Snapshot upgrade isn't possible neither because the production machine has the ...
-1 votes
1 answer
34 views

Replication between two Cloud Services

Is it possible to implement SQL Server Replication between two disparate cloud services? For instance, if I have an instance running in Amazon's AWS Cloud Service and another instance running in ...
0 votes
1 answer
64 views

Amazon RDS change collate for mysql database in production without downtime

I saw a solution like this below: create a new table like your source table. alter that new table the way you want. insert your data into the new table. create indexes etc. as needed on the new table....
  • 101
0 votes
0 answers
40 views

AWS PostgreSQL RDS read-replica replication failing and lagging

I noticed earlier today that the replication from one of our production databases to the read replica was not instant as it usually is. I logged into the AWS console and could see that the replication ...
  • 145
0 votes
0 answers
314 views

AWS RDS always gives a lost connection timeout error for slightly long queries

I have a huge database with many million row tables. I have been running a few joins on these talbes. And the query is identical but I'm doing it over many different tables. My query worked for like ...
1 vote
1 answer
151 views

AWS RDS Serverless-V2 Postgres restart issues

We have an RDS Serverless-V2 Postgres cluster setup with two instances (one read/write, and the other a read). Both instances are in the same AZ for now, although we plan on moving one to a different ...
  • 121
0 votes
0 answers
73 views

Will SQLNET.EXPIRE_TIME=5 prevent AWS Gateway Load Balancer from timing out after 350 seconds?

We have Amazon Web Services (AWS) Database Migration Service (DMS) tasks erroring out against an on premises Oracle 11.2.0.3 database with ORA-03135 errors. Our network traffic between AWS and the ...
0 votes
0 answers
18 views

AWS RDS for MySQL and On-Prem MySQL multi-master replication error 1236 from master when reading data from binary log

I am trying to set up a GTID multi-master replication between On-Prem MySQL and AWS RDS MySQL, so RDS MySQL should act as replica for On-Prem MySQL and vice versa. Due to the fact that we have a ...
  • 1
0 votes
0 answers
45 views

Moving SQL database with FCI to AWS

We have a MSSQL database which has two nodes and is using Always On FCI for High Availability purpose at our on-premise location. As most of you aware FCI SQL requires the two nodes to share the same ...
  • 202
0 votes
0 answers
50 views

Determining Correct DB power for AWS RDS MySQL

I'm no database expert so hoping someone can help - I currently have a dedicated server with 16CPUs which runs a MySQL database as well as my applications. My database size is about 10GB and want to ...
  • 101
0 votes
1 answer
93 views

How to clear AWS RDS Aurora MySQL local storage?

I got a warning message about running out of AWS RDS local storage. The free storage capacity for DB Instance: {MY INSTANCE NAME} is low at 2% of the provisioned storage [Provisioned Storage: 157.36 ...
0 votes
0 answers
45 views

disable trigger command giving error - mysql

I have a master slave server configured(one master and one slave) in amazon ec2 ubuntu instances. below are the tables and the insert trigger is on the likes table. create table posts ( post_id ...
0 votes
0 answers
26 views

Oracle 19c automatic indexing

It seems Oracle automatic indexing feature that was introduced in Oracle 19c works only on Oracle Cloud and not AWS RDS. Is my understanding correct (that AWS RDS doesn't support it)? Reference: https:...
0 votes
0 answers
131 views

AWS RDS database replication replicates everything regardless my parameters group

I have a database in RDS that I want to replicate. I made a parameter group where I described which tables I want to be replicated. I applied it to my replica, and still it replicated the whole ...
2 votes
1 answer
42 views

dual-password-like feature for MySQL before v 8.0

tldr; Is there a dual-password-like feature for MySQL v.5.x ? Problem I have a MySQL server that needs to temporarily allow two passwords for one account, due to legal constraints that impose DBMS ...
  • 33
1 vote
0 answers
905 views

AWS Lambda to RDS PostgreSQL connection

Hello fellow AWS contributors, I’m currently working on a project to set up an example of connecting a Lambda function to our PostgreSQL database hosted on RDS. I tested my Python + SQL code locally (...
0 votes
0 answers
82 views

When is the mysql performance schema event "wait/synch/cond/sql/MYSQL_BIN_LOG::COND_done" fired?

I am using Aurora Mysql 5.7.mysql_aurora.2.07.2 and am facing bottlenecks on load testing with a write-heavy workload. On enabling performance insights I noticed that a large number of sessions were ...
2 votes
1 answer
368 views

Aurora upgrade 2 to 3 / MySql 5.7 to 8.0: schemaInconsistencyCheck

In our attempts to upgrade our Aurora 2 MySql 5.7 DB to Aurora 3 MySql 8.0, we are running into a pre-check that we are unable to resolve. The error is: { "id": "...
  • 21
0 votes
0 answers
28 views

Does AWS RDS MariabDb supports automatic failover?

We want to use AWS RDS to store our app's data. We are leaning towards MariaDb because of its temporal tables feature. And hence not chosing AWS Aurora with MySQL. Another reason being even though ...
  • 121
0 votes
0 answers
162 views

Unable to connect to external mysql server from ec2 instance

I've some API written in express, I'm using sequlize as orm. Everything is working fine in local environment. The problem is while running on ec2. If I give any of the RDS url as host, the database ...
  • 101
0 votes
0 answers
111 views

How can we run Federated queries on RDS/Aurora PostgreSQL databases

I am trying to run few select queries to take snapshots on few tables and PG views(like select * from pg_Stat_activity) of AWS Aurora/RDS PostgreSQL databases on each of our instances(around 20) that ...
4 votes
1 answer
651 views

Why SQL inserts are slower in AWS Aurora Serverless than in AWS RDS

We had an AWS MySQL RDS t3.xlarge instance with 2000 IOPS. Also, I have a cron job written in java which inserts data in a table: it can insert up to 12M rows daily. Since AWS RDS cost is quite high ...
  • 141
0 votes
1 answer
36 views

Where to install SQL on EC2

If SQL Server and it's system databases are installed on an EC2 local drive, will they be recovered in a crash? My understanding is nothing but temporary files and the OS should be on the local ...
1 vote
0 answers
67 views

AWS S3 CLI : Check Validate Inside Automatically?

We're using "s3api put-object" and explicitly checking Hash MD5 to make sure the file uploaded to S3 correctly (Unless the upload file is less than 5 GB) aws s3api put-object --bucket ...
  • 121
0 votes
0 answers
43 views

Where is mysqlpump log file in Linux/Ubuntu located

I am neither a DB administrator, nor a DevOps but I need to migrate a very large table (~500M rows) from one MySQL schema to another. For doing so, I use mysqlpumpbackup tool. Also, since the DB is an ...
  • 141
1 vote
1 answer
1k views

AWS RDS "Maintenance Required"

I saw from the web interface that maintenance on my RDS postgresql instances is required, so I ran aws rds describe-pending-maintenance-actions, and it says that there's a "system-update" ...
  • 508
1 vote
2 answers
240 views

Reading SQL Server .sqlaudit Files Stored in S3

I set up an audit in SQL Server that saves audit logs (.sqlaudit files) to RDS, which we then copy over to S3 using a standard process. All of the documentation I can find on reading these audit files ...
1 vote
1 answer
323 views

Connection to AWS database gives back "You may not specify an IPv4 CIDR for an existing referenced group id rule."

I try to connect to a AWS database instance from a client by following this tutorial: https://medium.com/simplebackups/allow-a-remote-ip-to-connect-to-your-amazon-rds-mysql-instance-2d5074d601eb I ...
0 votes
0 answers
81 views

Dynamodb throttling config using boto3

I see couple of solutions on how to handle dynamo throttling errors. one is to set it in config object like this import boto3 from botocore.config import Config config = Config( retries = { '...
1 vote
0 answers
126 views

Does AWS Aurora MySQL not support encrypted binary log replication with RDS MySQL master?

Trying to setup replication between an RDS MySQL (5.6) master with an Aurora MySQL (also 5.6) replica cluster in the same region via binary log replication for a work project. However, this doesn't ...
1 vote
2 answers
373 views

AWS Aurora Postgres 12 Setting Collation

I posted this on stack overflow as well, but didn't get much traction over there. If I am not able to get some thoughts on here, then I will probably open a support ticket with AWS. I am trying to set ...
0 votes
1 answer
74 views

Moving entire SQL Server 2016 to a new location - best method

At my organization, we have a SQL Server (2016) running on an EC2 instance at Amazon on a Windows with SQL Server license. My boss realized we could save a ton of money by standing up a Windows-only ...
  • 327
0 votes
0 answers
458 views

Oracle Storage Full, How to release space?

i have and AWS RDS Oracle Database wich its storage is full, looks like the cause is SYSAUX tablespace with 10.2GB size The largest object inside SYSAUX is: WRI$_ADV_OBJECTS (TABLE) checking the table ...

1
2 3 4 5
9