Skip to main content

Questions tagged [aws]

Amazon Web Services.

186 questions with no upvoted or accepted answers
Filter by
Sorted by
Tagged with
6 votes
0 answers
5k views

AWS RDS Postgres Logical replication

I am using AWS RDS Postgres's and RDS's logical replication support (Edit: Note, this is not the same as the logical replication featurein PostgreSQL 10. It's AWS RDS functionality based on the same ...
Murali's user avatar
  • 61
6 votes
0 answers
1k views

Understanding MongoDB Log warning

In my MongoDB log, I am seeing these lines of messages: 2016-04-05T00:03:42.904+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 200, after asserts: 240, after backgroundFlushing: ...
M T's user avatar
  • 61
6 votes
1 answer
4k views

Queries running very slowly in Amazon RDS PostgreSQL read-replica

We have been maintaining a project which has both web and mobile application platform. The backend of the project is developed in Django 1.10 and deployed in AWS. At the beginning, when there were ...
Mahmud Al-Noor's user avatar
4 votes
2 answers
3k views

change character_set_connection utf8mb4 mysql

I want to change character_set_connection utf8mb4. Its showing me utf8. I have follow this https://mathiasbynens.be/notes/mysql-utf8mb4 article and changed [client] default-character-set = utf8mb4 [...
Bhavin Chauhan's user avatar
3 votes
0 answers
695 views

RDS MSSQL in-place upgrade how to update master db compatibility level when rdsa account is db owner

Background My workplace infrastructure team ran a typical in-place upgrade of an RDS MSSQL instance to update the version from 2012 to 2017. After the upgrade, while logged in as the "master ...
dev_etter's user avatar
  • 751
3 votes
0 answers
673 views

Failed to run query: error: 1023 on Redshift

I have a lambda : 'use strict'; const config = require('./redshift_config'); const pg = require('pg'); const redshift_conn = `pg://${config.user}:${config.password}@${config.host}/${config.database}`...
Mio's user avatar
  • 651
3 votes
0 answers
466 views

How can i sync a table between two MySQL RDS insatance

I am trying to sync one table in two of mysql RDS instances in AWS something like a db link or FEDERATED engine.
Nealabh Bhatia's user avatar
3 votes
0 answers
480 views

Best approach to maintain a clone of a db in Postgres RDS

We'd like to maintain a separate database for our dev environment that closely resembles the current state of our production database. What is the best way to do this in RDS? Our current process is to ...
user1272324's user avatar
3 votes
0 answers
1k views

Slony with Amazon's RDS service?

Is it actually possible to somehow use Slony with Amazon’s RDS service? I’m aware that there’s no such thing as a host that you can log into to make Slony’s configurations, but perhaps it can be done ...
Gonzalo Vasquez's user avatar
3 votes
0 answers
2k views

How to get the best write throughput during a MySQL import with Amazon RDS?

tl;dr - How can we get the maximum EBS throughput for a db.r3.2xlarge instance? We're only seeing about half of what it can supposedly do. Apologies for the long length of this question. We've had ...
Stephen Melrose's user avatar
3 votes
0 answers
2k views

PostgreSQL continuous archiving - use snapshot for base backup on AWS?

I'm new to AWS and PostgreSQL admin and have been poring over the docs trying to come up with a good backup strategy for a fairly simple setup. I have a single Amazon Web Services EC2 instance that ...
Mark Berry's user avatar
2 votes
0 answers
60 views

'Deadlock found when trying to get lock; try restarting transaction' in AWS RDS MySQL 8.0.36 after upgrading from MySQL 5.7.42. Django v4.1.6

Following an upgrade of our AWS RDS instance from MySQL version 5.7.42 to version 8.0.36, we are encountering persistent deadlock issues across concurrent transactions, affecting even basic read ...
Karan Raj's user avatar
2 votes
0 answers
20 views

Aurora mysql throttle during writes

I came across a situation where I need expert opinion. Our application ingests data into table A in aurora mysql 3.02 every 5 seconds. This is a write intensive process. During this time, I am using ...
Falcon's user avatar
  • 101
2 votes
1 answer
3k views

Connection to AWS database gives back "You may not specify an IPv4 CIDR for an existing referenced group id rule."

I try to connect to an AWS database instance from a client by following this tutorial: https://medium.com/simplebackups/allow-a-remote-ip-to-connect-to-your-amazon-rds-mysql-instance-2d5074d601eb I ...
Bruno Henrique L N Peixoto's user avatar
2 votes
0 answers
4k views

DBeaver connection via SSH tunnel

Using DBeaver, I'm trying to connect to my AWS ec2 instance where I've installed a MariaDB database. I've created a new connection as: Connection: AWS / Maria DB Server Host: localhost (because I'm ...
Tommy's user avatar
  • 121
2 votes
0 answers
359 views

Migrate cluster Aurora RDS postgres from 9.X to 10 without downtime

Ok, this question is to find some strategy or tool that helps me to migrate from cluster Aurora RDS postgres from 9.6 to 10 without downtime. What I find until now Aurora RDS is allowed to do major ...
Krismorte's user avatar
  • 554
2 votes
0 answers
278 views

AWS RDS Multi A-Z vs DigitalOcean Managed Databases

I am currently hosting my database inside a t2.large instance on AWS EC2 which provides 8GB RAM and 2 CPUs. I am now looking for better options which are more scalable and provides features like ...
Andro's user avatar
  • 121
2 votes
0 answers
200 views

AWS RDS PostgreSQL: Significant query runtime difference between two (identical?) instances

TL;DR: Solution The problem was that one instance hat magnetic storage attached and was therefore significantly slower. Original Question I have two identical AWS RDS PostgreSQL 10.6 databases ...
jurgispods's user avatar
2 votes
0 answers
345 views

Aggressive Tempdb spill process

We are having an issue with aggressive tempdb spills that significantly effect overall server performance and, in rare cases, cause AlwaysOn failures. Tested on SQL2016 and SQL2017 Enterprise (recent ...
Alex Bochkov's user avatar
2 votes
0 answers
377 views

How to backup a local database to cloud database?

I am about to start developing a POS software as my new project with python and electron js. It is going to be a desktop application. However, my concern is it should work in both cases when desktop ...
Abbas's user avatar
  • 121
2 votes
0 answers
647 views

AWS RDS PostgreSQL - Managing Permissions

Relatively new to AWS RDS PostgreSQL environment. We are creating a database with multiple schemas. Users are grouped by "schema_role" that have privileges to create objects in assigned schemas. My ...
sanetta1's user avatar
2 votes
0 answers
606 views

Amazon AWS RDS 120GB free storage suddenly became 0GB within less than 2 hours

I've been using AWS RDS db.m4.large with 128GB storage for MySQL(InnoDB) for more than one year now. The size of my database is now less than 2GB and the free storage had always been more than 125GB ...
PearlIsMyLove's user avatar
2 votes
0 answers
567 views

Slow SSMS connecting to AWS EC2 instance

I have an AlwaysOn availability group in AWS EC2. 2 nodes, multisubnet, with 1 DC in one subnet, the other DC in a separate (3rd) subnet. All in the same VPC. When anyone connects to either of the ...
Peter's user avatar
  • 1,490
2 votes
0 answers
4k views

PostgreSQL could not connect to server on AWS

I am currently using AWS's free tier. I am receiving the error message: could not connect to server: Connection timed out (0x0000274C/10060) Is the server running on host "xxxxxxxxx" (-) and ...
Min's user avatar
  • 121
2 votes
0 answers
109 views

Simple mysql insert occasionally taking over 300 seconds

I have a super simple insert query, something like insert INTO `table_a` (`choice`, `updated_at`, `created_at`) VALUES (?, ?, ?) Which inserts one integer (1 to 10) and 2 time stamps. 99.9% of time ...
Jānis's user avatar
  • 21
2 votes
0 answers
4k views

Why does my AWS-RDS storage, under billing, say its approaching the limit (20GB) when my DB size is only 10MB?

I only have one instance running on my AWS RDS as Psql DB. The size of my DB, which has twenty tables but all the data amounts to 10MB. As for the screenshot I added, it says the month-end estimate of ...
shle2821's user avatar
  • 121
2 votes
0 answers
528 views

MySQL replication RDS Master - RDS Slave

I have read many posts about replication from RDS to external and vice versa. But my need is actually a bit different. I need to set replication between two RDS instances. Of course I know about ...
user2700022's user avatar
2 votes
0 answers
132 views

Mirror data on local SSD storage to conserve EBS I/O?

I have an AWS instance with local (ephemeral) SSD storage backed by a permanent EBS storage. Is it possible to configure the local storage to act as a mirror/cache for row data in MySQL? I do not wish ...
Slawomir's user avatar
  • 453
2 votes
0 answers
55 views

What is the best way to keep track of 1000 RDS hosted databases?

I want to know what is 'best-practices' for managing an extreme number of RDS instances. I have no problem managing five. But managing dozens or hundreds, that's another task. I'm thinking use a ...
Michael Occhipinti's user avatar
2 votes
0 answers
304 views

how to convert mongodb(2.4.10) startup2 to primary

I have standalone bitnami mongodb(2.4.10). The output of rs.status() command is below : rs.status() { "set" : "test", "date" : ISODate("2015-11-13T08:07:41Z"), "myState" : 5, "members"...
singh's user avatar
  • 21
2 votes
4 answers
4k views

MongoDB: Server sockets closed after a few minutes

I am working with multiple AWS intances connected to the same MongoDB database (inside Compose.io Elastic deployment). But i am getting the error server <url>:<port> sockets closed after a ...
santihbc's user avatar
2 votes
0 answers
569 views

MongoDB C# driver fails to reconnect after stepDown

I have an Elastic Beanstalk environment in AWS that constantly verifies the DB is accessible by querying the mongos for one document. We only speak to the DB routers and not to specific instances. ...
Nir's user avatar
  • 123
2 votes
0 answers
2k views

MySQL Server hitting 100% unexpectedly (Amazon AWS RDS)

We've been struggling with this issue for months. This week we upped our RDS instance to the highest performing instance and although the occurrences have reduced, we're still seeing our database ...
Luc's user avatar
  • 121
1 vote
0 answers
88 views

Configuring 3:1 Failover Cluster for SQL Developer Edition on Windows Server with AWS AMI

We are in the process of configuring a 3:1 failover cluster mechanism for SQL Developer Edition hosted on Windows Server, deployed using an AWS AMI. Our objective is to ensure that if any of the three ...
Rahul's user avatar
  • 11
1 vote
0 answers
2k views

AWS RDS Postgres: How to diagnose CheckpointLag and potential slowups using AWS' Monitoring suite?

We are currently hosting a postgres RDS database and our team is noticing slowup in our querying service. I'm noticing a spike in the metric, CheckpointLag and I've been tasked in trying to find where ...
Andrew Narvaez's user avatar
1 vote
0 answers
37 views

Is there any tool that can be used to backup and restore individual schemas and not the entire database?

Can someone help me with any tool that can be used to incrementally back up the individual schemas and restore them instead of backing up the entire DB? We need this for the Aurora MySQL DB RDS ...
Omkar's user avatar
  • 11
1 vote
1 answer
421 views

aws ec2 instance using instance profile role to connect to s3 bucket.. sql server 2022 backup getting operating system error 86

Looking to see if anyone else having this issue. I have a windows server 2019/sql server 2022 ec2 instance that has a instance profile using a role/policy to upload to an s3 bucket. I created a ...
KC_IT's user avatar
  • 11
1 vote
0 answers
98 views

Persistent problems connecting MySQL Workbench to an AWS RDS DB

I started off my attempt to figure out how to connect my local MySQL Workbench (8.0.32) client/application to an RDS Database on my analytics team's AWS Account by asking Bing AI and this is what it ...
Marlen's user avatar
  • 227
1 vote
0 answers
59 views

Postgres: copy from 2 different DBs for identical tables

I have two identical DBs, under the same port and host. (they both postgres DBs and on AWS) I want to create a script\write any query (even though it is not possible to create a query that use data ...
Dor Cohen's user avatar
1 vote
0 answers
87 views

Finding distance between 2 geospatial location in aws neptune with opencypher query language

I am working with amazon neptune and using openCypher query language and doing some stuff using notebook. I have latitude and longitude of 2 points and I want to calculate the distance between these 2 ...
Vishal Jamdade's user avatar
1 vote
0 answers
84 views

How to encrypt a production unencrypted RDS Aurora MySQL 8 cluster

I have a running RDS Aurora MySQL 8.0.23 cluster running in production. The database is unencrypted and I need to enable encryption for it. As far as I understand, this is not possible to do directly. ...
revy's user avatar
  • 111
1 vote
0 answers
187 views

Redshift User password change permission denied

Redshift user not able to change its own password getting below error: ALTER USER or_user WITH PASSWORD 'md5<hash>'; ERROR:permission denied Also tried granting 'ALTER USER' privileges using ...
Aadu's user avatar
  • 11
1 vote
0 answers
109 views

Restart a Running Sum after Static Threshold

I've been stuck trying to solve the following problem for some time: I essentially want to restart the rolling sum if the rolling sum exceeds 3600, else continue summing. I've sort of have it working ...
WhimsicalWhale's user avatar
1 vote
0 answers
29 views

Best practice to store subitems

I am going to create my first Dynamodb database table. I have 3 options in my mind: 1. Create a long table where every subitem is a new row. Example: user John | item 1 | 2021 user John | item 2 | ...
L777's user avatar
  • 111
1 vote
0 answers
122 views

Backup data from RDS to S3 and delete from RDS once copied to S3

We have a requirement werein we have to backup data from RDS(MYSQL and Postgres) to S3 incrementally and to delete the already copied data from RDS. I thought of using aws data-pipeline for this, ...
Sumant Kumar's user avatar
1 vote
0 answers
118 views

aws rds password change triggers updates to which fields in mysql.user?

I'm using AWS RDS with MySql (5.7.mysql_aurora.2.10.2) Due to internal policy I updated db password via AWS RDS modify DB instance menu. What I can't grasp is, when I updated pw for dev db instance, ...
cp103's user avatar
  • 33
1 vote
0 answers
915 views

How to debug a huge MySQL replication lag?

We have an AWS RDS and a corresponding Replica. Once or twice a month the replication lags and does not recover from its own. Our "solution" is to create a new replica and delete the old one....
binford's user avatar
  • 111
1 vote
1 answer
637 views

How to clear AWS RDS Aurora MySQL local storage?

I got a warning message about running out of AWS RDS local storage. The free storage capacity for DB Instance: {MY INSTANCE NAME} is low at 2% of the provisioned storage [Provisioned Storage: 157.36 ...
BingbongKim's user avatar
1 vote
0 answers
2k views

AWS Lambda to RDS PostgreSQL connection

Hello fellow AWS contributors, I’m currently working on a project to set up an example of connecting a Lambda function to our PostgreSQL database hosted on RDS. I tested my Python + SQL code locally (...
Allen Yang's user avatar
1 vote
0 answers
181 views

AWS S3 CLI : Check Validate Inside Automatically?

We're using "s3api put-object" and explicitly checking Hash MD5 to make sure the file uploaded to S3 correctly (Unless the upload file is less than 5 GB) aws s3api put-object --bucket ...
Sachiko's user avatar
  • 121