Skip to main content

Questions tagged [aws]

Amazon Web Services.

Filter by
Sorted by
Tagged with
4 votes
2 answers
3k views

change character_set_connection utf8mb4 mysql

I want to change character_set_connection utf8mb4. Its showing me utf8. I have follow this https://mathiasbynens.be/notes/mysql-utf8mb4 article and changed [client] default-character-set = utf8mb4 [...
0 votes
1 answer
24 views

AWS Postgres replication: adding indexes to a replica?

Apologies for the beginner question. I have a couple of AWS Postgres databases that will be receiving a few thousand writes a second on the day of an event. I also need to make read queries against ...
0 votes
1 answer
721 views

MySQL - Turkey/Istanbul Daylight Saving Time Change

Until this year Turkey was using daylight saving time, staying UTC+2 on winter period, UTC+3 on summer. This year it is decided to stay only in UTC+3. Our DateTime's are persisted on MySQL (5.26.34) ...
0 votes
1 answer
40 views

high cpu spikes on postgresql (rds)

I have a PG 15(.5) RDS instance, which is experiencing intermittent random(?) periods of high cpu; that do not seem to, afaict, correlate with an obvious cause: Here is one example. The queries being ...
0 votes
1 answer
40 views

I need to move from sqlite to a distributed setup. What are my options?

I have an sqlite db that has grown to 30gb and I'm still pushing data to it everyday. I have a couple services that write to it using libsqlite3. Soon it will become too big to keep locally. What is ...
0 votes
1 answer
9k views

Mysql Alter table add column with ALGORITHM=INPLACE, LOCK=NONE

Am running below query Query Alter table dbname.tablename add column column1 varchar(50), add column column2 text , ALGORITHM=INPLACE, LOCK=NONE; It takes more time to execute. Ideally running ...
2 votes
4 answers
4k views

MongoDB: Server sockets closed after a few minutes

I am working with multiple AWS intances connected to the same MongoDB database (inside Compose.io Elastic deployment). But i am getting the error server <url>:<port> sockets closed after a ...
0 votes
0 answers
7 views

CREATE TABLE permissions required to append Pyspark dataframe to SSMS table

I am using AWS glue to extract some data from RDS, parse it into some other format and push it back to RDS. The RDS user I use has SELECT and INSERT permissions on tic.Example. However, when I try to ...
1 vote
2 answers
2k views

Reading SQL Server .sqlaudit Files Stored in S3

I set up an audit in SQL Server that saves audit logs (.sqlaudit files) to RDS, which we then copy over to S3 using a standard process. All of the documentation I can find on reading these audit files ...
0 votes
1 answer
33 views

Can not create logon trigger on AWS RDS sql server instance

In order to audit logins I've used before a server level trigger catching the LOGON and saving it to a table, there are endless examples to do this. But trying to do the same on and AWS RDS sqlserver ...
1 vote
1 answer
58 views

Unable to enable Performance Insights on Amazon RDS db.t3.small instance

I recently upgraded my Amazon RDS instance from db.t2.micro to db.t3.small. After the upgrade, I also activated the performance_schema parameter in the associated parameter group because I've read ...
0 votes
1 answer
1k views

What is the difference between Aurora Mysql 5.7.x and Aurora 2.x.x

I have an RDS instance with Aurora Mysql 5.7.12 and I noticed that there are other versions of Aurora Mysql 5.7, but I don't understand what is the difference between them. Some of the version ...
1 vote
1 answer
637 views

How to clear AWS RDS Aurora MySQL local storage?

I got a warning message about running out of AWS RDS local storage. The free storage capacity for DB Instance: {MY INSTANCE NAME} is low at 2% of the provisioned storage [Provisioned Storage: 157.36 ...
0 votes
0 answers
13 views

how to use Amazon SCT to connection to an Amazon RDS database?

Apparently, Amazon SCT can be used to compare two schemas for differences. We have several RDS Postgres databases, using Native postres authentication. SCT has the option to connect to an RDS database ...
0 votes
1 answer
656 views

Mongo slow startup after upgrade to 4.2.5

I have upgraded the MongoDB replica set, which consists of 3 members, from 4.0.11 to 4.2.5. After upgrading, startup lasts about 5 minutes. Before upgrading it was instant. It is related to ...
0 votes
1 answer
298 views

Snowflake/S3 Pipeline: ETL architecture Questions

I am trying to build a pipeline which is sending data from Snowflake to S3 and then from S3 back into Snowflake (after running it through a production ML model on Sagemaker). I am new to Data ...
0 votes
0 answers
28 views

Is there a way to connect to Redshift from dBeaver CE on Mac Using a Configuration Profile

I am trying to connect to RedShift using dBeaver CE from my Mac. One of the other teams in our organization has a document to connect to RedShift using SQLWorkbench, but that is on Windows. I tried ...
0 votes
1 answer
32 views

AWS RDS DB Migration

I have a PostgresFB on an AWS RDS instance that we want to migrate to an on-site server. The problem we having is the migrating of data and the time it is taking to migrate the data. I have tried AWS ...
0 votes
1 answer
1k views

AWS Aurora Mysql different instance types for writer/reader

I have a db.r5.large for the master/writer. I want to add some readers. Do they need to be the same instance type as the master? Or can i add for example 3x db.t3.medium ?
0 votes
0 answers
39 views

database "template0" is not currently accepting connections

i got the following error database "template0" is not currently accepting connections How to vaccum it? Thanks UPDATE i got the following yesterday postgres=> select * from public.test; ...
-1 votes
1 answer
117 views

Can AWS services replace SQL Server Agent Jobs?

I've decided that I no longer want to use SQL Server Agent Jobs. They're tightly coupled to SQL Server, cause interesting security/permissions problems, and can be complicated to sequence. I instead ...
0 votes
2 answers
1k views

AWS KMS Encryption enable for SQL Server Columns?

Is it possible MSSQL on EC2 with a key in AWS KMS to encrypt columns
1 vote
2 answers
629 views

How to enable Cloud Watch logs for AWS DMS task?

I am creating AWS DMS task for migrating data from GCP SQL server to AWS Aurora MySQL. How can I attach log group which I created? I could able to enable cloud watch logs for the task but when I click ...
1 vote
1 answer
299 views

Intermittent SQLSTATE[HY000] [2003] Can't connect to MySQL server on 'server.here' (110)

I'm suddenly having intermittent 2003 connection errors and I can't find anything that has changed that can explain it. These servers have been running smoothly for years and suddenly two days ago ...
1 vote
0 answers
90 views

Configuring 3:1 Failover Cluster for SQL Developer Edition on Windows Server with AWS AMI

We are in the process of configuring a 3:1 failover cluster mechanism for SQL Developer Edition hosted on Windows Server, deployed using an AWS AMI. Our objective is to ensure that if any of the three ...
0 votes
0 answers
14 views

AWS RDS MySQL read replica's failover and standby instance's failover

This question is for AWS RDS MySQL I have recently started studying RDS, trying to study from the documentation as well as other sources. For following scenario I am unable to understand certain ...
1 vote
0 answers
2k views

AWS RDS Postgres: How to diagnose CheckpointLag and potential slowups using AWS' Monitoring suite?

We are currently hosting a postgres RDS database and our team is noticing slowup in our querying service. I'm noticing a spike in the metric, CheckpointLag and I've been tasked in trying to find where ...
7 votes
2 answers
11k views

How to set up Amazon RDS parameter group for Postgres?

I'm trying to create a parameter group in Amazon Web Services for an Postgres 9.5 RDS instance. I'm a little confused by the units being used for things such as shared_buffers and min_wal_size. ...
0 votes
0 answers
55 views

AWS RDS SQL Server 2019 Standard edition, everyday 3 am getting errors "insufficient system memory in resource pool 'internal' to run this query"

I have AWS RDS SQL Server 2019 Standard edition with 128GB RAM, everyday 3 am getting errors insufficient system memory in resource pool 'internal' to run this query There are few jobs that run at a ...
0 votes
1 answer
535 views

Can I run commands from aws_s3 extensions as non-root on PostgreSQL?

I'm trying to copy data from S3 to PostgreSQL (Amazon AWS RDS). I've set up the following: CREATE EXTENSION aws_s3 cascade schema reporting; CREATE DATABASE my_database; \connect my_database; -- ...
0 votes
1 answer
1k views

Master slave replication with different mysql version is on both slave and master

Currently, we have MySQL master-slave replication. Both master and slave servers have Mysql 5.5 Currently I need to add one more Master server having version 5.7. Is it possible to add Multiple ...
0 votes
1 answer
2k views

Change in bind_ip value is not reflecting

I have mongo installed on Centos instance in AWS and I am connecting to the mongoDB server from my system. To connect from remote system we need to change bind_ip value to 0.0.0.0 in /etc/mongod.conf ...
2 votes
1 answer
3k views

Connection to AWS database gives back "You may not specify an IPv4 CIDR for an existing referenced group id rule."

I try to connect to an AWS database instance from a client by following this tutorial: https://medium.com/simplebackups/allow-a-remote-ip-to-connect-to-your-amazon-rds-mysql-instance-2d5074d601eb I ...
0 votes
1 answer
923 views

Debuging import of a large dump file to MySQL

I'm trying to import a 50GB dump file to AWS RDS instance and have an issue. I get the following error: ERROR 2013 (HY000) at line 15850: Lost connection to MySQL server during query In the beaning ...
1 vote
1 answer
429 views

aws ec2 instance using instance profile role to connect to s3 bucket.. sql server 2022 backup getting operating system error 86

Looking to see if anyone else having this issue. I have a windows server 2019/sql server 2022 ec2 instance that has a instance profile using a role/policy to upload to an s3 bucket. I created a ...
0 votes
0 answers
35 views

How does AWS Data Migration Service actually work with MSSQL?

I'm very confused as to how AWS Data Migration Service is actually achieving it's replication from an on prem MS SQL 2019 instance to RDS 2019. I understand from the documentation that tables with a ...
2 votes
0 answers
65 views

'Deadlock found when trying to get lock; try restarting transaction' in AWS RDS MySQL 8.0.36 after upgrading from MySQL 5.7.42. Django v4.1.6

Following an upgrade of our AWS RDS instance from MySQL version 5.7.42 to version 8.0.36, we are encountering persistent deadlock issues across concurrent transactions, affecting even basic read ...
1 vote
1 answer
3k views

AWS RDS mysql deadlock

Everything in our production environment was working well. Yesterday, suddenly out of no where we were getting "lock wait" on any transaction related to a specific row. Same transaction on another row ...
0 votes
2 answers
485 views

Give third-party access to AWS hosted MySQL

I have a production MySQL database hosted on AWS for an eCommerce store I work with. Employees in the firm are requesting access to our live SQL database to use with BI tools like Tableau/Qlikview. ...
0 votes
1 answer
963 views

Amazon RDS change collate for mysql database in production without downtime

I saw a solution like this below: create a new table like your source table. alter that new table the way you want. insert your data into the new table. create indexes etc. as needed on the new table....
1 vote
2 answers
494 views

AWS RDS same file_guids

Getting this error on AWS RDS with MS SQL Database XXX cannot be restored because there is already an existing database with the same file_guids on the instance. I've imported from S3 once, it ...
1 vote
1 answer
994 views

How to install keyring_aws plugin in MySQL?

I am looking for a way to install keyring_aws plugin in mysql community edition. Is it possible? I gone through couple of docs, https://dev.mysql.com/doc/refman/5.7/en/keyring-aws-plugin.html ...
1 vote
1 answer
307 views

RDS import from SQL backup

I'm migrating a SQL 2008 database from a corporate data center to an RDS intance on AWS. So far I have performed a native backup which gave me a .bak file Is it possible to simply upload this to S3 ...
0 votes
1 answer
1k views

Cannot connect to Aurora RDS using workbench over ssh

I set up an environment on AWS that consists of a VPC with a private and public subnet following the instructions for Magento Quick Start: http://docs.aws.amazon.com/quickstart/latest/magento/...
1 vote
1 answer
8k views

Why are my postgres logical replication workers crashing after syncing a certain amount of data?

I am trying to setup a logical replication between two postgresql 12 DBs run in Docker containers on AWS ECS. I gave the task 2 vCPU and 6 GB of ram so quite luxurious for a DB with ~1e7 rows in two ...
1 vote
1 answer
64 views

Mysql 5.7 Slave replication is Slow

We are trying to debug a slave lag issue - it is currently lagging behind the master by 24 hours. Deployed on a AWS EC2 machine Database size is around 600 GB Grows at roughly 500 MB to 1 GB per day ...
0 votes
1 answer
758 views

Best way to create a daily snapshotted read-only db in RDS?

We have a PostgreSQL db instance in RDS. In our application we need to run a daily export in the early hours of every day, the export and transformation may take some time and one issue we've found is ...
0 votes
0 answers
69 views

Unable to connect to AWS mysql RDS instance

I created an AWS mySQL RDS instance (free tier), but i am unable to connect to it from workbench or cli. I have enabled public access to the DB while creation and allowed "All traffic" while ...
0 votes
1 answer
348 views

My Galera Cluster does not connect across AWS regions

I am building a MariaDB Galera Cluster, on AWS, EC2. Using MariaDB 10.5 and Galera 4. I have two nodes in the California region, named galera_ca and galera_ca2, and a third node in Oregon name ...
0 votes
0 answers
12 views

What is a good mechanism to get production database data into other environments along with de identifying it

I am sure this is a solved problem and many people would have a great process already in place. How do I easily get data in my production server to other environments like staging and testing. We ...

1
2 3 4 5
10