Questions tagged [aws]

Amazon Web Services.

Filter by
Sorted by
Tagged with
0 votes
0 answers
7 views

disable trigger command giving error - mysql

I have a master slave server configured(one master and one slave) in amazon ec2 ubuntu instances. below are the tables and the insert trigger is on the likes table. create table posts ( post_id ...
user avatar
0 votes
0 answers
15 views

Oracle 19c automatic indexing

It seems Oracle automatic indexing feature that was introduced in Oracle 19c works only on Oracle Cloud and not AWS RDS. Is my understanding correct (that AWS RDS doesn't support it)? Reference: https:...
user avatar
0 votes
0 answers
55 views

AWS RDS database replication replicates everything regardless my parameters group

I have a database in RDS that I want to replicate. I made a parameter group where I described which tables I want to be replicated. I applied it to my replica, and still it replicated the whole ...
user avatar
1 vote
1 answer
14 views

dual-password-like feature for MySQL before v 8.0

tldr; Is there a dual-password-like feature for MySQL v.5.x ? Problem I have a MySQL server that needs to temporarily allow two passwords for one account, due to legal constraints that impose DBMS ...
user avatar
  • 13
1 vote
0 answers
98 views

AWS Lambda to RDS PostgreSQL connection

Hello fellow AWS contributors, I’m currently working on a project to set up an example of connecting a Lambda function to our PostgreSQL database hosted on RDS. I tested my Python + SQL code locally (...
user avatar
0 votes
0 answers
18 views

When is the mysql performance schema event "wait/synch/cond/sql/MYSQL_BIN_LOG::COND_done" fired?

I am using Aurora Mysql 5.7.mysql_aurora.2.07.2 and am facing bottlenecks on load testing with a write-heavy workload. On enabling performance insights I noticed that a large number of sessions were ...
user avatar
2 votes
1 answer
118 views

Aurora upgrade 2 to 3 / MySql 5.7 to 8.0: schemaInconsistencyCheck

In our attempts to upgrade our Aurora 2 MySql 5.7 DB to Aurora 3 MySql 8.0, we are running into a pre-check that we are unable to resolve. The error is: { "id": "...
user avatar
  • 21
0 votes
0 answers
13 views

Does AWS RDS MariabDb supports automatic failover?

We want to use AWS RDS to store our app's data. We are leaning towards MariaDb because of its temporal tables feature. And hence not chosing AWS Aurora with MySQL. Another reason being even though ...
user avatar
  • 121
0 votes
0 answers
22 views

Unable to connect to external mysql server from ec2 instance

I've some API written in express, I'm using sequlize as orm. Everything is working fine in local environment. The problem is while running on ec2. If I give any of the RDS url as host, the database ...
user avatar
  • 101
0 votes
0 answers
11 views

How can we run Federated queries on RDS/Aurora PostgreSQL databases

I am trying to run few select queries to take snapshots on few tables and PG views(like select * from pg_Stat_activity) of AWS Aurora/RDS PostgreSQL databases on each of our instances(around 20) that ...
user avatar
4 votes
1 answer
151 views

Why SQL inserts are slower in AWS Aurora Serverless than in AWS RDS

We had an AWS MySQL RDS t3.xlarge instance with 2000 IOPS. Also, I have a cron job written in java which inserts data in a table: it can insert up to 12M rows daily. Since AWS RDS cost is quite high ...
user avatar
  • 141
0 votes
1 answer
34 views

Where to install SQL on EC2

If SQL Server and it's system databases are installed on an EC2 local drive, will they be recovered in a crash? My understanding is nothing but temporary files and the OS should be on the local ...
user avatar
1 vote
0 answers
23 views

AWS S3 CLI : Check Validate Inside Automatically?

We're using "s3api put-object" and explicitly checking Hash MD5 to make sure the file uploaded to S3 correctly (Unless the upload file is less than 5 GB) aws s3api put-object --bucket ...
user avatar
  • 121
0 votes
0 answers
24 views

Where is mysqlpump log file in Linux/Ubuntu located

I am neither a DB administrator, nor a DevOps but I need to migrate a very large table (~500M rows) from one MySQL schema to another. For doing so, I use mysqlpumpbackup tool. Also, since the DB is an ...
user avatar
  • 141
0 votes
1 answer
281 views

AWS RDS "Maintenance Required"

I saw from the web interface that maintenance on my RDS postgresql instances is required, so I ran aws rds describe-pending-maintenance-actions, and it says that there's a "system-update" ...
user avatar
  • 455
1 vote
2 answers
106 views

Reading SQL Server .sqlaudit Files Stored in S3

I set up an audit in SQL Server that saves audit logs (.sqlaudit files) to RDS, which we then copy over to S3 using a standard process. All of the documentation I can find on reading these audit files ...
user avatar
1 vote
0 answers
183 views

Connection to AWS database gives back "You may not specify an IPv4 CIDR for an existing referenced group id rule."

I try to connect to a AWS database instance from a client by following this tutorial: https://medium.com/simplebackups/allow-a-remote-ip-to-connect-to-your-amazon-rds-mysql-instance-2d5074d601eb I ...
user avatar
0 votes
0 answers
27 views

Dynamodb throttling config using boto3

I see couple of solutions on how to handle dynamo throttling errors. one is to set it in config object like this import boto3 from botocore.config import Config config = Config( retries = { '...
user avatar
1 vote
0 answers
52 views

Does AWS Aurora MySQL not support encrypted binary log replication with RDS MySQL master?

Trying to setup replication between an RDS MySQL (5.6) master with an Aurora MySQL (also 5.6) replica cluster in the same region via binary log replication for a work project. However, this doesn't ...
user avatar
1 vote
2 answers
204 views

AWS Aurora Postgres 12 Setting Collation

I posted this on stack overflow as well, but didn't get much traction over there. If I am not able to get some thoughts on here, then I will probably open a support ticket with AWS. I am trying to set ...
user avatar
0 votes
1 answer
68 views

Moving entire SQL Server 2016 to a new location - best method

At my organization, we have a SQL Server (2016) running on an EC2 instance at Amazon on a Windows with SQL Server license. My boss realized we could save a ton of money by standing up a Windows-only ...
user avatar
  • 327
0 votes
0 answers
266 views

Oracle Storage Full, How to release space?

i have and AWS RDS Oracle Database wich its storage is full, looks like the cause is SYSAUX tablespace with 10.2GB size The largest object inside SYSAUX is: WRI$_ADV_OBJECTS (TABLE) checking the table ...
user avatar
1 vote
1 answer
105 views

Intermittent SQLSTATE[HY000] [2003] Can't connect to MySQL server on 'server.here' (110)

I'm suddenly having intermittent 2003 connection errors and I can't find anything that has changed that can explain it. These servers have been running smoothly for years and suddenly two days ago ...
user avatar
  • 111
0 votes
0 answers
67 views

how to sync one table of AWS RDS to another RDS

I have requirement like need to synchronize one table of data (contain user list) in AWS RDS instance to another RDS Instance. only particular user's table need to synchronize. ex: RDS-1 have schema ...
user avatar
  • 1
-1 votes
1 answer
103 views

How to temporarily disable foreign keys in Amazon RDS Aurora PostgreSQL? [duplicate]

Hi I am using DMS to load data from physical server to AWS Aurora PostgreSQL, but I am getting error for foreign key constraint. I want to disable using any sp / function. Could you please help me?
user avatar
0 votes
0 answers
12 views

Local SQL server replication to AWS RDS

I have a local licensed SQL server, I need to have an online replica for one of the local databases I have been reading and checking Amazon Web Service (AWS). I tried to do SQL Server Replication ...
user avatar
1 vote
0 answers
33 views

Any thoughts on what crashed my database?

A few days ago, our database server, (see specs below), spiked to 4800% CPU usage. The database is about 100GB. For 3 hours we tried to figure out what the issue was. We finally figured out a feature ...
user avatar
0 votes
2 answers
54 views

database changes are lost in the next session

We just move to Amazon RDS. Now all the CREATE, UPDATE, and INSERT commands are reverting in the next session. All the tables are InnoDB and query caching is on. What could be the problem?
user avatar
0 votes
0 answers
154 views

Aurora I/O IOPS vs Billed Volume IOPS

Here is a AWS Aurora PostgreSQL 12 database. The database is an r5.4xlarge and average load is ~16. Over 3 hours, the average "Write IOPS" was 40,000 and the average "Read IOPS" ...
user avatar
0 votes
0 answers
85 views

psql connects to AWS RDS instance for co-worker, but not for me

We're on an EC2 VM (the same EC2 VM on the same subnet as the RDS instance) running vanilla PostgreSQL 12.5, and using psql to connect to an AWS RDS PostgreSQL 12.5 instance. My co-worker and I run ...
user avatar
  • 455
0 votes
0 answers
12 views

AWS glue - load data by a dynamic condition

I have a concern to apply AWS Glue to my project for below case to see is it possiple on Glue -I have a AWS RDS Postgresql db and a Resdhift DW -I want to load data from Postgresql to Redshift but not ...
user avatar
  • 13
1 vote
0 answers
18 views

Container is running beyond physical memory and killed on request (code 143) [closed]

I ran a query which involved a JOIN and an AVG operation: SELECT AVG(user_amount) AS average_user_per_game FROM ( SELECT start_time ,end_time ,COUNT(DISTINCT ID) AS ...
user avatar
0 votes
0 answers
30 views

Remote Nodes is not detecting in cluster validate configuration in sql server 2019

I am not a professional DBA. In my organization, we are trying to implement active active node always on clustering. We have 2 nodes, primary and secondary. After installing WSFC, and during ...
user avatar
0 votes
1 answer
271 views

RDS PostgreSQL -> aws_lambda.invoke error: 'Unable to connect to endpoint'

SELECT * FROM aws_lambda.invoke( 'arn:aws:lambda:us-west-2:123456789012:function:spark-ods-lambda-preprod-myETLTest', '{"body": "Hello from Postgres!"}'::JSON, 'us-west-2', ...
user avatar
0 votes
1 answer
168 views

Postgres Database flagged as STORAGE FULL whereas there's 45 Gb available

I will start this post by stating that I am not very experienced in database administration, please accept my apologies for any unclear explanation you may find below. We have a replica postgresql ...
user avatar
0 votes
0 answers
62 views

Timestamp is off by an hour When Migrating from Mysql to Sql server AWS DMS

We are trying to migrate a MySQL database on AWS RDS to SQL Server Database on AWS. Both the Source and Target Database are created in PST Time zone. Replication Instance Version : 3.4.4 Mysql Version:...
user avatar
1 vote
1 answer
1k views

How to connect Datagrip with AWS Athena using an assumed role?

I am able to make Athena queries through the AWS CLI. This requires me to assume a role first (I use awsume). The role requires MFA. Now I want to configure Datagrip for this as well. However there ...
user avatar
  • 121
2 votes
1 answer
149 views

Backup TO URL S3

Can I do a SQL backup to AWS S3 URL from an EC2 machine I know that Azure side is possible but I do not know if it is possible AWS side thank you for your advice
user avatar
0 votes
0 answers
352 views

AWS DMS migration not migrated Foreign keys, sequences and indexes got renamed

I have used DMS for AURORA PostgreSQL to PostgreSQL SCHEMA Migration. Migrate Data only type is used for DMS activity. After a Full load of Data, all tables were created on the target endpoint with ...
user avatar
0 votes
0 answers
73 views

AWS-RDS database catalog is restricted

I use PostgreSQL 13.2 in AWS-RDS. The database is up and working properly; I can connect with the user provided by Amazon. We need to alter the catalog to enable the implicit cast of integer to ...
user avatar
0 votes
1 answer
228 views

delete obsolete archivelog

I have an oracle instance aws recently migrated to RDS aws I just noticed that my database is set by default in archivelog mode and that the archivelog are not deleted who has any idea how deleted the ...
user avatar
0 votes
0 answers
69 views

Python / AWS RDS - 300 insert statements taking 10 minutes to complete

I'm using Python 3.7 with SQLAlchemy on Ubuntu 18.04. I have two MySQL Databases - a local instance hosted on bare metal and an Amazon RDS instance. Both are accessible from MySQL Workbench on my ...
user avatar
0 votes
1 answer
51 views

MySQL Replication from On-Premises to AWS

I have an on-premises DB server running MySQL 5.5.37 with multiple databases. I created database on the AWS RDS. The idea is to set the replication from on-premises to the AWS, but for only one ...
user avatar
  • 111
0 votes
0 answers
65 views

Is offsite replication from MySQL AWS RDS with encrypted RDS storage possible? How?

AWS RDS for MySQL now supports encrypted storage backends. This encrypts the MySQL data and binlogs with a key within AWS's key management system, thus causing offsite replication issues because we ...
user avatar
  • 13
1 vote
1 answer
56 views

Clear PostgreSQL logs in AWS Ubuntu Server

I am trying to clear the logs of an postgresql under /var/log/postgresql/ but I am getting error message as below: /var/log/postgresql$ sudo > postgresql-11-main.log -bash: postgresql-11-main.log:...
user avatar
  • 113
1 vote
1 answer
616 views

subquery must return onl one column in postgresql

I want to get the XML response after the stored procedure call in PostgreSQL. In the below query I was trying to get the output, but it throws an Error: subquery must return only one column. Can ...
user avatar
0 votes
0 answers
28 views

Same query taking different execution times on equivalent RDS instances

The train table has around 60million records all of which have their updated_at timestamp in the year 2021. The schema of the table is as below. Table "public.train" ...
user avatar
  • 131
0 votes
0 answers
14 views

Does it make sense to separate records in a document DB (e.g. DynamoDB) for better query performance?

I've recently started working with DynamoDB, and most of my experience is in traditional data warehousing (e.g. sql server). One common pattern which I saw when working with SQL server was that we ...
user avatar
  • 101
0 votes
1 answer
103 views

how to mongorestore mongoDB 4.2 to documentDB 4.0?

I need to do mongorestore from my mongodb 4.2 to DocumenDb 4.0 compatible i got the command from aws which is this mongorestore --ssl --host="abc.aws.com:27017" --username=user --password=...
user avatar
  • 69
1 vote
0 answers
65 views

SQL Always on Availability Groups Direct Seeding

Setting up a new SQL cluster and HA using SQL Availability Groups. SQL 2019 STD 2 Node Multi Subnet Basic AG Primary Node AWS Secondary Node VMWare on premise I am using the newer Automatic Seeding ...
user avatar
  • 397

1
2 3 4 5
9