Questions tagged [aws]
Amazon Web Services.
428
questions
0
votes
0
answers
7
views
disable trigger command giving error - mysql
I have a master slave server configured(one master and one slave) in amazon ec2 ubuntu instances.
below are the tables and the insert trigger is on the likes table.
create table posts (
post_id ...
0
votes
0
answers
15
views
Oracle 19c automatic indexing
It seems Oracle automatic indexing feature that was introduced in Oracle 19c works only on Oracle Cloud and not AWS RDS.
Is my understanding correct (that AWS RDS doesn't support it)?
Reference: https:...
- 25
0
votes
0
answers
55
views
AWS RDS database replication replicates everything regardless my parameters group
I have a database in RDS that I want to replicate. I made a parameter group where I described which tables I want to be replicated. I applied it to my replica, and still it replicated the whole ...
1
vote
1
answer
14
views
dual-password-like feature for MySQL before v 8.0
tldr; Is there a dual-password-like feature for MySQL v.5.x ?
Problem
I have a MySQL server that needs to temporarily allow two passwords for one account, due to legal constraints that impose DBMS ...
- 13
1
vote
0
answers
98
views
AWS Lambda to RDS PostgreSQL connection
Hello fellow AWS contributors, I’m currently working on a project to set up an example of connecting a Lambda function to our PostgreSQL database hosted on RDS. I tested my Python + SQL code locally (...
- 11
0
votes
0
answers
18
views
When is the mysql performance schema event "wait/synch/cond/sql/MYSQL_BIN_LOG::COND_done" fired?
I am using Aurora Mysql 5.7.mysql_aurora.2.07.2 and am facing bottlenecks on load testing with a write-heavy workload. On enabling performance insights I noticed that a large number of sessions were ...
- 101
2
votes
1
answer
118
views
Aurora upgrade 2 to 3 / MySql 5.7 to 8.0: schemaInconsistencyCheck
In our attempts to upgrade our Aurora 2 MySql 5.7 DB to Aurora 3 MySql 8.0, we are running into a pre-check that we are unable to resolve. The error is:
{
"id": "...
- 21
0
votes
0
answers
13
views
Does AWS RDS MariabDb supports automatic failover?
We want to use AWS RDS to store our app's data. We are leaning towards MariaDb because of its temporal tables feature.
And hence not chosing AWS Aurora with MySQL. Another reason being even though ...
- 121
0
votes
0
answers
22
views
Unable to connect to external mysql server from ec2 instance
I've some API written in express, I'm using sequlize as orm.
Everything is working fine in local environment. The problem is while running on ec2.
If I give any of the RDS url as host, the database ...
- 101
0
votes
0
answers
11
views
How can we run Federated queries on RDS/Aurora PostgreSQL databases
I am trying to run few select queries to take snapshots on few tables and PG views(like select * from pg_Stat_activity) of AWS Aurora/RDS PostgreSQL databases on each of our instances(around 20) that ...
4
votes
1
answer
151
views
Why SQL inserts are slower in AWS Aurora Serverless than in AWS RDS
We had an AWS MySQL RDS t3.xlarge instance with 2000 IOPS. Also, I have a cron job written in java which inserts data in a table: it can insert up to 12M rows daily. Since AWS RDS cost is quite high ...
- 141
0
votes
1
answer
34
views
Where to install SQL on EC2
If SQL Server and it's system databases are installed on an EC2 local drive, will they be recovered in a crash?
My understanding is nothing but temporary files and the OS should be on the local ...
1
vote
0
answers
23
views
AWS S3 CLI : Check Validate Inside Automatically?
We're using "s3api put-object" and explicitly checking Hash MD5 to make sure the file uploaded to S3 correctly (Unless the upload file is less than 5 GB)
aws s3api put-object --bucket ...
- 121
0
votes
0
answers
24
views
Where is mysqlpump log file in Linux/Ubuntu located
I am neither a DB administrator, nor a DevOps but I need to migrate a very large table (~500M rows) from one MySQL schema to another. For doing so, I use mysqlpumpbackup tool. Also, since the DB is an ...
- 141
0
votes
1
answer
281
views
AWS RDS "Maintenance Required"
I saw from the web interface that maintenance on my RDS postgresql instances is required, so I ran aws rds describe-pending-maintenance-actions, and it says that there's a "system-update" ...
- 455
1
vote
2
answers
106
views
Reading SQL Server .sqlaudit Files Stored in S3
I set up an audit in SQL Server that saves audit logs (.sqlaudit files) to RDS, which we then copy over to S3 using a standard process. All of the documentation I can find on reading these audit files ...
1
vote
0
answers
183
views
Connection to AWS database gives back "You may not specify an IPv4 CIDR for an existing referenced group id rule."
I try to connect to a AWS database instance from a client by following this tutorial:
https://medium.com/simplebackups/allow-a-remote-ip-to-connect-to-your-amazon-rds-mysql-instance-2d5074d601eb
I ...
0
votes
0
answers
27
views
Dynamodb throttling config using boto3
I see couple of solutions on how to handle dynamo throttling errors. one is to set it in config object like this
import boto3
from botocore.config import Config
config = Config(
retries = {
'...
1
vote
0
answers
52
views
Does AWS Aurora MySQL not support encrypted binary log replication with RDS MySQL master?
Trying to setup replication between an RDS MySQL (5.6) master with an Aurora MySQL (also 5.6) replica cluster in the same region via binary log replication for a work project. However, this doesn't ...
1
vote
2
answers
204
views
AWS Aurora Postgres 12 Setting Collation
I posted this on stack overflow as well, but didn't get much traction over there. If I am not able to get some thoughts on here, then I will probably open a support ticket with AWS.
I am trying to set ...
0
votes
1
answer
68
views
Moving entire SQL Server 2016 to a new location - best method
At my organization, we have a SQL Server (2016) running on an EC2 instance at Amazon on a Windows with SQL Server license. My boss realized we could save a ton of money by standing up a Windows-only ...
- 327
0
votes
0
answers
266
views
Oracle Storage Full, How to release space?
i have and AWS RDS Oracle Database wich its storage is full, looks like the cause is SYSAUX tablespace with 10.2GB size
The largest object inside SYSAUX is: WRI$_ADV_OBJECTS (TABLE) checking the table ...
1
vote
1
answer
105
views
Intermittent SQLSTATE[HY000] [2003] Can't connect to MySQL server on 'server.here' (110)
I'm suddenly having intermittent 2003 connection errors and I can't find anything that has changed that can explain it. These servers have been running smoothly for years and suddenly two days ago ...
- 111
0
votes
0
answers
67
views
how to sync one table of AWS RDS to another RDS
I have requirement like need to synchronize one table of data (contain user list) in AWS RDS instance to another RDS Instance.
only particular user's table need to synchronize.
ex: RDS-1 have schema ...
- 1
-1
votes
1
answer
103
views
How to temporarily disable foreign keys in Amazon RDS Aurora PostgreSQL? [duplicate]
Hi I am using DMS to load data from physical server to AWS Aurora PostgreSQL, but I am getting error for foreign key constraint.
I want to disable using any sp / function. Could you please help me?
0
votes
0
answers
12
views
Local SQL server replication to AWS RDS
I have a local licensed SQL server, I need to have an online replica for one of the local databases
I have been reading and checking Amazon Web Service (AWS).
I tried to do SQL Server Replication ...
- 101
1
vote
0
answers
33
views
Any thoughts on what crashed my database?
A few days ago, our database server, (see specs below), spiked to 4800% CPU usage. The database is about 100GB. For 3 hours we tried to figure out what the issue was. We finally figured out a feature ...
- 11
0
votes
2
answers
54
views
database changes are lost in the next session
We just move to Amazon RDS. Now all the CREATE, UPDATE, and INSERT commands are reverting in the next session. All the tables are InnoDB and query caching is on. What could be the problem?
- 129
0
votes
0
answers
154
views
Aurora I/O IOPS vs Billed Volume IOPS
Here is a AWS Aurora PostgreSQL 12 database.
The database is an r5.4xlarge and average load is ~16.
Over 3 hours, the average "Write IOPS" was 40,000 and the average "Read IOPS" ...
- 640
0
votes
0
answers
85
views
psql connects to AWS RDS instance for co-worker, but not for me
We're on an EC2 VM (the same EC2 VM on the same subnet as the RDS instance) running vanilla PostgreSQL 12.5, and using psql to connect to an AWS RDS PostgreSQL 12.5 instance.
My co-worker and I run ...
- 455
0
votes
0
answers
12
views
AWS glue - load data by a dynamic condition
I have a concern to apply AWS Glue to my project for below case to see is it possiple on Glue
-I have a AWS RDS Postgresql db and a Resdhift DW
-I want to load data from Postgresql to Redshift but not ...
- 13
1
vote
0
answers
18
views
Container is running beyond physical memory and killed on request (code 143) [closed]
I ran a query which involved a JOIN and an AVG operation:
SELECT
AVG(user_amount) AS average_user_per_game
FROM
(
SELECT
start_time
,end_time
,COUNT(DISTINCT ID) AS ...
- 111
0
votes
0
answers
30
views
Remote Nodes is not detecting in cluster validate configuration in sql server 2019
I am not a professional DBA. In my organization, we are trying to implement active active node always on clustering. We have 2 nodes, primary and secondary. After installing WSFC, and during ...
0
votes
1
answer
271
views
RDS PostgreSQL -> aws_lambda.invoke error: 'Unable to connect to endpoint'
SELECT * FROM aws_lambda.invoke(
'arn:aws:lambda:us-west-2:123456789012:function:spark-ods-lambda-preprod-myETLTest',
'{"body": "Hello from Postgres!"}'::JSON,
'us-west-2',
...
- 51
0
votes
1
answer
168
views
Postgres Database flagged as STORAGE FULL whereas there's 45 Gb available
I will start this post by stating that I am not very experienced in database administration, please accept my apologies for any unclear explanation you may find below.
We have a replica postgresql ...
0
votes
0
answers
62
views
Timestamp is off by an hour When Migrating from Mysql to Sql server AWS DMS
We are trying to migrate a MySQL database on AWS RDS to SQL Server Database on AWS.
Both the Source and Target Database are created in PST Time zone.
Replication Instance Version : 3.4.4 Mysql Version:...
1
vote
1
answer
1k
views
How to connect Datagrip with AWS Athena using an assumed role?
I am able to make Athena queries through the AWS CLI. This requires me to assume a role first (I use awsume). The role requires MFA.
Now I want to configure Datagrip for this as well. However there ...
- 121
2
votes
1
answer
149
views
Backup TO URL S3
Can I do a SQL backup to AWS S3 URL from an EC2 machine
I know that Azure side is possible but I do not know if it is possible AWS side
thank you for your advice
0
votes
0
answers
352
views
AWS DMS migration not migrated Foreign keys, sequences and indexes got renamed
I have used DMS for AURORA PostgreSQL to PostgreSQL SCHEMA Migration. Migrate Data only type is used for DMS activity.
After a Full load of Data, all tables were created on the target endpoint with ...
0
votes
0
answers
73
views
AWS-RDS database catalog is restricted
I use PostgreSQL 13.2 in AWS-RDS.
The database is up and working properly; I can connect with the user provided by Amazon.
We need to alter the catalog to enable the implicit cast of integer to ...
- 101
0
votes
1
answer
228
views
delete obsolete archivelog
I have an oracle instance aws recently migrated to RDS aws
I just noticed that my database is set by default in archivelog mode and that the archivelog are not deleted
who has any idea how deleted the ...
0
votes
0
answers
69
views
Python / AWS RDS - 300 insert statements taking 10 minutes to complete
I'm using Python 3.7 with SQLAlchemy on Ubuntu 18.04. I have two MySQL Databases - a local instance hosted on bare metal and an Amazon RDS instance. Both are accessible from MySQL Workbench on my ...
- 101
0
votes
1
answer
51
views
MySQL Replication from On-Premises to AWS
I have an on-premises DB server running MySQL 5.5.37 with multiple databases.
I created database on the AWS RDS.
The idea is to set the replication from on-premises to the AWS, but for only one ...
- 111
0
votes
0
answers
65
views
Is offsite replication from MySQL AWS RDS with encrypted RDS storage possible? How?
AWS RDS for MySQL now supports encrypted storage backends. This encrypts the MySQL data and binlogs with a key within AWS's key management system, thus causing offsite replication issues because we ...
- 13
1
vote
1
answer
56
views
Clear PostgreSQL logs in AWS Ubuntu Server
I am trying to clear the logs of an postgresql under /var/log/postgresql/ but I am getting error message as below:
/var/log/postgresql$ sudo > postgresql-11-main.log
-bash: postgresql-11-main.log:...
- 113
1
vote
1
answer
616
views
subquery must return onl one column in postgresql
I want to get the XML response after the stored procedure call in PostgreSQL. In the below query I was trying to get the output, but it throws an Error: subquery must return only one column. Can ...
0
votes
0
answers
28
views
Same query taking different execution times on equivalent RDS instances
The train table has around 60million records all of which have their updated_at timestamp in the year 2021. The schema of the table is as below.
Table "public.train"
...
- 131
0
votes
0
answers
14
views
Does it make sense to separate records in a document DB (e.g. DynamoDB) for better query performance?
I've recently started working with DynamoDB, and most of my experience is in traditional data warehousing (e.g. sql server). One common pattern which I saw when working with SQL server was that we ...
- 101
0
votes
1
answer
103
views
how to mongorestore mongoDB 4.2 to documentDB 4.0?
I need to do mongorestore from my mongodb 4.2 to DocumenDb 4.0 compatible i got the command from aws
which is this
mongorestore --ssl --host="abc.aws.com:27017" --username=user --password=...
- 69
1
vote
0
answers
65
views
SQL Always on Availability Groups Direct Seeding
Setting up a new SQL cluster and HA using SQL Availability Groups.
SQL 2019 STD 2 Node Multi Subnet Basic AG
Primary Node AWS
Secondary Node VMWare on premise
I am using the newer Automatic Seeding ...
- 397