Questions tagged [aws]
Amazon Web Services.
373
questions
0
votes
0answers
3 views
How to modify the block size of my S3 parquet files that are being queried in Athena?
I read that adjusting the block size of the parquet files being queried with Athena can affect and possibly improve the performance of the queries. My parquet files for my database are currently ...
1
vote
1answer
45 views
AWS iops vs disk iops?
Recently devops guy from our company told me that our local mysql stage environment are much faster than aws, because local disk has 10k iops, but our aws rds has only 500 iops.
As far as I ...
1
vote
0answers
16 views
Storing Analytic Data for Multi-Tenet SaaS with AWS Aurora [closed]
I have an app that a user can upload an excel sheet of analytics data to S3. I am wanting to trigger a Lambda function on upload to do some data processing and then write the analytics to a client's ...
-1
votes
1answer
34 views
What value to set for MAX and MIN memory of SQL Server hosted on Bare Metal [duplicate]
Within AWS, Many of our Database servers are being migrated from EC2 Instance to Bare Metal. (Correct me, If I am wrong) In Bare metal, there are two memory limits available for the VM hosted on Bare ...
-1
votes
0answers
7 views
How to import data from AWS data lake to PostgreSQL DB? [closed]
We got already existing product which pushed data to AWS data lake and currently we are manually using that that data for some external processing. Now we are creating a product with PostgreSQL DB. We ...
0
votes
1answer
24 views
AWS RDS MySQL some time get slow performance when update table1 set field='any word' where primarykey=1234
Normally when update table1 set field='any word' where primarykey=1234 take 1sec. or less but sometimes random take much more time possible 500sec. or more.
I was set very well and never see high CPU,...
0
votes
1answer
22 views
Storage problem with MYSQL read replica
I have one master RDS instance of 50 GB storage and created a read replica of the master DB with the same configuration.
I use this read replica only for SELECT operations nothing else. But suddenly ...
0
votes
0answers
20 views
Unable to connect to postgresql EC2 instance from VPN
I have an EC2 instance of timescaledb running on AWS. For security purposes, my team members and I are using OpenVPN so that we have access to it and the same IP address has been defined in the ...
0
votes
1answer
11 views
High write IOPS on MySQL instance
I posted this first in the aws forums before i learned that there's a stackoverflow for DBs but i would ask this here as well.
We recently took over management of a wordpress site using a MySQL DB ...
0
votes
0answers
18 views
MySQL 5.6 - Can I disable SSL for a single user
Server version: 5.6.21-70.1-log
Linux
SSL Keys
ssl-ca=/etc/mysql-ssl/ca-cert.pem
ssl-cert=/etc/mysql-ssl/server-cert.pem
ssl-key=/etc/mysql-ssl/server-key.pem
skip-name-resolve
skip-external-locking
...
0
votes
0answers
41 views
What is the difference between Aurora Mysql 5.7.x and Aurora 2.x.x
I have an RDS instance with Aurora Mysql 5.7.12 and I noticed that there are other versions of Aurora Mysql 5.7, but I don't understand what is the difference between them.
Some of the version ...
0
votes
0answers
4 views
In AWS how to migrate “Microsoft Windows Server 2016” instance to “Microsoft Windows Server 2016 with SQL Server 2017 Standard” AMI
Currently I have "Microsoft Windows Server 2016" instance running in AWS where I have installed evaluation version of SQL server 2017. Now I want to move this server along with SQL database to "...
0
votes
0answers
12 views
AWS RDS Fine Grained Access Control using IAM Authentication
Is it possible to limit a users access to specific 'databases' within an RDS DB cluster using IAM authentication?
Looking at this documentation I can't see any obvious Conditions that would allow ...
0
votes
1answer
47 views
Mongo slow startup after upgrade to 4.2.5
I have upgraded the MongoDB replica set, which consists of 3 members, from 4.0.11 to 4.2.5.
After upgrading, startup lasts about 5 minutes.
Before upgrading it was instant.
It is related to ...
1
vote
1answer
19 views
Speed up AWS PostgreSQL insertion via Python script
I have 120,000 csv inside my AWS EC2 instance, each containing 120,000 rows. I can't insert each of them as is into my AWS RDS postgresql DB, that will be 120,000^2 = 14,400,000,000 records. Each csv ...
1
vote
0answers
62 views
AWS RDS responds with (Got an error reading communication packets). Works locally
I've been on this issue for a couple of days now, I will cover things I've tried at the end. So I'm running a NodeJS server from a GitHub repo using netlify-lamda. I am connecting to an Amazon RDS (...
0
votes
0answers
16 views
MYSQL query working fine in AWS RDS instances with 1 vCPU but hangs if running in instances with 2 vCPU or more
I have this following SQL query below executed in a Lambda function. The Lambda function connected to AWS RDS running MySQL 5.7.22.
When this query is executed against an instance type db.t2.small ...
0
votes
1answer
22 views
Error when restoring Postgres Database on RDS
I am following this to restore an externally backed up Postgres DB onto my RDS instance - https://docs.aws.amazon.com/AmazonRDS/latest/UserGuide/PostgreSQL.Procedural.Importing.html
However, when I ...
0
votes
0answers
12 views
Redash metadata DB migrate
I am using Redash v5.0.0 and PostgreSQL for metadata in an EC2 instance. I can create Redash v8.x container on ECS and PostgreSQL on RDS, however how can I migrate metadata in EC2 for Redash v5 to RDS ...
0
votes
0answers
13 views
Error while doing the AWS Community-AMI installation of MariaDB ColumnStore 1.1.3
On AWS I've used a CentOS based community AMI for mariadb-columnstore-1.1.3. I've created 1 UM (User Module) and 3 PMs (Performance Module viz PM1, PM2 and PM3) spot instances and assigned ...
0
votes
2answers
42 views
PostgreSQL slow query log entries contain no query details, only duration
I have a PostgreSQL RDS instance hosted in AWS. I have set the log_min_duration_statement setting to 1 second. When checking my log for slow queries I found the following six entries which don't ...
0
votes
0answers
11 views
Correct inbound rules for PostgreSQl on RDS and EBS instance
I'm very new to AWS and its security policies. I've two similar projects which contain a postgreSQl database on RDS and an EC2 instance of node js each. The problem is every now and then the PGadmin(...
0
votes
0answers
29 views
Moving SyBase to AWS Database as a Service
We have several existing Sybase ASE and IQ v16 installation on-premise that are not accessible via the internet. These databases have stored procedures.
What's the best way to migrate these databases ...
0
votes
1answer
150 views
I get this error: 8/40 PLS-00364: loop index variable 'I' use is invalid
When I execute this stored procedure:
create or replace procedure "delete-archive"
is
begin
for i in (select * from table(RDSADMIN.RDS_FILE_UTIL.LISTDIR('DATA_PUMP_DIR'))
where FILENAME like '...
0
votes
1answer
31 views
Add AWS EC2 instance to existing Availability Group
I currently have an AG with 2 replicas both running SQL Server 2016. These are both located on premise. I was looking to add a third node using a AWS EC2 instance and asynchronous replication.
...
0
votes
0answers
14 views
Error Creating File DSN for MS SQL on AWS
I have a contained MS SQL database on Amazon AWS and it has contained users. Using SSMS, I can connect to the contained database by using the contained user's credentials.
I'm trying to create a ...
0
votes
1answer
18 views
Is it possible to spin up a free development / test instance of an AWS Redshift server to run test queries on?
I have a traditional MS SQL Server background and am interested in looking into AWS Redshift. Microsoft offers a free download of their development version installer of SQL Server, and I was wondering ...
0
votes
0answers
98 views
AWS DocumentDB vs MongoDB performance issue
I am helping to support a Node.js application which uses MongoDB on an EC2 instance as the back end. The database is about 14 GB and the largest table has a little over 15 million documents.
To test, ...
0
votes
0answers
261 views
Access or modify tnsnames.ora on AWS Oracle RDS
I have an Oracle RDS instance running on AWS and I need to access the tnsnames.ora file and check its configuration since I am getting this error
Caused by: oracle.net.ns.NetException: Listener ...
0
votes
1answer
24 views
Prevent failure in conditional insert in mysql database
The infrastructure of our system looks like this.
An AWS lambda function receives requests such as (accountId, .....). It creates an entry in the MySQL database using a newly generated UUID as caseId....
0
votes
0answers
13 views
What can I do to diagnose where data inaccuracies in my ElasticSearch stack on AWS are coming from?
Context
I'm running an ElasticSearch stack on AWS. Data flows as follows:
Web client (user's browser)
AWS API endpoint
AWS Firehose
AWS Kinesis
AWS Lambda (transforms the data)
AWS ElasticSearch
My ...
1
vote
1answer
40 views
SQL Server linked server from on premises to SQL Server instance on Windows in Amazon EC2
I am trying to create a SQL Server linked server from on premises to SQL Server instance on Windows in Amazon EC2 (2 different domains) and getting:
Login timeout expired.
I am using sa account ...
1
vote
0answers
13 views
How to calcuate current IOPS consumed in AWS
We have a SQL Server hosted on AWS using EC2 and EBS. SQL Files are hosted on EBS. EBS vol type is GP2 and drive IOPS is 480.
At an instance of time Write Througput in AWS is showing is 725 and Read ...
0
votes
1answer
78 views
How the transaction logs are maintained in MSSQL RDS?
Just curious, I was asked that if RDS takes transactional log / incremental log backup for point in time recovery, does RDS shrink the logs too?
In MSSQL instance, we shrink logs if transactional ...
0
votes
0answers
168 views
SSHtunnelForwarder to Linux Box, then connect to Postgres RDS (AWS)
I'm trying to write a python script to update DDL in a Aurora RDS (postgres) on AWS. In Order to do this, I need to SSHTunnel to a linux box that sits at the edge of the VPC, then do another jump to ...
1
vote
1answer
83 views
What does RRQMS and WRQMS mean?
I found a possiblity to display Rrqms and Wrqms graphs in AWS RDS Enhanced monitoring page (I use Postgres 9.5.19) but I can't find any detailed explenation about these parameters.
By googling I only ...
2
votes
1answer
347 views
Linked Server: An error occurred during decryption
We're running a SQL Server instance on AWS RDS. I believe this is a 2017 instance. We also have a couple of Linux EC2 instances running SQL Server (not sure the version, but I assume 2017)
Our RDS ...
0
votes
1answer
288 views
Script to install Oracle client 12c2 on Redhat linux 7.5
Can someone help me to provide a script which I can use to install the Oracle client as part of the server build or AMI. Below script I was able to pull out from the guide in the Oracle site. But ...
0
votes
0answers
116 views
Migrate cluster Aurora RDS postgres from 9.X to 10 without downtime
Ok, this question is to find some strategy or tool that helps me to migrate from cluster Aurora RDS postgres from 9.6 to 10 without downtime.
What I find until now
Aurora RDS is allowed to do major ...
3
votes
3answers
200 views
RDS MySQL 8.0.16 has empty “INFORMATION_SCHEMA.ST_SPATIAL_REFERENCE_SYSTEMS” table
On aws RDS I have an mysql 8.0.16 instance running.
My problem is now, that the INFORMATION_SCHEMA.ST_SPATIAL_REFERENCE_SYSTEMS table is empty.
This is a problem for me because I would like to create ...
-2
votes
1answer
21 views
Estimating aws postgres delete activity rate
I have a table organized by date. Of the 84M rows, 26M all hit on one date. I want to delete that date.
There is an index on the date field.
I started a delete from <table> where <...
0
votes
0answers
26 views
Does AWS DocumentDB automatically scale down disk space?
I have swapped to DocumentDB from MongoDB so I don't need to manage my DB and it's nicely in the AWS stack.
I have recently done some load testing creating a DB of 180GB, now my DB is back down to ...
1
vote
1answer
19 views
Data Pipeline load bulk tables in one time
I am using AWS Data Pipeline for copying my RDS MySQL Database to Redshift. I need to create separate pipeline for each table and each pipeline create new EC2 instance. (Process takes time).
Problem
...
0
votes
0answers
184 views
ElasticSearch Node Failure or Shard Failure?
My Elasticsearch cluster dropped from 2B documents to 900M Records, on AWS it shows
Relocating shards: 4
Whilst Showing
Active Shards: 35
and
Active primary shards: 34
(Might not be ...
0
votes
1answer
66 views
AWS RDS: How do I diagnose this failure?
I have a simple RDS setup: one database, no replication. It has been running for around 2 years without any problems. CPU usage is generally less than 5%, sometimes boosting to around 10%.
Today, ...
1
vote
0answers
74 views
How to connect mongodb from aws ec2 ubuntu docker containers?
I have tried
mongosqld --addr localhost:3002 --mongo-uri xxxxx.com:27017
But it is throwing the following error:
unable to load MongoDB information:
failed to create admin session for ...
0
votes
1answer
335 views
Number of Worker threads available in PostgreSQL
In SQL Server we can have many worker threads per CPU core. Does anyone know if the same is true in PostgreSQL and can point me at a reference? (assume version 11).
The background is that we have ...
1
vote
0answers
20 views
Which FLUSH command before taking EBS volume snapshot?
The FLUSH TABLES WITH... command has a few flavors. The manual meagerly describes the differences between:
FLUSH TABLES WITH READ LOCK
FLUSH TABLES WITH READ LOCK AND DISABLE CHECKPOINT
FLUSH TABLES ....
0
votes
0answers
25 views
High constant CPU on Aurora/RDS
I've noticed recently that our resting CPU on our Aurora RDS cluster appears to be about 80%. I'm unsure when this started, as we don't have alarms/metrics in place (something I plan to rectify now).
...
1
vote
0answers
75 views
AWS RDS Multi A-Z vs DigitalOcean Managed Databases
I am currently hosting my database inside a t2.large instance on AWS EC2 which provides 8GB RAM and 2 CPUs. I am now looking for better options which are more scalable and provides features like ...
