Questions tagged [aws]
Amazon Web Services.
325
questions
0
votes
0answers
7 views
Connecting to postgres via ODBC from AWS Oracle RDS
I would like to connect a 12.1 Oracle RDS AWS instance to a Postgres database (also running at AWS but hosted on an EC2 instance).
There are a number of examples of how you could do this (eg
https://...
0
votes
0answers
5 views
How to run/host gradle java application with aws lambda? [migrated]
Currently I have one gradle java project which is a service that querying another service to export some data in xml file format, I need this exporter to generate xml files and upload to a ftp server ...
0
votes
1answer
31 views
Amazon RDS Ola Hallengren
Very new to SQL on AWS RDS so.
Need to create maintenance jobs on an AWS RDS SQL2016 instance. I know parts of Ola Hallengren's life saver maintenance script works, Index, stats and integrity.
...
0
votes
1answer
13 views
Detecting Logical Replication Error on Postgres v10 on AWS RDS CloudWatch metrics
https://www.postgresql.org/docs/10/logical-replication-restrictions.html
States:
"When the schema is changed on the publisher and replicated data starts arriving at the subscriber but does not fit ...
0
votes
0answers
16 views
Unable to install AWQ RDS sample db on sql server [closed]
PS C:\WINDOWS\system32> set-location C:\sampledb\v1
PS C:\sampledb\v1> sqlcmd -i .\install-onprem.sql
Sqlcmd: Error: Microsoft ODBC Driver 17 for SQL Server : Named Pipes
Provider: Could not ...
1
vote
2answers
16 views
GRANT permission ON database TO user not working on AWS
I'm having trouble granting a user permission on AWS.
mysql> GRANT CREATE ON *.* TO 'hmrex_db'@'%';
Query OK, 0 rows affected (0.01 sec)
mysql> SHOW GRANTS FOR 'hmrex_db'@'%';
+----------------...
0
votes
2answers
29 views
What is the best way to upload custom-parsed data into AWS Aurora PostgreSQL
I have a large (5-10 GB) binary file on AWS S3 that will require custom parsing, probably in python. It is essentially a sequential set of millions of dataframes, all having the same structure. What ...
2
votes
1answer
20 views
AWS aurora (postgres) proper value for the shared_buffers parameter
I think it's fairly well known that a normal PostgreSQL database has a starting value of 25% of system memory for its shared_buffers parameter, but I haven't been able to find anything regarding a ...
0
votes
0answers
30 views
AWS aurora mysql is restarted unexpectedly
In our system
one of aurora mysql instances was't available for short period.
because this instance suddenly restarted at 08/14/2019 3:56JST.
we already checked error log for aurora.
but i found ...
0
votes
0answers
7 views
AWS Redshift Workload Management
I am planning an AWS Redshift (RS) data warehouse and expect to have mix of longer-term jobs (60%) and short-term jobs (40%). The plan is to use workload management (WLM) and create multiple queues to ...
0
votes
2answers
37 views
MongoDB Replica Set InitialSyncOplogSourceMissing error
I am setting up a 3 nodes MongoDB replica set with one node in AWS using Mongo 3.6.12. There are about 400GB data need to sync to secondary nodes. Initial sync starts fine. However, after data sync ...
0
votes
0answers
14 views
Do not replicate Delete operations AWS DMS
I am using AWS DMS to replicate ongoing changes with SQL Server as a source and target endpoint. The tasks are running and replicating data with low latency. However, I need the tasks configured not ...
0
votes
0answers
4 views
How to restore data in aws rds without snapshot
Suppose I have snapshot at 9 AM and the data crashes at 3 PM and I want the data till 2:55 pm. How to restore data till 2:55 PM. Is there any method .if so how to do that.
1
vote
1answer
64 views
AWS Aurora MySQL Serverless CPU utilization is growing for unknown reason
We have been using Aurora serverless databases in staging and production environments for a few months now, and find the CPU remains in the range 15-20% almost all the time. However in the past week ...
0
votes
0answers
17 views
Partition Alignment in AWS SSD EBS
I'm setting up a new SQL Server 2008 r2 in AWS with IO1 SSD EBS volumes. My smaller EBS volumes are aligned correctly when they were formatted but the larger volumes, 3TB, are not because they used ...
0
votes
0answers
28 views
AWS RDS mysql deadlock
Everything in our production environment was working well. Yesterday, suddenly out of no where we were getting "lock wait" on any transaction related to a specific row. Same transaction on another row ...
0
votes
0answers
8 views
How to find the master instance of a read replica in AWS RDS PostgreSQL?
I have an RDS Postgres instance whose role is Replica. I do not see the master in the same region and probably is in another region of the AWS account. How do I find the master for this replica?
...
1
vote
0answers
47 views
Win 2019 + SQL Server 2014 slowly locks up the server
We have a 2019 + 2014 sql server box that was running fine for a few days after we first stood it up on Ec2.
After a week I removed a temp drive (EBS) that we had initially used to load up the ...
0
votes
0answers
7 views
Elastic search data synchronization with different databases
We are using elastic search hosted in AWS for apps wide search in our organization. We had initially dumped our existing data using logstash.
However, we are struck at keeping the Elastic DB in sync ...
0
votes
0answers
12 views
Find an equivalent way to make “$setIsSubset” with AWS DocumentDB
I need to find another way to make this operation : "$setIsSubset" with AWS DocumentDB (MongoDB like).
I'm not an expert with the mongo request, but I need to convert this instruction for my ...
0
votes
0answers
3 views
Copying fields from first line item to header in MySQL (5.7 on Amazon)
We have a header table ("opportunities") and a line-item table ("opportunity_details"). Each header record has 7 fields of vendor information that get copied from the first (by record-ID) line-item ...
0
votes
0answers
17 views
How to switch MBR to GPT without losing any existed data originally in MBR, AWS Ubuntu EC2
I'm trying to extend my diskspace for my AWS EC2 Ubuntu instance, the partition I've started with is MBR and the maximum it can go is 2TB.
Currently the diskspace is full with important data, I need ...
2
votes
1answer
48 views
Redshift Spectrum CTE Union
I have a query with a CTE that uses a Spectrum table. When I try to union the CTE with itself:
WITH foo AS (
SELECT col1
FROM spectrum.bar
)
SELECT * FROM foo UNION ALL
SELECT * FROM foo;
I get ...
0
votes
0answers
13 views
SQL Server read-replica hosted on AWS with ephemeral storage
I have a temporary need (during transition from on-prem to AWS) to provide a high-performance SQL server instance for analytics.
I would like to purchase two SQL server enterprise instances. One ...
0
votes
1answer
9 views
Redshift is missing in target database list of AWS SCT Schema Convertion Tool
I want to convert schema of SQL Server database to Amazon Redshift using AWS SCT tool
But as target database, Redshift is not listed
When I use PostgreSQL compatible with IP address of the cluster, ...
0
votes
1answer
24 views
SQL Server license from AWS Marketplace with ? cores
We are planning to buy a SQL Server 2012 Enterprise edition license from AWS Marketplace for our company. We have exhausted our previous licenses and we need to add a new region with SQL Server in ...
0
votes
1answer
123 views
How to set the wal_level in AWS RDS Postgresql?
How do I know which wal_level my AWS RDS Postgres 11.1 database has?
I checked 'parameter groups', but was unable to find the wal_level.
Once found, how do I change it?
0
votes
0answers
59 views
Can SQL Developer be used with the Athena JDBC Driver
I'm trying to connect to Athena using the JDBC drivers provided by Amazon, and using SQL Developer as the client. So far, I haven't had any luck with Java 1.8.181 and AthenaJDBC42-2.0.7.jar Has anyone ...
0
votes
1answer
14 views
DATE_SUB with configurable value
In MySQL you can use the DATE_SUB function to get a new date based on the values passed in. For example I can use the following to get the a date of 30 days ago from when I run the function
SELECT ...
0
votes
2answers
172 views
AWS KMS Encryption enable for SQL Server Columns?
Is it possible MSSQL on EC2 with a key in AWS KMS to encrypt columns
4
votes
6answers
614 views
MySQL join has drastically worse performance after upgrading from 5.6 to 5.7
I have a fairly straightforward query that has become very slow after upgrading from MySQL 5.6.35 to MySQL 5.7.12 (running on AWS RDS).
SELECT DISTINCT
Name,d.id,deviceType,issuedBy, description,...
4
votes
1answer
78 views
Is there a way to improve performance of this simple SELECT query?
I'm still relatively new to MySQL so please forgive any ignorance on my part. I've tried looking through other posts on here and StackExchange, but haven't had much luck in improving the performance ...
0
votes
1answer
26 views
“Pausing” log shipping to allow normal DB use. Is this process valid?
I am in the process of migrating a server to AWS. Right now it is just for Dev/QA work, but will eventually be turned into our production server. It is a 2 node AG. Server is all up and running, ...
1
vote
1answer
58 views
Is compression used in RDS SQLServer database
I have few Clarification regarding AWS RDS SQL Server.
Do we have any compression technique to compress the data loaded into RDS SQL server?
Is there any option or parameter to compress the data and ...
2
votes
1answer
26 views
AWS DMS - How to select different databases for source and target points for a task
Does aws DMS(Data Migration service) allow to select different databases for source and target points for a task in a replication instance? My source engine is MySQL.
example: I want to move table A ...
1
vote
1answer
113 views
Recommended postgres parameters for index creation with 244gb RAM and 32 CPUs?
I have a 200 GB database with 26 tables that I need to create indexes on.
Currently index creation takes a long time on the biggest tables, as they have ~12gb and 400,000,000 rows in them (>4 hours)....
0
votes
1answer
146 views
AWS Aurora MySQL Serverless CPU utilisation is above 10 even it is not processing any requests
We have Aurora MySQL serverless DB with 2 capacity units. I didn't understand why the CPU utilisation is always above 10 even when it not processing any queries. As a result we are paying more bills ...
1
vote
0answers
155 views
Predicting AWS RDS MySQL Instance Performance
I have a small MySQL db running on AWS RDS t2.small instance.
So far, the CPU usage has been very predictable based on the traffic from my app.
Example:
1000 concurrent users = 15% CPU
2000 ...
0
votes
0answers
28 views
Configure Availability Group in SQL Server 2016
Can you tell me how you add the second node as the replica to the AG?
I am using this feature on AWS instances, I have followed all the steps as shown in different videos, but when I try to add the ...
1
vote
1answer
396 views
connecting to mongodb on ec2 instance using the private IP address
Im trying to connect to my MongoDB that is on my EC2 instance. I am able to connect to using the public dns with this statement:
mongoClient = new
MongoClient("ec2-3-92-197-163.compute-1....
0
votes
0answers
8 views
AWS MySQL remote Connection
I am attempting to connect to a mySQL database that is not on AWS from a client that is. The AWS EC2 instance has an elastic IP and that IP has been white listed, but I continue to get an access ...
0
votes
0answers
120 views
Full backup job failed after changing backup location
In AG Environment, for the last 30 days, the daily Full backup job is failing for a few of the larger databases. The rest of the databases are getting through daily so far. We recently changed the ...
0
votes
1answer
49 views
Find queries causing a lot of read IO
I'm trying to find the cause of a higher amount of VolumeReadIOPs in our Aurora Postgres instance on AWS. This is what the past 6 weeks look like:
I found the cause of the largest period (02/27 to 03/...
0
votes
0answers
212 views
Load From S3 MySQL Error Code 2013 — AWS Aurora
I am attempting to load S3 files to an Aurora MySQL DB Cluster using the below AWS documentation:
https://docs.aws.amazon.com/AmazonRDS/latest/AuroraUserGuide/AuroraMySQL.Integrating.LoadFromS3.html
...
0
votes
1answer
528 views
Mysql Alter table add column with ALGORITHM=INPLACE, LOCK=NONE
Am running below query
Query
Alter table dbname.tablename
add column column1 varchar(50),
add column column2 text ,
ALGORITHM=INPLACE, LOCK=NONE;
It takes more time to execute.
Ideally running ...
2
votes
0answers
37 views
AWS RDS PostgreSQL: Significant query runtime difference between two (identical?) instances
TL;DR: Solution
The problem was that one instance hat magnetic storage attached and was therefore significantly slower.
Original Question
I have two identical AWS RDS PostgreSQL 10.6 databases ...
2
votes
0answers
129 views
Aggressive Tempdb spill process
We are having an issue with aggressive tempdb spills that significantly effect overall server performance and, in rare cases, cause AlwaysOn failures.
Tested on SQL2016 and SQL2017 Enterprise (recent ...
2
votes
2answers
123 views
MySQL hitting IOPS wall in AWS, not able to utilize full volume IOPS level
We are scaling up an existing MySQL 5.6.41 (with Galera) based system running in AWS on EC2, and are hitting a wall in performance, which we believe is narrowed down to storage IOPS.
Please note for ...
1
vote
0answers
39 views
AWS RDS SQL Server Native Backups
We have some AWS RDS SQL Server instances that we are setting up. Some of these will be Multi-AZ for HADR.
We know that RDS will take system level backups and snapshots. We are wanting to perform ...
0
votes
1answer
94 views
How to install keyring_aws plugin in MySQL?
I am looking for a way to install keyring_aws plugin in mysql community edition.
Is it possible?
I gone through couple of docs,
https://dev.mysql.com/doc/refman/5.7/en/keyring-aws-plugin.html
...
