Questions tagged [aws]
Amazon Web Services.
0
votes
1answer
18 views
SQL Server license from AWS Marketplace with ? cores
We are planning to buy a SQL Server 2012 Enterprise edition license from AWS Marketplace for our company. We have exhausted our previous licenses and we need to add a new region with SQL Server in ...
0
votes
0answers
18 views
How to set the wal_level in AWS RDS Postgresql?
How do I know which wal_level my AWS RDS Postgres 11.1 database has?
I checked 'parameter groups', but was unable to find the wal_level.
Once found, how do I change it?
0
votes
0answers
8 views
optimal (price) solution in aws for write-heavy read-infrequently key/value store? [on hold]
Apologies in advance if this question is too vague. Admins: feel free to delete if so.
Background:
Copious amounts of user activity data streamed to S3
File size ~32 MB
Record size ~1k; format = ...
0
votes
0answers
18 views
Can SQL Developer be used with the Athena JDBC Driver
I'm trying to connect to Athena using the JDBC drivers provided by Amazon, and using SQL Developer as the client. So far, I haven't had any luck with Java 1.8.181 and AthenaJDBC42-2.0.7.jar Has anyone ...
0
votes
1answer
9 views
DATE_SUB with configurable value
In MySQL you can use the DATE_SUB function to get a new date based on the values passed in. For example I can use the following to get the a date of 30 days ago from when I run the function
SELECT ...
0
votes
2answers
42 views
AWS KMS Encryption enable for SQL Server Columns?
Is it possible MSSQL on EC2 with a key in AWS KMS to encrypt columns
4
votes
6answers
227 views
MySQL join has drastically worse performance after upgrading from 5.6 to 5.7
I have a fairly straightforward query that has become very slow after upgrading from MySQL 5.6.35 to MySQL 5.7.12 (running on AWS RDS).
SELECT DISTINCT
Name,d.id,deviceType,issuedBy, description,...
4
votes
1answer
74 views
Is there a way to improve performance of this simple SELECT query?
I'm still relatively new to MySQL so please forgive any ignorance on my part. I've tried looking through other posts on here and StackExchange, but haven't had much luck in improving the performance ...
0
votes
1answer
25 views
“Pausing” log shipping to allow normal DB use. Is this process valid?
I am in the process of migrating a server to AWS. Right now it is just for Dev/QA work, but will eventually be turned into our production server. It is a 2 node AG. Server is all up and running, ...
1
vote
1answer
30 views
Is compression used in RDS SQLServer database
I have few Clarification regarding AWS RDS SQL Server.
Do we have any compression technique to compress the data loaded into RDS SQL server?
Is there any option or parameter to compress the data and ...
1
vote
0answers
14 views
AWS DMS - How to select different databases for source and target points for a task
Does aws DMS(Data Migration service) allow to select different databases for source and target points for a task in a replication instance? My source engine is MySQL.
example: I want to move table A ...
1
vote
1answer
38 views
Recommended postgres parameters for index creation with 244gb RAM and 32 CPUs?
I have a 200 GB database with 26 tables that I need to create indexes on.
Currently index creation takes a long time on the biggest tables, as they have ~12gb and 400,000,000 rows in them (>4 hours)....
0
votes
1answer
31 views
AWS Aurora MySQL Serverless CPU utilisation is above 10 even it is not processing any requests
We have Aurora MySQL serverless DB with 2 capacity units. I didn't understand why the CPU utilisation is always above 10 even when it not processing any queries. As a result we are paying more bills ...
1
vote
0answers
61 views
Predicting AWS RDS MySQL Instance Performance
I have a small MySQL db running on AWS RDS t2.small instance.
So far, the CPU usage has been very predictable based on the traffic from my app.
Example:
1000 concurrent users = 15% CPU
2000 ...
0
votes
0answers
28 views
Configure Availability Group in SQL Server 2016
Can you tell me how you add the second node as the replica to the AG?
I am using this feature on AWS instances, I have followed all the steps as shown in different videos, but when I try to add the ...
0
votes
1answer
72 views
connecting to mongodb on ec2 instance using the private IP address
Im trying to connect to my MongoDB that is on my EC2 instance. I am able to connect to using the public dns with this statement:
mongoClient = new
MongoClient("ec2-3-92-197-163.compute-1....
0
votes
0answers
5 views
AWS MySQL remote Connection
I am attempting to connect to a mySQL database that is not on AWS from a client that is. The AWS EC2 instance has an elastic IP and that IP has been white listed, but I continue to get an access ...
0
votes
0answers
64 views
Full backup job failed after changing backup location
In AG Environment, for the last 30 days, the daily Full backup job is failing for a few of the larger databases. The rest of the databases are getting through daily so far. We recently changed the ...
0
votes
1answer
26 views
Find queries causing a lot of read IO
I'm trying to find the cause of a higher amount of VolumeReadIOPs in our Aurora Postgres instance on AWS. This is what the past 6 weeks look like:
I found the cause of the largest period (02/27 to 03/...
0
votes
0answers
88 views
Load From S3 MySQL Error Code 2013 — AWS Aurora
I am attempting to load S3 files to an Aurora MySQL DB Cluster using the below AWS documentation:
https://docs.aws.amazon.com/AmazonRDS/latest/AuroraUserGuide/AuroraMySQL.Integrating.LoadFromS3.html
...
0
votes
1answer
186 views
Mysql Alter table add column with ALGORITHM=INPLACE, LOCK=NONE
Am running below query
Query
Alter table dbname.tablename
add column column1 varchar(50),
add column column2 text ,
ALGORITHM=INPLACE, LOCK=NONE;
It takes more time to execute.
Ideally running ...
2
votes
0answers
26 views
AWS RDS PostgreSQL: Significant query runtime difference between two (identical?) instances
TL;DR: Solution
The problem was that one instance hat magnetic storage attached and was therefore significantly slower.
Original Question
I have two identical AWS RDS PostgreSQL 10.6 databases ...
2
votes
0answers
97 views
Aggressive Tempdb spill process
We are having an issue with aggressive tempdb spills that significantly effect overall server performance and, in rare cases, cause AlwaysOn failures.
Tested on SQL2016 and SQL2017 Enterprise (recent ...
1
vote
2answers
61 views
MySQL hitting IOPS wall in AWS, not able to utilize full volume IOPS level
We are scaling up an existing MySQL 5.6.41 (with Galera) based system running in AWS on EC2, and are hitting a wall in performance, which we believe is narrowed down to storage IOPS.
Please note for ...
1
vote
0answers
31 views
AWS RDS SQL Server Native Backups
We have some AWS RDS SQL Server instances that we are setting up. Some of these will be Multi-AZ for HADR.
We know that RDS will take system level backups and snapshots. We are wanting to perform ...
0
votes
1answer
29 views
How to install keyring_aws plugin in MySQL?
I am looking for a way to install keyring_aws plugin in mysql community edition.
Is it possible?
I gone through couple of docs,
https://dev.mysql.com/doc/refman/5.7/en/keyring-aws-plugin.html
...
0
votes
1answer
142 views
Oracle AWS RDS supermaster user cant grant select on some tables
I'm dealing with some sort of issue beyond my Oracle knowledge. A customer wants to execute some queries to detect issues, locks, etc in a Oracle RDS database. I assume this queries needs database ...
0
votes
1answer
57 views
Heartbeat frequency in AWS DMS (Database Migration Service)?
Within "PostgreSQL Source WAL Heartbeat https://docs.aws.amazon.com/dms/latest/userguide/CHAP_ReleaseNotes.html#CHAP_ReleaseNotes.DMS230", what does heartbeat frequency represents? The AWS docs doesn'...
0
votes
1answer
19 views
Slow execution with MariaDB
Not sure if this can be done without UNION. I think it is the UNION which makes it slow. The two parts are quite fast on their own, but combined with the UNION this code takes > 5 seconds to complete. ...
1
vote
1answer
131 views
How to alter system on AWS RDS?
I need to run
ALTER SYSTEM SET track_activity_query_size = 16384;
So I can see the contents of some long running queries (I can only see the beginning at the default size), but when I try to do ...
0
votes
0answers
40 views
AWS DMS attribute-type list into DynamoDB?
I'm trying to use AWS DMS (Database Migration Service) to load data from a .csv file stored into S3 to AWS DynamoDB. One of the columns (the last one) in the csv file is a list. Sample data:
...
0
votes
0answers
33 views
Redshift: information_schema.columns table takes long time to respond
The information_schema.columns table takes a long time to return results. Is this something a database performance issue. The bad thing is the query doesn't appear in the AWS console.
Any ...
0
votes
1answer
69 views
Schema replication Postgresql AWS
Is there a way to replicate Postgres Schemas in AWS into one location for reporting purposes?
I have 3 postgres databases (up to date with current version) running in AWS that I would like to ...
1
vote
0answers
48 views
A transport-level error has occurred when receiving results from the server [duplicate]
Our application is made from asp.net webforms using framework 4.5. And since migrating to Amazon AWS from an inhouse server. We've been flooded by this error through out our system.
On the software ...
-1
votes
1answer
24 views
The fastest way to Copy Schema or Table in MySQL DB
I have a schema (size 500 GB) in my MySQL DB and I want to make a copy of this schema to another schema in the same DB.
May I ask what is the fastest way of copying all the tables in that schema?
(I ...
0
votes
1answer
18 views
MySQL eats up all the memory from the RHEL OS
Currently, I have MySQL server installed in the AWS RHEL EC2 instance.
The team was running heavy data processing in the DB and we found out that every now and then the DB restarted itself. After ...
0
votes
1answer
61 views
Integrating MongoDB metrices with Cloud watch
We are hosting mongodb in AWS environment and planning to create incident in Servicenow using AWS Cloud watch alarm facility
Has anyone integrated MongoDB Monitoring metrices with Cloud watch to ...
1
vote
1answer
93 views
PostgreSQL Materialized View not refreshing
I'm using PostgreSQL in DBeaver and querying data from AWS.
ana.bookings is a materialized view and it shows only the data up to 26th November 2018 even though all the tables and views prior to it ...
1
vote
0answers
31 views
How to backup a local database to cloud database?
I am about to start developing a POS software as my new project with python and electron js. It is going to be a desktop application.
However, my concern is it should work in both cases when desktop ...
1
vote
0answers
49 views
Best Distkey and Sortkey for the tables in Redshift
I have the following tables:
orders:
id => primary key
customer_id =>
store_id =>
order_date => datetime
order_items:
id => primary key
order_id => FK
The query I usually run ...
0
votes
1answer
339 views
Change in bind_ip value is not reflecting
I have mongo installed on Centos instance in AWS and I am connecting to the mongoDB server from my system. To connect from remote system we need to change bind_ip value to 0.0.0.0 in /etc/mongod.conf ...
1
vote
2answers
45 views
How do you know when it's time to upgrade a RDBMS/SQL database infrastructure? What metrics to follow? [closed]
In my specific case, I have just deployed my side project to AWS and using AWS MySQL Tier 2 Micro instance, which is within AWS' Free Tier;
https://aws.amazon.com/ec2/instance-types/t2/
It has: 20 ...
1
vote
1answer
177 views
What database to choose for 1TB of time series? [closed]
I'm saving about 3GB per day of financial orderbook data to a database (currently Mysql). In the coming weeks, I'm going to save trade and quote (bids/asks) data too.
Data is structured, but I'm ...
0
votes
1answer
54 views
What's your data ETL methodology? [closed]
I think this is more like an open question: How do you do the ETL for your company?
We are using MySQL as our database management system and we have a production schema. Every month, when we received ...
0
votes
1answer
36 views
Master slave replication with different mysql version is on both slave and master
Currently, we have MySQL master-slave replication. Both master and slave servers have Mysql 5.5 Currently I need to add one more Master server having version 5.7.
Is it possible to add Multiple ...
1
vote
1answer
79 views
MongoDB deployment across cloud and On Premises
We are planning to implement MongoDB as a stretch cluster which includes Primary secondary in DC 1, Secondary secondary in DC 2, Arbiter in cloud(DC 3) where DC 1 and DC 2 are on premise servers and ...
2
votes
1answer
2k views
Best way to pg_dump PostgreSQL on RDS to S3
I need to dump my PostgreSQL on RDS to a file on S3 periodically (to use it elsewhere than AWS).
Is there a better way than running a script that runs pg_dump and uploads results to S3 using e.g. ...
1
vote
1answer
112 views
Recommended innodb_file_per_table value for AWS MySQL RDS database
We have the following scenario: Our databases are hosted on AWS MySQL 5.6, and we are planning the following migration: we currently have 10 distinct instances with about 50 databases split between ...
1
vote
1answer
320 views
What is the optimal setting for innodb_buffer_pool_instances for a mid level AWS RDS server with 6gb buffer pool?
We have a MySQL 5.7 AWS RDS instance running on a db.m4.large instance. The basic resources for that instance type are:
7.5gb RAM
2 VCPU
RDS defaults to a calculation that allocates 75% of RAM to ...
0
votes
1answer
34 views
Cannot Create or Drop User in MySQL Workbench
OK. I have set up a new MySQL Server in AWS Ubuntu EC2 and migrate databases from the RDS. After importing the tables, stored procedures and functions into the new server, I encountered the attached ...
