Stack Exchange Network

Stack Exchange network consists of 175 Q&A communities including Stack Overflow, the largest, most trusted online community for developers to learn, share their knowledge, and build their careers.

Visit Stack Exchange

Questions tagged [aws]

Amazon Web Services.

0
votes
1answer
31 views

Mysql Alter table add column with ALGORITHM=INPLACE, LOCK=NONE

Am running below query Query Alter table dbname.tablename add column column1 varchar(50), add column column2 text , ALGORITHM=INPLACE, LOCK=NONE; It takes more time to execute. Ideally running ...
2
votes
0answers
22 views

AWS RDS PostgreSQL: Significant query runtime difference between two (identical?) instances

TL;DR: Solution The problem was that one instance hat magnetic storage attached and was therefore significantly slower. Original Question I have two identical AWS RDS PostgreSQL 10.6 databases ...
2
votes
0answers
78 views

Aggressive Tempdb spill process

We are having an issue with aggressive tempdb spills that significantly effect overall server performance and, in rare cases, cause AlwaysOn failures. Tested on SQL2016 and SQL2017 Enterprise (recent ...
1
vote
2answers
46 views

MySQL hitting IOPS wall in AWS, not able to utilize full volume IOPS level

We are scaling up an existing MySQL 5.6.41 (with Galera) based system running in AWS on EC2, and are hitting a wall in performance, which we believe is narrowed down to storage IOPS. Please note for ...
1
vote
0answers
23 views

AWS RDS SQL Server Native Backups

We have some AWS RDS SQL Server instances that we are setting up. Some of these will be Multi-AZ for HADR. We know that RDS will take system level backups and snapshots. We are wanting to perform ...
0
votes
1answer
18 views

How to install keyring_aws plugin in MySQL?

I am looking for a way to install keyring_aws plugin in mysql community edition. Is it possible? I gone through couple of docs, https://dev.mysql.com/doc/refman/5.7/en/keyring-aws-plugin.html ...
0
votes
1answer
39 views

Oracle AWS RDS supermaster user cant grant select on some tables

I'm dealing with some sort of issue beyond my Oracle knowledge. A customer wants to execute some queries to detect issues, locks, etc in a Oracle RDS database. I assume this queries needs database ...
0
votes
1answer
28 views

Heartbeat frequency in AWS DMS (Database Migration Service)?

Within "PostgreSQL Source WAL Heartbeat https://docs.aws.amazon.com/dms/latest/userguide/CHAP_ReleaseNotes.html#CHAP_ReleaseNotes.DMS230", what does heartbeat frequency represents? The AWS docs doesn'...
0
votes
1answer
17 views

Slow execution with MariaDB

Not sure if this can be done without UNION. I think it is the UNION which makes it slow. The two parts are quite fast on their own, but combined with the UNION this code takes > 5 seconds to complete. ...
0
votes
1answer
52 views

How to alter system on AWS RDS?

I need to run ALTER SYSTEM SET track_activity_query_size = 16384; So I can see the contents of some long running queries (I can only see the beginning at the default size), but when I try to do ...
0
votes
0answers
11 views

AWS DMS attribute-type list into DynamoDB?

I'm trying to use AWS DMS (Database Migration Service) to load data from a .csv file stored into S3 to AWS DynamoDB. One of the columns (the last one) in the csv file is a list. Sample data: ...
0
votes
0answers
13 views

Redshift: information_schema.columns table takes long time to respond

The information_schema.columns table takes a long time to return results. Is this something a database performance issue. The bad thing is the query doesn't appear in the AWS console. Any ...
0
votes
1answer
32 views

Schema replication Postgresql AWS

Is there a way to replicate Postgres Schemas in AWS into one location for reporting purposes? I have 3 postgres databases (up to date with current version) running in AWS that I would like to ...
1
vote
0answers
44 views

A transport-level error has occurred when receiving results from the server [duplicate]

Our application is made from asp.net webforms using framework 4.5. And since migrating to Amazon AWS from an inhouse server. We've been flooded by this error through out our system. On the software ...
-1
votes
1answer
22 views

The fastest way to Copy Schema or Table in MySQL DB

I have a schema (size 500 GB) in my MySQL DB and I want to make a copy of this schema to another schema in the same DB. May I ask what is the fastest way of copying all the tables in that schema? (I ...
0
votes
1answer
14 views

MySQL eats up all the memory from the RHEL OS

Currently, I have MySQL server installed in the AWS RHEL EC2 instance. The team was running heavy data processing in the DB and we found out that every now and then the DB restarted itself. After ...
0
votes
0answers
15 views

Integrating MongoDB metrices with Cloud watch

We are hosting mongodb in AWS environment and planning to create incident in Servicenow using AWS Cloud watch alarm facility Has anyone integrated MongoDB Monitoring metrices with Cloud watch to ...
1
vote
1answer
40 views

PostgreSQL Materialized View not refreshing

I'm using PostgreSQL in DBeaver and querying data from AWS. ana.bookings is a materialized view and it shows only the data up to 26th November 2018 even though all the tables and views prior to it ...
1
vote
0answers
30 views

How to backup a local database to cloud database?

I am about to start developing a POS software as my new project with python and electron js. It is going to be a desktop application. However, my concern is it should work in both cases when desktop ...
1
vote
0answers
37 views

Best Distkey and Sortkey for the tables in Redshift

I have the following tables: orders: id => primary key customer_id => store_id => order_date => datetime order_items: id => primary key order_id => FK The query I usually run ...
0
votes
1answer
132 views

Change in bind_ip value is not reflecting

I have mongo installed on Centos instance in AWS and I am connecting to the mongoDB server from my system. To connect from remote system we need to change bind_ip value to 0.0.0.0 in /etc/mongod.conf ...
1
vote
2answers
45 views

How do you know when it's time to upgrade a RDBMS/SQL database infrastructure? What metrics to follow? [closed]

In my specific case, I have just deployed my side project to AWS and using AWS MySQL Tier 2 Micro instance, which is within AWS' Free Tier; https://aws.amazon.com/ec2/instance-types/t2/ It has: 20 ...
1
vote
1answer
125 views

What database to choose for 1TB of time series? [closed]

I'm saving about 3GB per day of financial orderbook data to a database (currently Mysql). In the coming weeks, I'm going to save trade and quote (bids/asks) data too. Data is structured, but I'm ...
0
votes
1answer
48 views

What's your data ETL methodology? [closed]

I think this is more like an open question: How do you do the ETL for your company? We are using MySQL as our database management system and we have a production schema. Every month, when we received ...
0
votes
1answer
28 views

Master slave replication with different mysql version is on both slave and master

Currently, we have MySQL master-slave replication. Both master and slave servers have Mysql 5.5 Currently I need to add one more Master server having version 5.7. Is it possible to add Multiple ...
1
vote
1answer
58 views

MongoDB deployment across cloud and On Premises

We are planning to implement MongoDB as a stretch cluster which includes Primary secondary in DC 1, Secondary secondary in DC 2, Arbiter in cloud(DC 3) where DC 1 and DC 2 are on premise servers and ...
2
votes
1answer
753 views

Best way to pg_dump PostgreSQL on RDS to S3

I need to dump my PostgreSQL on RDS to a file on S3 periodically (to use it elsewhere than AWS). Is there a better way than running a script that runs pg_dump and uploads results to S3 using e.g. ...
1
vote
1answer
62 views

Recommended innodb_file_per_table value for AWS MySQL RDS database

We have the following scenario: Our databases are hosted on AWS MySQL 5.6, and we are planning the following migration: we currently have 10 distinct instances with about 50 databases split between ...
1
vote
1answer
200 views

What is the optimal setting for innodb_buffer_pool_instances for a mid level AWS RDS server with 6gb buffer pool?

We have a MySQL 5.7 AWS RDS instance running on a db.m4.large instance. The basic resources for that instance type are: 7.5gb RAM 2 VCPU RDS defaults to a calculation that allocates 75% of RAM to ...
0
votes
1answer
30 views

Cannot Create or Drop User in MySQL Workbench

OK. I have set up a new MySQL Server in AWS Ubuntu EC2 and migrate databases from the RDS. After importing the tables, stored procedures and functions into the new server, I encountered the attached ...
2
votes
1answer
424 views

Cannot remotely access PostgreSQL on EC2 instance

I was unable to access a remote AWS postgres database via things like psql -h *EC2ExternalIP* -U *me*. I would get: psql -h *EC2ExternalIP* -U *me* psql: could not connect to server: Operation timed ...
1
vote
1answer
21 views

Backup weekly current production db to Historical db server [closed]

I have a production sql db of 600gb and a historical server where i move the full db every month. Now we want to have only the last 3 months information on the production server, and move every week ...
1
vote
0answers
112 views

AWS RDS PostgreSQL - Managing Permissions

Relatively new to AWS RDS PostgreSQL environment. We are creating a database with multiple schemas. Users are grouped by "schema_role" that have privileges to create objects in assigned schemas. My ...
0
votes
2answers
159 views

Redshift table level security

I have a common scenario where I need to drop and create an Amazon Redshift table or view (more often with views). There are situations where an ALTER is not going to work, which would preserve ...
2
votes
1answer
411 views

PostgreSQL - can I use logical replication from a replica's WAL?

I would like to use logical replication. However, as PostgreSQL works now, it can eat up the whole disk and then block the database. Especially in Amazon Web Services RDS, this is a problem because ...
1
vote
0answers
59 views

Domain Independent Cluster on AWS

I am trying to work out whether it's possible to create a Domain Independent Workgroup Cluster in AWS (on Windows Server 2016 for use with SQL 2017 Availability Groups). This environment also has no ...
0
votes
1answer
30 views

One SQL Server RDS instance plus one Ubuntu instance cost money on my initial free trial year [closed]

Why do I get charged when I only have one micro instance running as Ubuntu and another one a RDS. Does the extra RDS count as a separate instance? My RDS is Microsoft SQL Server exchange which should ...
2
votes
1answer
137 views

Replication from Amazon's RDS to Postgres via DMS errors out

I have a transactional replication from SQL Server 2008 to RDS SQL Server 2016 in 2014 compatibility mode. This works okay. I now want to replicate this RDS database via DMS to Postgresql. This errors ...
1
vote
1answer
297 views

How to install cstore_fdw inside RDS postgres 9.6

cstore_fdw is foreign data wrapper for columnar storage for postgresql. I want to install it inside RDS postgre 9.6 instance. Is it possible to install inside RDS instance? Thanks
1
vote
1answer
108 views

Can PAGELATCH Waits cause increase in SOS_SCHEDULER_YIELD wait in SQL Server?

We have a high concurrency web server application on which we have some amount of PAGELATCH_UP & PAGELATCH_SH Waits due to tempdb contention. But recently we have noticed the SOS_SCHEDULER_YIELD ...
1
vote
1answer
146 views

I/O errors backing up to an SMB Share from MSSQL Server 2014

I'm having some issues with SQL backups which are being written to an SMB share on a AWS Storage Gateway Appliance from an EC2 SQL Server. I'm consistently getting the same error in the SQL Event log ...
0
votes
0answers
131 views

Wal-e : “ pg_stop_backup still waiting for all required WAL segments to be archived”

I've been trying to use wal-e to take incremental backup of my postgresql database by following this blog. I've a database on my postgresql and using an AWS S3 bucket. while I'm using the following ...
1
vote
1answer
193 views

Are read replicas heavy reading in affect masterDB?

We have a very heavy load in Read side with large DB tables in 2 hours per day that affect to Db so as solutions I have created read replica for it. If application fetches large heavy data on read ...
0
votes
0answers
21 views

Partially rotating MongoDB collection efficiency

I have a MongoDB collection with approximately 20M objects in it. Nightly, I am deleting (2 + incomplete portion) months of data and replacing them with an import from CSV that uses PyMongo 3.0....
0
votes
0answers
10 views

Amazon RDS for MySQL Backup

Amazon RDS for MySQL states the following: There is no additional charge for backup storage, up to 100% of your total database storage for a region. (Based upon our experience as database ...
1
vote
0answers
57 views

How to connect to a SQL Server from another computer using SSMS with only hostname?

I set up a VM server computer on AWS EC2 and got a SQL Express Server running on it on port 1433. I made sure to allow TCP/IP requests and allowed TCP port 1433 through the firewall along with UDP ...
1
vote
2answers
287 views

Significantly Slower DB Dumps on AWS RDS After Turning on Encryption?

Turning on encryption on an AWS RDS MySQL instance results in significantly slower database dumps (using mysqldump). mysqldump -u test -p -h xxx.aws.com > dump.sql Is there a reason for ...
0
votes
0answers
14 views

Database for storing frequency of access token usage

I would like to create a database to store how often access tokens in my system are being used. I was thinking of a data model like so - Access Token from (basically I will store this hourly, so ...
0
votes
1answer
218 views

Mongodb Cross-region failover replication aws

I have deployed 3 MongoDB nodes(node-1, node-2, node-3) in AWS. The first two nodes (node-1, node-2) are deployed in Virginia region and the third node(node-3) is deployed in Oregon region and enabled ...
1
vote
1answer
76 views

AWS VS Azure , which one is preferable for SQL Server 2012 standard version? [closed]

I want few recommendations while considering azure vs aws for our current database which is SQL Server 2012 standard edition. Currently we are using AWS RDS for managing our database, recently we had ...