Skip to main content

Questions tagged [aws]

Amazon Web Services.

Filter by
Sorted by
Tagged with
26 votes
1 answer
42k views

Multiple databases in same AWS RDS PostgreSQL instance

I have an existing database in a RDS AWS PostgreSQL instance. I need to create one more database in this instance as spinning up a separate cluster will be expensive. There doesn't seem to be any ...
Pravs_thedataguy's user avatar
16 votes
2 answers
20k views

How to set the wal_level in AWS RDS Postgresql?

How do I know which wal_level my AWS RDS Postgres 11.1 database has? I checked 'parameter groups', but was unable to find the wal_level. Once found, how do I change it?
Hauke's user avatar
  • 263
15 votes
1 answer
24k views

Best way to pg_dump PostgreSQL on RDS to S3

I need to dump my PostgreSQL on RDS to a file on S3 periodically (to use it elsewhere than AWS). Is there a better way than running a script that runs pg_dump and uploads results to S3 using e.g. ...
pmichna's user avatar
  • 313
15 votes
2 answers
12k views

Why use RDS over EC2 for Postgres?

I have a database currently running on EC2. As I have to move it to a bigger machine the question of using RDS came up. Pricing: I can get an EC2 c3.large instance with two SSDs (16GB each), two ...
kev's user avatar
  • 397
15 votes
1 answer
58k views

PostgreSQL: SSL SYSCALL error: EOF detected

First, I've searched for and found several posts relating to this error, and most of them point either to a RAM issue or an SSL issue, I tried overcoming the SSL possibility by adding the sslmode=...
Gonzalo Vasquez's user avatar
12 votes
2 answers
5k views

Does AWS RDS support MEMORY storage engine?

Title says it all. Strangely can't find a result on this.
Marc L.'s user avatar
  • 223
9 votes
1 answer
12k views

Replication Lag on Postgres AWS RDS Service

We have a single master/single streaming replica Postgres 9.3 db on AWS. The load is not terribly high - this is a development/staging environment. (The production shows similar metrics). Point is the ...
MJB's user avatar
  • 191
9 votes
1 answer
3k views

Why does RDS PostgreSQL always recover on restart?

I am running an RDS instance of PostgreSQL 9.6.3: select version(); returns PostgreSQL 9.6.3 on x86_64-pc-linux-gnu [...]. I have found that after issuing a stop from the RDS console followed by a ...
Christopher Lewis's user avatar
9 votes
3 answers
9k views

How to configure replication from PostgreSQL (RDS) to vanilla PostgreSQL?

I have an Amazon RDS Postgres DB and I created a "replicator" user and granted it the "replication" privilege. db=> create role replicator login password 'something'; CREATE ROLE db=> alter ...
Evan's user avatar
  • 199
8 votes
2 answers
6k views

AWS RDS - Changing Instance Class

So I'm fairly new to AWS and I'm hoping you guys can reassure me as I couldn't find anything in the AWS documentation either way. I actually have two questions, the first: I have an RDS MySql instance ...
Pheonyx's user avatar
  • 183
8 votes
1 answer
4k views

What AWS instance to choose for write-heavy PostgreSQL database server

We are now having problems trouble to tackle the intensive traffic to our servers during peak hours; see this related question on tuning the DB. At the moment we are using a smaller cloud service for ...
lorgartzor's user avatar
8 votes
1 answer
6k views

Postgres long autovacuum halting database

I have a fairly large table (1 million rows) and my database is stuck on an autovacuum (>30 mins) on the this table, causing the whole database to chock. Application won't even load now. -00:37:31....
Andrew Cetinic's user avatar
8 votes
2 answers
6k views

MySQL on RDS, data transfer from one instance to another as a production job

I have a MySQL RDS instance ("production") from which I need to copy incremental data to another MySQL RDS instance ("reporting"). “Incremental data” being the new rows in certain tables. Currently ...
Alex Lo's user avatar
  • 181
7 votes
2 answers
8k views

AWS DMS creates tables with no auto_increment

I am migrating my databases to Amazon's RDS using their DMS tool. Pretty much everything looks great except that columns that were marked as auto_increment on the source database did not get marked ...
InfernoTK's user avatar
  • 103
7 votes
2 answers
35k views

How to solve MySQL “The table is full” error 1114 with Amazon RDS?

I am trying to add a new column in a table and the query giving me this error 1114. My RDS instance size is small. 1.7 GB memory, 1 ECU (1 virtual core with 1 ECU) Table i am trying to modify is ...
Ruchit Patel's user avatar
7 votes
2 answers
11k views

How to set up Amazon RDS parameter group for Postgres?

I'm trying to create a parameter group in Amazon Web Services for an Postgres 9.5 RDS instance. I'm a little confused by the units being used for things such as shared_buffers and min_wal_size. ...
bertday's user avatar
  • 199
7 votes
1 answer
5k views

Amazon RDS t2.small as a production server

I currently have a m3.medium as production PostgreSQL server but I want to move it to RDS with the Multi-AZ feature. Since the CPU usage of our current server is never higher than 5% and the RAM ...
Danny Hiemstra's user avatar
7 votes
6 answers
9k views

MySQL join has drastically worse performance after upgrading from 5.6 to 5.7

I have a fairly straightforward query that has become very slow after upgrading from MySQL 5.6.35 to MySQL 5.7.12 (running on AWS RDS). SELECT DISTINCT Name,d.id,deviceType,issuedBy, description,...
blindsnowmobile's user avatar
7 votes
3 answers
8k views

SSL connection to AWS RDS Postgresql instance from windows client

I am trying to connect to a PG instance hosted on AWS RDS using a secure SSL connection. Where do I store the public key on windows so that it is automatically applied to the connection? Please note ...
ChristopherTull's user avatar
7 votes
1 answer
13k views

Amazon RDS mysqbinlog "Could not find first log file name in binary log index file"

Preamble: We use RDS at AWS to manage our MySQL database. I know that RDS creates binary logs used for replication.. I want to harvest these binary logs and store them on S3, so that at any time, i ...
code ninja's user avatar
7 votes
2 answers
3k views

Recommendations on replicating an RDS PostgreSQL instance?

At my company, we are looking for alternatives to replicate a PostgreSQL instance into another database. In our scenario, we have a production PostgreSQL 9.5 database server, with new entries coming ...
thalesmello's user avatar
7 votes
2 answers
2k views

Best practice for securely backing up RDS Postgres "offsite"?

We're running Postgres on RDS, which is largely great. The big issue with it, however, is to do with AWS' security model, which allows anyone with various permissions to delete everything - your DBs, ...
Pete Storey's user avatar
7 votes
1 answer
9k views

Simple queries to Redshift really slow

I just started testing AWS Redshift and populated a single node with the AWS sample data. Querying a table with 10 or ~400 rows takes around 2 seconds, uncached. I'm not sure if I'm misunderstanding ...
Till's user avatar
  • 173
6 votes
3 answers
10k views

How to handle MySQL database connections/pooling from Lambda -> RDS with Node

I'm running into some problems while testing my Lambda function. I my test, I execute in parallel N executions of my Lambda function. In my lambda function, I retrieve a database connection through ...
Austin Gayler's user avatar
6 votes
1 answer
9k views

Cannot remotely access PostgreSQL on EC2 instance

I was unable to access a remote AWS postgres database via things like psql -h *EC2ExternalIP* -U *me*. I would get: psql -h *EC2ExternalIP* -U *me* psql: could not connect to server: Operation timed ...
rikb's user avatar
  • 201
6 votes
1 answer
7k views

Disable MySQL replication on rds

I want set up replication between an Amazon RDS MySQL DB instance and a MySQL instance that is external to Amazon RDS. but Slave_IO_Running: Connecting how to solve this problem? I have already ...
hhhyungyu's user avatar
6 votes
1 answer
2k views

AWS RDS databases & SSIS

I have 2 AWS RDS databases (A & B) and need to create a datawarehouse with star scheme and slowly changing dimensions within AWS. From a MS background it makes sense to create a SSIS package to ...
Bob's user avatar
  • 161
6 votes
0 answers
5k views

AWS RDS Postgres Logical replication

I am using AWS RDS Postgres's and RDS's logical replication support (Edit: Note, this is not the same as the logical replication featurein PostgreSQL 10. It's AWS RDS functionality based on the same ...
Murali's user avatar
  • 61
6 votes
0 answers
1k views

Understanding MongoDB Log warning

In my MongoDB log, I am seeing these lines of messages: 2016-04-05T00:03:42.904+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 200, after asserts: 240, after backgroundFlushing: ...
M T's user avatar
  • 61
6 votes
1 answer
4k views

Queries running very slowly in Amazon RDS PostgreSQL read-replica

We have been maintaining a project which has both web and mobile application platform. The backend of the project is developed in Django 1.10 and deployed in AWS. At the beginning, when there were ...
Mahmud Al-Noor's user avatar
5 votes
1 answer
6k views

How to alter system on AWS RDS?

I need to run ALTER SYSTEM SET track_activity_query_size = 16384; So I can see the contents of some long running queries (I can only see the beginning at the default size), but when I try to do ...
CorayThan's user avatar
  • 151
5 votes
2 answers
46k views

How to get the records from Amazon Athena for past week only

I am writing a query to get Amazon Athena records for the past one week only. Here is what I wrote so far: WITH events AS ( SELECT event.eventVersion, event.eventID, event.eventTime, ...
Kittystone's user avatar
5 votes
1 answer
3k views

PostgreSQL 9.3: pg_dump fails due to tiger.direction_lookup

I am trying to dump the schema from one of my PostgreSQL 9.3+PostGIS databases: /usr/lib/postgresql/9.3/bin/pg_dump --schema-only -h stg-db.....rds.amazonaws.com ...
Adam Matan's user avatar
  • 11.7k
5 votes
1 answer
7k views

RDS crosstab: ERROR: permission denied for language c

We're currently using PostgreSQL 9.2 in our production database, we want to migrate to a new RDS instance, using PostgreSQL 9.4. However, we need to have permission to create a function, but only ...
Valter Silva's user avatar
5 votes
1 answer
7k views

Spike in AWS RDS Oldest Replication Slot lag

Does anyone know about this "Oldest Replication Slot Lag" in AWS RDS? What does it represent? I have a PostgreSQL instance on RDS (with Logical Replication switched on) for transferring data from ...
Zinx's user avatar
  • 309
5 votes
1 answer
2k views

In RDS digest function is undefined after creating pgcrypto extension

On an AWS RDS instance, we have run CREATE EXTENSION pgcrypto; The extension gets created. Both queries: SELECT digest('a', 'sha256') FROM table_name; SELECT public.digest('a', 'sha256') FROM ...
chris's user avatar
  • 201
5 votes
1 answer
5k views

PostgreSQL - can I use logical replication from a replica's WAL?

I would like to use logical replication. However, as PostgreSQL works now, it can eat up the whole disk and then block the database. Especially in Amazon Web Services RDS, this is a problem because ...
Ondra Žižka's user avatar
5 votes
1 answer
3k views

Change AWS's Read Replica's streaming replication to trigger based replication

We have a Postgres RDS instance for which we have created a read replica instance. The problem we are facing is that, that whenever there is a long running query(about 30-40 mins) on Read Replica, it ...
Mitaksh Gupta's user avatar
5 votes
1 answer
2k views

Swap Usage but high Freeable memory

We have an AWS RDS with a MySQL database. Buffer Pool size is only 144GB out of the total available 244GB RAM. However, even at such a low RAM config, we see Swap Usage happening. Does anyone have any ...
Shahid Thaika's user avatar
4 votes
1 answer
2k views

Recovery mode keeps reverting to full

I'm using SQL Server 2016 to manipulate some large research data-sets. I keep setting the recovery mode to simple, however it keeps reverting somehow back to full. Any guidance or advice on how to ...
plane's user avatar
  • 41
4 votes
3 answers
14k views

How to decide whether to enable MySQL query cache using InnoDB

How should the decision to enable / disable the MySQL query cache be made, on a server that uses just InnoDB tables. Say for example, if the cache is enabled, then how should the output of: SHOW ...
Michal Charemza's user avatar
4 votes
1 answer
8k views

How to enable force ssl on AWS Aurora Postgres?

In AWS's direct postgres offering RDS Postgres, you can require SSL by setting the parameter group item rds.force_ssl to 1. This is as per the RDS postgres documentation: https://docs.aws.amazon.com/...
JK.'s user avatar
  • 141
4 votes
2 answers
9k views

Import data into AWS RDS sql server through SQL Server management studio

I have created an RDS instance running SQL Server SE, this does not allow remote desktop access, so I also have an EC2 instance running Windows Server 2012 base, and I have installed SQL Server ...
user120920's user avatar
4 votes
2 answers
31k views

Not able to login on MySQL in AWS RDS using root

I am trying to connect my MySQL RDS from EC2. Under security groups I have made sure permissions are in place. $ mysql -h xxx.xyz.ap-southeast-1.rds.amazonaws.com -P 3306 -p Enter password: I am ...
Deepak Singhal's user avatar
4 votes
1 answer
450 views

Always On Availability Groups Network Configuration in AWS

I have set up a 3-node, multi-subnet Always On Availability group in AWS, which seems to be working well. However, each node only has a single network adaptor with 3 IP addresses assigned to it (1 ...
Matt's user avatar
  • 53
4 votes
2 answers
4k views

Using AWS DynamoDB Geospatial index with Python

Amazon's AWS DynamoDB features Geospatial Indexing, which facilitates geo queries: Query Support: Box queries return items that fall within a pair of geo points that define a rectangle as ...
Adam Matan's user avatar
  • 11.7k
4 votes
1 answer
8k views

Stale table lock in AWS Aurora?

We have an AWS Aurora (MySQL engine, r3.large) we are using to test a migration. We have noticed a couple of queries that simply don't appear to run. When I run show engine innodb status; it ...
chris's user avatar
  • 1,222
4 votes
2 answers
81k views

Cluster network name resource 'Cluster Name' failed registration

I have a fail-over cluster set between two Windows Server 2016 machines, and I'm seeing errors regarding the DNS record, both for the cluster itself and for any listener I try to add in SQL high ...
Green's user avatar
  • 41
4 votes
1 answer
3k views

AWS aurora (postgres) proper value for the shared_buffers parameter

I think it's fairly well known that a normal PostgreSQL database has a starting value of 25% of system memory for its shared_buffers parameter, but I haven't been able to find anything regarding a ...
user188401's user avatar
4 votes
2 answers
972 views

RDS Oracle SE - Performance troubleshooting options

I have an RDS Oracle SE2 instance with Amazon RDS. Our team is looking forward to move couple of applications to RDS. But we’re looking for options that are available in RDS Oracle SE to perform ...
Ramya's user avatar
  • 445

1
2 3 4 5
10