Amazon Web Services.

learn more… | top users | synonyms

6
votes
1answer
1k views

What AWS instance to choose for write-heavy PostgreSQL database server

We are now having problems trouble to tackle the intensive traffic to our servers during peak hours; see this related question on tuning the DB. At the moment we are using a smaller cloud service for ...
5
votes
2answers
3k views

Is it possible to Clone a RedShift Database?

For some test and development work we would like the ability to routinely clone existing RedShift databases (all schema and all data). Something like a backup-restore. The best I can find starts by ...
5
votes
1answer
3k views

MySQL on RDS, data transfer from one instance to another as a production job

I have a MySQL RDS instance ("production") from which I need to copy incremental data to another MySQL RDS instance ("reporting"). “Incremental data” being the new rows in certain tables. Currently ...
5
votes
1answer
110 views

AWS RDS databases & SSIS

I have 2 AWS RDS databases (A & B) and need to create a datawarehouse with star scheme and slowly changing dimensions within AWS. From a MS background it makes sense to create a SSIS package to ...
5
votes
1answer
5k views

Amazon RDS mysqbinlog “Could not find first log file name in binary log index file”

Preamble: We use RDS at AWS to manage our MySQL database. I know that RDS creates binary logs used for replication.. I want to harvest these binary logs and store them on S3, so that at any time, i ...
4
votes
1answer
3k views

Why use RDS over EC2 for Postgres?

I have a database currently running on EC2. As I have to move it to a bigger machine the question of using RDS came up. Pricing: I can get an EC2 c3.large instance with two SSDs (16GB each), two ...
4
votes
1answer
188 views

Frequent MySQL table corruptions and instability [closed]

The database I'm working on is having frequent issues. Almost every day there is a problem. Things like tables crashing or becoming corrupt. So far, they've been repairable in one way or another,...
4
votes
1answer
3k views

How to configure replication from PostgreSQL (RDS) to vanilla PostgreSQL?

I have an Amazon RDS Postgres DB and I created a "replicator" user and granted it the "replication" privilege. db=> create role replicator login password 'something'; CREATE ROLE db=> alter ...
4
votes
1answer
685 views

Migrating development and production databases to AWS

After careful thinking and asking on meta.stackoverflow, I'm posting this question on the DBA site. If anyone thinks this question should be on serverfault or any other site, feel free to close and ...
3
votes
1answer
178 views

RDS crosstab: ERROR: permission denied for language c

We're currently using PostgreSQL 9.2 in our production database, we want to migrate to a new RDS instance, using PostgreSQL 9.4. However, we need to have permission to create a function, but only ...
3
votes
2answers
7k views

How to solve MySQL “The table is full” error 1114 with Amazon RDS?

I am trying to add a new column in a table and the query giving me this error 1114. My RDS instance size is small. 1.7 GB memory, 1 ECU (1 virtual core with 1 ECU) Table i am trying to modify is ...
3
votes
2answers
213 views

Deciding EC2 Instance type & Volume IOPS for Mongo DB

We have 500GB data in our Mongo(v2.6.3) including the indexes. We currently run this on AWS m3.large(8GB RAM) instance. Yes, Single machine. Our MongoDB Cloud Manager shows these stats: ...
3
votes
1answer
653 views

Domain Admin on AWS lacking user rights to edit the top 200 using the Management Studio interface

I setup an application + SQL Server on AWS. Everything works fine my SQL User can read/write to any table. Now I connected to the SQL Server using my domain admin account using windows authentication ...
3
votes
1answer
2k views

AWS performance of RDS with provisioned IOPS vs EC2

Has anyone done a performance comparison of AWS RDS with the new provisioned IOPS vs EC2? I've found plenty of non-high IOPS RDS vs EC2 but nothing with the new high IOPS feature in RDS.
3
votes
1answer
288 views

SQL Server Multi Tenancy Setup

What is the best way to use Multi Tenant Database Architecture when all of the "Tenants" will be from the same company? We are going to be using AWS and SQL Server for our backend system. We ...
3
votes
1answer
476 views

Active/ Active SQL Server Clustering on AWS

I need to design and implement a highly available SQL Server 2012 clustering on Amazon AWS. In the white paper presented by Amazon, they provided an example of Active/ Passive SQL Cluster. Do you know ...
3
votes
1answer
344 views

Postgres Plus Cloud Database on AWS for write heavy social game?

I'm one of four founders of a big social gaming iPhone app in Sweden. We now suffer from severe database server issues so I'm turning to you guys to get some help. First of all, let me get this out ...
3
votes
0answers
85 views

Why does replication with SSL fail on my MySQL database in AWS RDS?

I'm trying to replicate from AWS RDS to my own server. It works without SSL. Whenever I include the SSL property to the slave, it breaks with this error: error connecting to master 'user@xxxxx....
3
votes
0answers
676 views

How to get the best write throughput during a MySQL import with Amazon RDS?

tl;dr - How can we get the maximum EBS throughput for a db.r3.2xlarge instance? We're only seeing about half of what it can supposedly do. Apologies for the long length of this question. We've had ...
2
votes
1answer
296 views

Is there a way to achieve Workload Management in MySQL?

Is there a way to set up Workload Management in MySQL (in particular v5.5 on AWS RDS)? By Workload Management I mean the functionality implemented in e.g. Teradata, RedShift that allows ...
2
votes
1answer
363 views

Managing code and deployments to Amazon Redshift

I am finding it difficult to manage and deploy schema changes to my Amazon Redshift database. Ideally, I would like is to have the code for my database under source control and use a schema ...
2
votes
1answer
4k views

Creating mongo 3 node replica set on ec2 problems

I'm trying to create a 3 node cluster of mongo replicas on ec2 instances, with internal ips 10.168.xxx.xxx, 10.166.xxx.xxx and 10.188.xxx.xxx, my config file is: dbpath = /home/ubuntu/mongo-data/ ...
2
votes
1answer
183 views

How to have remote standby PostgreSQL server in different location (AWS)?

We have a primary PostgreSQL 9.4 server running multiple instances in our DC. It is using Continuous Archiving via WAL-E out to AWS S3. I would like to have a hot/warm standby server in our VPC within ...
2
votes
1answer
638 views

Amazon RDS t2.small as a production server

I currently have a m3.medium as production PostgreSQL server but I want to move it to RDS with the Multi-AZ feature. Since the CPU usage of our current server is never higher than 5% and the RAM ...
2
votes
1answer
8k views

Not able to login on MySQL in AWS RDS using root

I am trying to connect my MySQL RDS from EC2. Under security groups I have made sure permissions are in place. $ mysql -h xxx.xyz.ap-southeast-1.rds.amazonaws.com -P 3306 -p Enter password: I am ...
2
votes
1answer
697 views

Replication Lag on Postgres AWS RDS Service

We have a single master/single streaming replica Postgres 9.3 db on AWS. The load is not terribly high - this is a development/staging environment. (The production shows similar metrics). Point is the ...
2
votes
2answers
727 views

Using AWS DynamoDB Geospatial index with Python

Amazon's AWS DynamoDB features Geospatial Indexing, which facilitates geo queries: Query Support: Box queries return items that fall within a pair of geo points that define a rectangle as ...
2
votes
2answers
353 views

Sharded MongoDB backup solution

I am looking for a way that I can backup my 12 MongoDB shards into a single server. Disk space is not an issue but getting the backups to be on a single node would be the best. I am not sure if there ...
2
votes
1answer
75 views

Which AWS database services are designed for storing logging records like log4j or log4perl?

I have been using the file system for log4j and log4perl records and want to start using a database to store the information, especially to lookup records organized by pid. We are using MySQL RDS for ...
2
votes
1answer
194 views

Improving concurrency in MongoDB via sharding

Our current setup: Cluster of ~500 ec2 c1.xLarge worker nodes with 8 threads on each running scientific simulations Results temporarily stored at runtime on each worker node's local MongoDB, using ...
2
votes
0answers
36 views

Mirror data on local SSD storage to conserve EBS I/O?

I have an AWS instance with local (ephemeral) SSD storage backed by a permanent EBS storage. Is it possible to configure the local storage to act as a mirror/cache for row data in MySQL? I do not wish ...
2
votes
0answers
15 views

What is the best way to keep track of 1000 RDS hosted databases?

I want to know what is 'best-practices' for managing an extreme number of RDS instances. I have no problem managing five. But managing dozens or hundreds, that's another task. I'm thinking use a ...
2
votes
1answer
34 views

Mysql RDS migration problem

I'm trying to migrate my MySQL RDS to a different machine. The reason is that I need smaller disk, and you can't make disks smaller for RDS servers, only bigger. I'm trying to migrate with this ...
2
votes
0answers
25 views

how to convert mongodb(2.4.10) startup2 to primary

I have standalone bitnami mongodb(2.4.10). The output of rs.status() command is below : rs.status() { "set" : "test", "date" : ISODate("2015-11-13T08:07:41Z"), "myState" : 5, "members"...
2
votes
2answers
58 views

Troubles connecting to a SQL Server Express instance on AWS

I'm trying to remote connect a SQL Server Express instance that is running on AWS on a db.t2.micro. I'm getting the following error: A network-related or instance-specific error occurred while ...
2
votes
1answer
121 views

AWS RDS - Changing Instance Class

So I'm fairly new to AWS and I'm hoping you guys can reassure me as I couldn't find anything in the AWS documentation either way. I actually have two questions, the first: I have an RDS MySql ...
2
votes
0answers
118 views

MongoDB C# driver fails to reconnect after stepDown

I have an Elastic Beanstalk environment in AWS that constantly verifies the DB is accessible by querying the mongos for one document. We only speak to the DB routers and not to specific instances. ...
2
votes
1answer
96 views

PostgreSQL query - works locally but not on AWS RDS

We have a large query that works fine locally but deadlocks on AWS RDS. According to cloudwatch we are not resource bound on CPU, disk or iops and nothing else should be accessing these tables. The ...
2
votes
0answers
627 views

PostgreSQL continuous archiving - use snapshot for base backup on AWS?

I'm new to AWS and PostgreSQL admin and have been poring over the docs trying to come up with a good backup strategy for a fairly simple setup. I have a single Amazon Web Services EC2 instance that ...
2
votes
0answers
2k views

MySQL Server hitting 100% unexpectedly (Amazon AWS RDS)

We've been struggling with this issue for months. This week we upped our RDS instance to the highest performing instance and although the occurrences have reduced, we're still seeing our database ...
1
vote
2answers
104 views

Recreate a table that was deleted during an ALTER statement (errno: -1)?

For the third time in the past 2-3 weeks I've gotten the following message during an ALTER statement: Error 2013: Lost connection to MySQL server during query SQL Statement: ALTER TABLE `...
1
vote
1answer
38 views

Where to store data on AWS?

I'm using AWS to host my application, and I'm using mongodb as db. I have installed mongodb on amazon ec2, but now I have no idea about where I should store all of my data. Can I store all of my data ...
1
vote
2answers
239 views

How do I know if a AWS Server instance has license SQL Server Standard or SQL Server Web?

I'm looking my AWS billing and this doubt has come up. How do I know if a specific instance is running SQL Server 2008-R2 Standard or SQL Server Web? (using the AWS Console or SQL Server Management ...
1
vote
1answer
708 views

PostgreSQL 9.3: pg_dump fails due to tiger.direction_lookup

I am trying to dump the schema from one of my PostgreSQL 9.3+PostGIS databases: /usr/lib/postgresql/9.3/bin/pg_dump --schema-only -h stg-db.....rds.amazonaws.com ...
1
vote
1answer
65 views

How to skip the current 'Relay_Master_Log_File' in AWS MYSQL RDS?

Below is the status of my slave. The master log file is at position "mysql-bin-changelog.278337" but the slave log file is at position "mysql-bin-changelog.278008". How to skip the current executing "...
1
vote
1answer
172 views

Postgres sharding installation with citusdb

We are developing a prototype for a BIG data product. We have almost 2 billion records. We have used PostgresSQL 9.5 as a back-end and Python as front-end. We are using a 16*2.4 GHz processors with ...
1
vote
1answer
908 views

Does AWS Aurora suffer from the same limitations that MySQL suffer from? [closed]

Specifically, MySQL has a limitations max row size as 64kB. I would like to know if Amazon Aurora, which is supposedly a drop in replacement for MySQL suffer the same limitation.
1
vote
1answer
1k views

How to migrate postgreSQL on EC2 instance to AWS RDS?

I have a large PostgreSQL DB (around 100GB) which is on EC2. I want to migrate it to RDS. How can I achieve this with minimal downtime?
1
vote
1answer
71 views

PostgreSQL 9.2 EBS Snapshot on AWS

I found this post here back from 2011, and wanted to verify that it's still valid and good advice to take a hot snapshot of an ebs volume (PostgreSQL still running) so long as you're snapping all of ...
1
vote
1answer
20 views

Is this work flow suitable for Amazon RDS?

I am considering to set up a MySQL database via amazon web services (AWS). Consider the following steps which characterize my workflow: There is a daily data inflow into several AWS EC2 instances On ...