Amazon Web Services.

learn more… | top users | synonyms

5
votes
1answer
977 views

What AWS instance to choose for write-heavy PostgreSQL database server

We are now having problems trouble to tackle the intensive traffic to our servers during peak hours; see this related question on tuning the DB. At the moment we are using a smaller cloud service for ...
5
votes
1answer
3k views

MySQL on RDS, data transfer from one instance to another as a production job

I have a MySQL RDS instance ("production") from which I need to copy incremental data to another MySQL RDS instance ("reporting"). “Incremental data” being the new rows in certain tables. Currently ...
5
votes
1answer
4k views

Amazon RDS mysqbinlog “Could not find first log file name in binary log index file”

Preamble: We use RDS at AWS to manage our MySQL database. I know that RDS creates binary logs used for replication.. I want to harvest these binary logs and store them on S3, so that at any time, i ...
4
votes
2answers
3k views

Is it possible to Clone a RedShift Database?

For some test and development work we would like the ability to routinely clone existing RedShift databases (all schema and all data). Something like a backup-restore. The best I can find starts by ...
4
votes
1answer
183 views

Frequent MySQL table corruptions and instability [closed]

The database I'm working on is having frequent issues. Almost every day there is a problem. Things like tables crashing or becoming corrupt. So far, they've been repairable in one way or ...
4
votes
1answer
3k views

How to configure replication from PostgreSQL (RDS) to vanilla PostgreSQL?

I have an Amazon RDS Postgres DB and I created a "replicator" user and granted it the "replication" privilege. db=> create role replicator login password 'something'; CREATE ROLE db=> alter ...
4
votes
1answer
563 views

Migrating development and production databases to AWS

After careful thinking and asking on meta.stackoverflow, I'm posting this question on the DBA site. If anyone thinks this question should be on serverfault or any other site, feel free to close and ...
3
votes
1answer
2k views

Why use RDS over EC2 for Postgres?

I have a database currently running on EC2. As I have to move it to a bigger machine the question of using RDS came up. Pricing: I can get an EC2 c3.large instance with two SSDs (16GB each), two ...
3
votes
2answers
6k views

How to solve MySQL “The table is full” error 1114 with Amazon RDS?

I am trying to add a new column in a table and the query giving me this error 1114. My RDS instance size is small. 1.7 GB memory, 1 ECU (1 virtual core with 1 ECU) Table i am trying to modify is ...
3
votes
1answer
2k views

AWS performance of RDS with provisioned IOPS vs EC2

Has anyone done a performance comparison of AWS RDS with the new provisioned IOPS vs EC2? I've found plenty of non-high IOPS RDS vs EC2 but nothing with the new high IOPS feature in RDS.
3
votes
1answer
138 views

SQL Server Multi Tenancy Setup

What is the best way to use Multi Tenant Database Architecture when all of the "Tenants" will be from the same company? We are going to be using AWS and SQL Server for our backend system. We ...
3
votes
1answer
423 views

Active/ Active SQL Server Clustering on AWS

I need to design and implement a highly available SQL Server 2012 clustering on Amazon AWS. In the white paper presented by Amazon, they provided an example of Active/ Passive SQL Cluster. Do you know ...
3
votes
1answer
328 views

Postgres Plus Cloud Database on AWS for write heavy social game?

I'm one of four founders of a big social gaming iPhone app in Sweden. We now suffer from severe database server issues so I'm turning to you guys to get some help. First of all, let me get this out ...
3
votes
0answers
49 views

Why does replication with SSL fail on my MySQL database in AWS RDS?

I'm trying to replicate from AWS RDS to my own server. It works without SSL. Whenever I include the SSL property to the slave, it breaks with this error: error connecting to master ...
3
votes
0answers
479 views

How to get the best write throughput during a MySQL import with Amazon RDS?

tl;dr - How can we get the maximum EBS throughput for a db.r3.2xlarge instance? We're only seeing about half of what it can supposedly do. Apologies for the long length of this question. We've had ...
2
votes
1answer
262 views

Is there a way to achieve Workload Management in MySQL?

Is there a way to set up Workload Management in MySQL (in particular v5.5 on AWS RDS)? By Workload Management I mean the functionality implemented in e.g. Teradata, RedShift that allows ...
2
votes
1answer
286 views

Managing code and deployments to Amazon Redshift

I am finding it difficult to manage and deploy schema changes to my Amazon Redshift database. Ideally, I would like is to have the code for my database under source control and use a schema ...
2
votes
1answer
3k views

Creating mongo 3 node replica set on ec2 problems

I'm trying to create a 3 node cluster of mongo replicas on ec2 instances, with internal ips 10.168.xxx.xxx, 10.166.xxx.xxx and 10.188.xxx.xxx, my config file is: dbpath = /home/ubuntu/mongo-data/ ...
2
votes
1answer
113 views

How to have remote standby PostgreSQL server in different location (AWS)?

We have a primary PostgreSQL 9.4 server running multiple instances in our DC. It is using Continuous Archiving via WAL-E out to AWS S3. I would like to have a hot/warm standby server in our VPC within ...
2
votes
1answer
239 views

Amazon RDS t2.small as a production server

I currently have a m3.medium as production PostgreSQL server but I want to move it to RDS with the Multi-AZ feature. Since the CPU usage of our current server is never higher than 5% and the RAM ...
2
votes
2answers
482 views

Using AWS DynamoDB Geospatial index with Python

Amazon's AWS DynamoDB features Geospatial Indexing, which facilitates geo queries: Query Support: Box queries return items that fall within a pair of geo points that define a rectangle as ...
2
votes
2answers
342 views

Sharded MongoDB backup solution

I am looking for a way that I can backup my 12 MongoDB shards into a single server. Disk space is not an issue but getting the backups to be on a single node would be the best. I am not sure if there ...
2
votes
1answer
45 views

Which AWS database services are designed for storing logging records like log4j or log4perl?

I have been using the file system for log4j and log4perl records and want to start using a database to store the information, especially to lookup records organized by pid. We are using MySQL RDS for ...
2
votes
1answer
182 views

Improving concurrency in MongoDB via sharding

Our current setup: Cluster of ~500 ec2 c1.xLarge worker nodes with 8 threads on each running scientific simulations Results temporarily stored at runtime on each worker node's local MongoDB, using ...
2
votes
2answers
54 views

Deciding EC2 Instance type & Volume IOPS for Mongo DB

We have 500GB data in our Mongo(v2.6.3) including the indexes. We currently run this on AWS m3.large(8GB RAM) instance. Yes, Single machine. Our MongoDB Cloud Manager shows these stats: ...
2
votes
1answer
30 views

Mysql RDS migration problem

I'm trying to migrate my MySQL RDS to a different machine. The reason is that I need smaller disk, and you can't make disks smaller for RDS servers, only bigger. I'm trying to migrate with this ...
2
votes
0answers
14 views

how to convert mongodb(2.4.10) startup2 to primary

I have standalone bitnami mongodb(2.4.10). The output of rs.status() command is below : rs.status() { "set" : "test", "date" : ISODate("2015-11-13T08:07:41Z"), "myState" : 5, ...
2
votes
2answers
33 views

Troubles connecting to a SQL Server Express instance on AWS

I'm trying to remote connect a SQL Server Express instance that is running on AWS on a db.t2.micro. I'm getting the following error: A network-related or instance-specific error occurred while ...
2
votes
1answer
54 views

AWS RDS - Changing Instance Class

So I'm fairly new to AWS and I'm hoping you guys can reassure me as I couldn't find anything in the AWS documentation either way. I actually have two questions, the first: I have an RDS MySql ...
2
votes
0answers
85 views

MongoDB C# driver fails to reconnect after stepDown

I have an Elastic Beanstalk environment in AWS that constantly verifies the DB is accessible by querying the mongos for one document. We only speak to the DB routers and not to specific instances. ...
2
votes
1answer
71 views

PostgreSQL query - works locally but not on AWS RDS

We have a large query that works fine locally but deadlocks on AWS RDS. According to cloudwatch we are not resource bound on CPU, disk or iops and nothing else should be accessing these tables. The ...
2
votes
0answers
561 views

PostgreSQL continuous archiving - use snapshot for base backup on AWS?

I'm new to AWS and PostgreSQL admin and have been poring over the docs trying to come up with a good backup strategy for a fairly simple setup. I have a single Amazon Web Services EC2 instance that ...
2
votes
0answers
1k views

MySQL Server hitting 100% unexpectedly (Amazon AWS RDS)

We've been struggling with this issue for months. This week we upped our RDS instance to the highest performing instance and although the occurrences have reduced, we're still seeing our database ...
1
vote
2answers
188 views

How do I know if a AWS Server instance has license SQL Server Standard or SQL Server Web?

I'm looking my AWS billing and this doubt has come up. How do I know if a specific instance is running SQL Server 2008-R2 Standard or SQL Server Web? (using the AWS Console or SQL Server Management ...
1
vote
1answer
1k views

How to migrate postgreSQL on EC2 instance to AWS RDS?

I have a large PostgreSQL DB (around 100GB) which is on EC2. I want to migrate it to RDS. How can I achieve this with minimal downtime?
1
vote
1answer
63 views

PostgreSQL 9.2 EBS Snapshot on AWS

I found this post here back from 2011, and wanted to verify that it's still valid and good advice to take a hot snapshot of an ebs volume (PostgreSQL still running) so long as you're snapping all of ...
1
vote
1answer
6k views

Not able to login on MySQL in AWS RDS using root

I am trying to connect my MySQL RDS from EC2. Under security groups I have made sure permissions are in place. $ mysql -h xxx.xyz.ap-southeast-1.rds.amazonaws.com -P 3306 -p Enter password: I am ...
1
vote
1answer
32 views

Create a quick report for a client

I have an Amazon RDS (postgres) database and an client asked me to have access to certain data stored in this database preferably in the form of a comma separated file. If the data changes, the client ...
1
vote
2answers
147 views

MySQL / DRBD / Pacemaker on EC2

I am trying to setup DRBD/MySQL/Corosync/Pacemaker on AWS EC2 instances, though I am not sure if it will work since how to integrate VIP is a problem for me. Anyone have any thoughts on what to do ? ...
1
vote
1answer
175 views

SQL Server 2012 CPU usage spikes to 100%

I am using SQL Server 2014 in AWS and the AWS image configuration is 4 cores and 16GB RAM(m3.xlarge). I am running the following simple query, SELECT * FROM user_table WHERE user_id = '10' ...
1
vote
1answer
385 views

Replication Lag on Postgres AWS RDS Service

We have a single master/single streaming replica Postgres 9.3 db on AWS. The load is not terribly high - this is a development/staging environment. (The production shows similar metrics). Point is the ...
1
vote
1answer
284 views

Amazon RDS replication with external slave

I've recently configured a replication with an external MySQL master and RDS as slave but now I need to reverse that config and use RDS as master and the other instance as slave. Actually I use a vpn ...
1
vote
1answer
337 views

RDS MySQL instance is unavailable, probably during binlog rotation

One of my customers uses a few EC2 linuxes with PHP application, connected to a standalone MySQL RDS. He reported application outage. During my investigation I found that this outage happened ...
1
vote
3answers
4k views

How to decide whether to enable MySQL query cache using InnoDB

How should the decision to enable / disable the MySQL query cache be made, on a server that uses just InnoDB tables. Say for example, if the cache is enabled, then how should the output of: SHOW ...
1
vote
1answer
513 views

What happens when the index size of my Mysql instance exceeds the innodb_buffer_pool_size?

I am using Amazon's RDS db.m1.small. innodb_buffer_pool_size is set to 1125.00 MB. Current index size is 1110.00 MB and growing slowly but steadily. I do not need more hard drive space. I want ...
1
vote
1answer
981 views

High MySQL CPU usage, queries seem fine, not running ntp

I've had about 48 hours of extremely high CPU usage on my main MySQL database for no apparent reason. I realize this question is quite similar to the one posed here: High CPU usage from MySQL with no ...
1
vote
0answers
25 views

AWS RDS databases & SSIS

I have 2 AWS RDS databases (A & B) and need to create a datawarehouse with star scheme and slowly changing dimensions within AWS. From a MS background it makes sense to create a SSIS package to ...
1
vote
0answers
22 views

Slony with Amazon's RDS service?

Is it actually possible to somehow use Slony with Amazon’s RDS service? I’m aware that there’s no such thing as a host that you can log into to make Slony’s configurations, but perhaps it can be done ...
1
vote
1answer
99 views

High data traffic from MySQL server to web server

I have one webserver running Magento : Community Edition 1.7.0.2 and a separate machine with MySQL 5.5.42 on it. Both machines are EC2 instances. I am seeing huge unexpected data traffic from the ...
1
vote
1answer
55 views

storing files on mongodb

I am developing an app where user will upload multiple images along with some other data like name address etc. I am using MEAN stack for development, So I have some questions regarding this: How ...