The tag has no wiki summary.

learn more… | top users | synonyms

5
votes
1answer
811 views

What AWS instance to choose for write-heavy PostgreSQL database server

We are now having problems trouble to tackle the intensive traffic to our servers during peak hours; see this related question on tuning the DB. At the moment we are using a smaller cloud service for ...
5
votes
1answer
2k views

MySQL on RDS, data transfer from one instance to another as a production job

I have a MySQL RDS instance ("production") from which I need to copy incremental data to another MySQL RDS instance ("reporting"). “Incremental data” being the new rows in certain tables. Currently ...
4
votes
2answers
1k views

Is it possible to Clone a RedShift Database?

For some test and development work we would like the ability to routinely clone existing RedShift databases (all schema and all data). Something like a backup-restore. The best I can find starts by ...
4
votes
1answer
2k views

Amazon RDS mysqbinlog “Could not find first log file name in binary log index file”

Preamble: We use RDS at AWS to manage our MySQL database. I know that RDS creates binary logs used for replication.. I want to harvest these binary logs and store them on S3, so that at any time, i ...
4
votes
1answer
2k views

How to configure replication from PostgreSQL (RDS) to vanilla PostgreSQL?

I have an Amazon RDS Postgres DB and I created a "replicator" user and granted it the "replication" privilege. db=> create role replicator login password 'something'; CREATE ROLE db=> alter ...
4
votes
1answer
416 views

Migrating development and production databases to AWS

After careful thinking and asking on meta.stackoverflow, I'm posting this question on the DBA site. If anyone thinks this question should be on serverfault or any other site, feel free to close and ...
3
votes
2answers
4k views

How to solve MySQL “The table is full” error 1114 with Amazon RDS?

I am trying to add a new column in a table and the query giving me this error 1114. My RDS instance size is small. 1.7 GB memory, 1 ECU (1 virtual core with 1 ECU) Table i am trying to modify is ...
3
votes
1answer
1k views

AWS performance of RDS with provisioned IOPS vs EC2

Has anyone done a performance comparison of AWS RDS with the new provisioned IOPS vs EC2? I've found plenty of non-high IOPS RDS vs EC2 but nothing with the new high IOPS feature in RDS.
3
votes
1answer
304 views

Active/ Active SQL Server Clustering on AWS

I need to design and implement a highly available SQL Server 2012 clustering on Amazon AWS. In the white paper presented by Amazon, they provided an example of Active/ Passive SQL Cluster. Do you know ...
3
votes
1answer
306 views

Postgres Plus Cloud Database on AWS for write heavy social game?

I'm one of four founders of a big social gaming iPhone app in Sweden. We now suffer from severe database server issues so I'm turning to you guys to get some help. First of all, let me get this out ...
3
votes
1answer
166 views

Frequent MySQL table corruptions and instability

The database I'm working on is having frequent issues. Almost every day there is a problem. Things like tables crashing or becoming corrupt. So far, they've been repairable in one way or ...
3
votes
0answers
89 views

How to get the best write throughput during a MySQL import with Amazon RDS?

tl;dr - How can we get the maximum EBS throughput for a db.r3.2xlarge instance? We're only seeing about half of what it can supposedly do. Apologies for the long length of this question. We've had ...
2
votes
1answer
194 views

Is there a way to achieve Workload Management in MySQL?

Is there a way to set up Workload Management in MySQL (in particular v5.5 on AWS RDS)? By Workload Management I mean the functionality implemented in e.g. Teradata, RedShift that allows ...
2
votes
1answer
2k views

Creating mongo 3 node replica set on ec2 problems

I'm trying to create a 3 node cluster of mongo replicas on ec2 instances, with internal ips 10.168.xxx.xxx, 10.166.xxx.xxx and 10.188.xxx.xxx, my config file is: dbpath = /home/ubuntu/mongo-data/ ...
2
votes
1answer
164 views

Managing code and deployments to Amazon Redshift

I am finding it difficult to manage and deploy schema changes to my Amazon Redshift database. Ideally, I would like is to have the code for my database under source control and use a schema ...
2
votes
2answers
311 views

Sharded MongoDB backup solution

I am looking for a way that I can backup my 12 MongoDB shards into a single server. Disk space is not an issue but getting the backups to be on a single node would be the best. I am not sure if there ...
2
votes
1answer
198 views

Using AWS DynamoDB Geospatial index with Python

Amazon's AWS DynamoDB features Geospatial Indexing, which facilitates geo queries: Query Support: Box queries return items that fall within a pair of geo points that define a rectangle as ...
2
votes
1answer
152 views

Improving concurrency in MongoDB via sharding

Our current setup: Cluster of ~500 ec2 c1.xLarge worker nodes with 8 threads on each running scientific simulations Results temporarily stored at runtime on each worker node's local MongoDB, using ...
2
votes
0answers
16 views

PostgreSQL query - works locally but not on AWS RDS

We have a large query that works fine locally but deadlocks on AWS RDS. According to cloudwatch we are not resource bound on CPU, disk or iops and nothing else should be accessing these tables. The ...
2
votes
0answers
958 views

MySQL Server hitting 100% unexpectedly (Amazon AWS RDS)

We've been struggling with this issue for months. This week we upped our RDS instance to the highest performing instance and although the occurrences have reduced, we're still seeing our database ...
1
vote
2answers
116 views

How do I know if a AWS Server instance has license SQL Server Standard or SQL Server Web?

I'm looking my AWS billing and this doubt has come up. How do I know if a specific instance is running SQL Server 2008-R2 Standard or SQL Server Web? (using the AWS Console or SQL Server Management ...
1
vote
1answer
435 views

How to migrate postgreSQL on EC2 instance to AWS RDS?

I have a large PostgreSQL DB (around 100GB) which is on EC2. I want to migrate it to RDS. How can I achieve this with minimal downtime?
1
vote
1answer
946 views

Why use RDS over EC2 for Postgres?

I have a database currently running on EC2. As I have to move it to a bigger machine the question of using RDS came up. Pricing: I can get an EC2 c3.large instance with two SSDs (16GB each), two ...
1
vote
1answer
35 views

PostgreSQL 9.2 EBS Snapshot on AWS

I found this post here back from 2011, and wanted to verify that it's still valid and good advice to take a hot snapshot of an ebs volume (PostgreSQL still running) so long as you're snapping all of ...
1
vote
1answer
3k views

Not able to login on MySQL in AWS RDS using root

I am trying to connect my MySQL RDS from EC2. Under security groups I have made sure permissions are in place. $ mysql -h xxx.xyz.ap-southeast-1.rds.amazonaws.com -P 3306 -p Enter password: I am ...
1
vote
1answer
41 views

SQL Server 2012 CPU usage spikes to 100%

I am using SQL Server 2014 in AWS and the AWS image configuration is 4 cores and 16GB RAM(m3.xlarge). I am running the following simple query, SELECT * FROM user_table WHERE user_id = '10' ...
1
vote
1answer
216 views

RDS MySQL instance is unavailable, probably during binlog rotation

One of my customers uses a few EC2 linuxes with PHP application, connected to a standalone MySQL RDS. He reported application outage. During my investigation I found that this outage happened ...
1
vote
3answers
2k views

How to decide whether to enable MySQL query cache using InnoDB

How should the decision to enable / disable the MySQL query cache be made, on a server that uses just InnoDB tables. Say for example, if the cache is enabled, then how should the output of: SHOW ...
1
vote
1answer
887 views

High MySQL CPU usage, queries seem fine, not running ntp

I've had about 48 hours of extremely high CPU usage on my main MySQL database for no apparent reason. I realize this question is quite similar to the one posed here: High CPU usage from MySQL with no ...
1
vote
1answer
49 views

Can't connect to EC2 Postgresql instance unless I change the default port 5432 [closed]

I just created a brand new EC2 instance with a default security group allowing All Traffic from Anywhere. My listen_address is set to * I can SSH to it but I can't connect to the pgsql instance ...
1
vote
0answers
42 views

Replication Lag on Postgres AWS RDS Service

We have a single master/single streaming replica Postgres 9.3 db on AWS. The load is not terribly high - this is a development/staging environment. (The production shows similar metrics). Point is the ...
1
vote
0answers
396 views

PostgreSQL continuous archiving - use snapshot for base backup on AWS?

I'm new to AWS and PostgreSQL admin and have been poring over the docs trying to come up with a good backup strategy for a fairly simple setup. I have a single Amazon Web Services EC2 instance that ...
1
vote
2answers
148 views

Migrating a database from SQL Server 2012 to the cloud [closed]

I have a sample SQL Server database which is running on my computer. I have a cloud database account on AWS (free account). I want to migrate the database, with all tables, to the cloud. How can I do ...
0
votes
1answer
457 views

AWS RDS PostgreSQL dump/restore - syntax error

I am trying to import a postgresql database from an EC2 instance to RDS on the same subnet, so far I am doing the following... 1) Dump EC2 DB: pg_dump --host localhost --port 5432 -Fc ...
0
votes
2answers
29 views

Table JOIN and CREATE new table extremely slow

I'm using something like this to create a new table: CREATE TABLE result AS (SELECT calls.*, targ_with_planned_calls.* FROM calls INNER JOIN planned ON calls.first_id = ...
0
votes
1answer
57 views

Does AWS Aurora suffer from the same limitations that MySQL suffer from? [closed]

Specifically, MySQL has a limitations max row size as 64kB. I would like to know if Amazon Aurora, which is supposedly a drop in replacement for MySQL suffer the same limitation.
0
votes
2answers
980 views

SQL Server replication service in Amazon RDS

I have a local infrastructure with multiple SQL Servers. Some of the servers have replications services to copy some data to a master database. Is it possible to have the replication services to work ...
0
votes
0answers
22 views

AWS RDS Constant cpu (20%) utilisation

I have a RDS instance that has workload at specific time window, however, cpu utilisation is a constant 20% even outside this window. There is no replication configured. Can't find a solution for ...
0
votes
0answers
19 views

SQL Server hangs during backup on EC2

Once and then our SQL Server will "hang" during its weekly full backup. When this happens, external connections start to timeout. The symptoms are: Connections timeout The sqlservr.exe process sits ...
0
votes
0answers
8 views

How to backup huge Mysql db containing both InnoDB & MyISAM tables in Aws RDS?

I am running a Mysql RDS with 150GB+ data. The DB size is growing very fast(But normal considering the application's nature) Till now we were having only InnoDB storage engine, so we were using the ...
0
votes
0answers
14 views

Amazon RDS backup space requirements

It's very unclear to me how much space an Amazon RDS DB backup actually needs. The pricing page says: For example, if you have an active DB Instance with 10GB-month of provisioned database ...
0
votes
0answers
29 views

Mongodb replica set across AWS regions or subnets or data centers

I seem to have run into a blocking problem. I want a certain collection to be replicated across multiple AWS regions/subnets/data centers (eg a global lookup table or a global user credentials table) ...
0
votes
0answers
31 views

Load Large data set SSIS AWS EBS

We have configuration of SQL 2012 std edition hosted in Amazon cloud that has data disk of 3 TB, Index disk of 3 TB, Log disk of 500 gb all raid 0 stripped. Am trying to load a table that has 8 ...
0
votes
0answers
50 views

Issue using COPY command with AWS Redshift

I am trying to copy a CSV file from my PC, which has SSH running, to AWS Redshift. I have copied the Redshfit public key to authorized_keys for the appropriate user. copy contact (id,name) from ...
0
votes
0answers
101 views

Multi Session Mirroring using 1 witness server, cannot find certificate

I am trying to use 1 witness server for 2 mirrored databases that reside on different servers. For example: db1 on server(A) mirrored to server(B) using witness server(1), and db2 on ...
0
votes
1answer
97 views

Amazon RDS replication with external slave

I've recently configured a replication with an external MySQL master and RDS as slave but now I need to reverse that config and use RDS as master and the other instance as slave. Actually I use a vpn ...
0
votes
1answer
95 views

Amazon RDS freezes on mysqldump

My questions is quite similar to Mysqldump from the Amazon RDS. I have the same behavior. Everytime when I do a backup using mysqldump my entire RDS freezes and hence my application is not responding. ...
0
votes
1answer
298 views

PostgreSQL 9.3: pg_dump fails due to tiger.direction_lookup

I am trying to dump the schema from one of my PostgreSQL 9.3+PostGIS databases: /usr/lib/postgresql/9.3/bin/pg_dump --schema-only -h stg-db.....rds.amazonaws.com ...
0
votes
1answer
195 views

How to get pg_archivecleanup on Amazon Linux 2014.03?

I have an Amazon EC2 instance based on Amazon Linux AMI 2014.03. I installed PostresSQL from their repos: yum install postgresql-libs postgresql postgresql-server postgresql-devel I've read about ...
0
votes
0answers
34 views

How to replicate an Oracle 11g DB on AWS

Our client gave us an RMAN back for Oracle Enterprise 11.2.0.3 and we wanted to replicate it on AWS We are unable to do so because the default AWS server runs 11.2.0.1 and we do not have a licensee ...