Stack Exchange Network

Stack Exchange network consists of 174 Q&A communities including Stack Overflow, the largest, most trusted online community for developers to learn, share their knowledge, and build their careers.

Visit Stack Exchange

Questions tagged [amazon-rds]

Amazon Relational Database Service is a web service that makes it easy to set up, operate, and scale a relational database in the cloud.

0
votes
1answer
12 views

Postgres 10.5: Granting full schema access to a user that isn't the owner

So the underlying problem I'm having is trying to migrate my on premise Postgres 10.5 instance to RDS. RDS does NOT give end users the SuperUser role so I'm hitting tons of permissions issues when ...
0
votes
0answers
11 views

migrating data pipeline to AWS Glue

I was trying AWS Glue to migrate our current data pipeline from python scripts to AWS Glue . I was able to setup a crawler to pull the schema for the different Postgres databases . However, I am ...
0
votes
1answer
13 views

Increase in number of temp files being generated after increasing checkpoint_timeout

I have pgbadger set up to analyze the log files from my postgres db. I recently changed a couple of parameters in my postgres config. I changed the checkpoint_timeout from the default value of 300 ...
0
votes
0answers
9 views

Why do AWS RDS connections time out even though its configured to accept connections?

Hi I have a PostgresSQL database on AWS RDS which is in VPC. Its security groups are set to accept Postgres connections on port 5432 from my EC2 web servers which are in same VPC and yet in aws rds ...
0
votes
1answer
18 views

Some queries not logging using RDS's SQL Server with C2 Auditing enabled

Similar to a past issue I had with audited queries not showing when using Extended Events, I'm having an issue with queries not logging when using C2 Auditing on an RDS SQL Server instance. (I would ...
1
vote
0answers
19 views

How to backup a local database to cloud database?

I am about to start developing a POS software as my new project with python and electron js. It is going to be a desktop application. However, my concern is it should work in both cases when desktop ...
0
votes
1answer
20 views

Are the MariaDB and MySql drivers interchangeable when connecting to a MySQL backend Aurora cluster?

I saw a similar question asked before but I didn't get enough supporting information Does anyone know any new information on this? Can MariaDB connector (driver) be used instead of the MySQL ...
1
vote
0answers
16 views

mysql RDS cpu utilization is 90 % above always for less than for 250 connections ( max conn 1236)

I'm using mysql RDS db.m3.xlarge( 4 vcpus, 15G Ram). max_connection limit is 1236 but cpu is used more than 90% for less than 250 connection. I don't know what I'm struggling to find reason. Please ...
1
vote
3answers
130 views

MySQL in AWS RDS 100% CPU on some queries

I have a managed MySQL (5.7.19) instance on AWS. In general, things work pretty well. I'm consistently around 4% CPU usage, and well below my IOPS limits for the burstable instance (t2.micro). ...
0
votes
1answer
34 views

mysqldump from AWS RDS slowing down

Im taking a db backup from AWS RDS (MySQL) slave from an EC2 (m5.large - 2c/8GB) in same AZ using - mysqldump -hxx -u xx -p --extended-insert --single-transaction --max_allowed_packet=1G db > ...
3
votes
1answer
195 views

What is the apgcc schema in Amazon RDS Postgresql?

Recently a mysterious new schema called apgcc appeared in every database in our testing Aurora Postgresql cluster (eu-west region). It is owned by the rdsadmin account. What is it, and where did it ...
0
votes
0answers
13 views

Is it possible to change lock_timeout in amazon postgres rds?

We wanted to change the lock_timeout variable for our AWS RDS for PostgreSQL but we are unable to find it in the parameter group. Also, We are unable to check its current default value. Ref: https:/...
0
votes
0answers
17 views

AWS Aurora to Redshift continuous data capture

We have a Aurora database which is very write heavy, few tables are continuously being populated(lots of insert/update) throughout the day. The query on the Aurora are slow when some bigger clients ...
0
votes
0answers
18 views

PostgreSql statement_timeout for specific query

I have a use-case where I wanted to execute a query which took more time which was mentioned in statement_timeout parameter. I don't want this specific query to timeout in any way. Query: VACUUM ...
0
votes
0answers
18 views

Can an Amazon RDS SQL Server link to an RDS MySQL server?

Amazon RDS for SQL Server supports linked servers, but the doc page only describes linking to other SQL Servers. I would like to link to an RDS MySQL instance, but this normally involves installing ...
0
votes
1answer
11 views

Do I need SQS queues to store remote data in the Amazon Web Services (AWS) cloud?

My first question is, do I need SQS queues to receive my remote data, or can it go directly into an Amazon cloud storage solution like S3 or EC2? Currently, my company uses a third-party vendor to ...
1
vote
0answers
22 views

AWS RDS convertible RIs do not exist, so how can I gauge whether my instance is enough before I commit for a year?

I just migrated my small PostgreSQL database to AWS RDS, and I used a db.m4.large instance class. For the first 12 hours I found the database to be performant, and here's some key metrics: CPU ...
0
votes
1answer
25 views

Question regarding PSQLException: User was holding shared buffer pin for too long

I recently encountered a strange error that I don't quite understand what could cause it: caused by org.postgresql.util.PSQLException: ERROR: canceling statement due to conflict with recovery ...
0
votes
1answer
29 views

Why are my InnoDB tables larger than calculated?

I have a DB where some of the tables are much larger than I think that they should be. For 23 of 39 tables the following query overestimates their size, as it is designed to. But for 16 tables my ...
0
votes
1answer
19 views

drop big table freeze server

I am using amazon rds mysql 5.6 master instance and 4 slaves. there is big table with 800 GIB size that i want to drop it for releasing space. But when i execute drop command, the server entering to "...
0
votes
0answers
13 views

How to do I migrate a standalone postgresql to Amazon RDS?

How to do I migrate a standalone PostgreSQL to Amazon RDS? My PostgreSQL database is stored locally.
0
votes
2answers
70 views

Using MySQL 8.0 “Upgrade Checker” on RDS

The MySQL 8.0 Shell came with an "Upgrade Checker". Useful to run before upgrading, as you may detect incompatible issues with your table structure / etc. Running its python version from the shell ...
1
vote
0answers
13 views

AWS RDS Performance insights - Do DBAs would need a DB user? [closed]

This question is more to clarify or expand my knowledge. Currently, on my work, we're migrating all our systems to AWS. Regarding to databases, we start using performance insights but I'm not really ...
2
votes
1answer
40 views

Regularly updating table with huge amount of rows

I have a table containing (in addition to some metadata) a score and a boolean flag: CREATE TABLE scores ( score_id SERIAL NOT NULL CONSTRAINT score_pkey PRIMARY KEY, user_id ...
0
votes
1answer
56 views

Best way to pg_dump PostgreSQL on RDS to S3

I need to dump my PostgreSQL on RDS to a file on S3 periodically (to use it elsewhere than AWS). Is there a better way than running a script that runs pg_dump and uploads results to S3 using e.g. ...
0
votes
0answers
35 views

Database and table size shows large difference

I was running a materialized view refresh command in my postgres database. While the query was running it hit out of storage space and crashed with the following error. psql:refresh.sql:1: FATAL: ...
1
vote
1answer
74 views

What is the optimal setting for innodb_buffer_pool_instances for a mid level AWS RDS server with 6gb buffer pool?

We have a MySQL 5.7 AWS RDS instance running on a db.m4.large instance. The basic resources for that instance type are: 7.5gb RAM 2 VCPU RDS defaults to a calculation that allocates 75% of RAM to ...
0
votes
1answer
24 views

“Could not find server error” when using INSERT SELECT statement in SQL Server

I'm trying to copy a record from a production database table into a staging database table. They are both SQL Server databases on Amazon RDS. My query looks something like this: INSERT INTO [...
0
votes
0answers
62 views

AWS RDS - How to make a “read replica” of specific tables and not the whole database

The question sums it up basically. I have an external (not in AWS) MySQL v5.7 database that is 40Gb (it has one table of 16Gb). This database will be imported to RDS MySQL by another team. I will ...
1
vote
0answers
33 views

More scalable solution than MySQL - big inserts, analytic queries [closed]

We need to store a huge and growing amount of order data in a database. We currently use MySQL on AWS RDS for this purpose, but we are looking for a more scalable solution. We currently have around 50 ...
0
votes
0answers
13 views

Copy Postgres database from DEV to PROD on Amazon RDS using pgAdminIII

I am running pgAdminIII on Windows 10 and trying to copy my PostgreSQL database to production. I am able to Backup to a file. I am also able to connect to the PROD server on Amazon RDS and make ...
1
vote
0answers
61 views

Linked server from SQL server on AWS RDS to On premises Oracle database

We are planning to migrate an on-premises Microsoft SQL server database to AWS RDS SQL server. Everything is good except one roadblock, i.e this SQL server database has a linked server to on premises ...
1
vote
0answers
10 views

User / Client IP restrictions in Postgres running on RDS

I'm looking to restrict connection access for specific accounts based on the client IP. All of our services are running on AWS so I want an account that has R/W permissions to only be able to connect ...
2
votes
1answer
126 views

Temporarily disable indexes before updating whole table

For testing purposes I periodically restore production backup into a new database (AWS RDS PostgreSQL instance) with pg_restore. In the new database I run SQL queries that anonymize sensitive data. ...
0
votes
0answers
24 views

Exporting Mysqlbinlogs from RDS to EC2

We are trying to export Mysqlbinlogs from RDS to EC2 instance.We followed the steps as per the AWS guide (https://docs.aws.amazon.com/AmazonRDS/latest/UserGuide/USER_LogAccess.Concepts.MySQL.html) ...
1
vote
1answer
14 views

How does an encrypted DynamoDB (the same question applies to RDS as well) query work?

I am trying to understand whether the primary key is encrypted when I choose to encrypt in rest for AWS DynamoDB If the primary key is encrypted, how does a primary-key look up get performed under ...
0
votes
0answers
33 views

Is there any way to write to CloudWatch from an AWS RDS SQL Server Instance?

For scheduled tasks running against an AWS RDS server, I use a mix of apps living on an EC2 server and SQL Agent jobs. The apps can easily write success or failure to CloudWatch using the handy AWS ...
0
votes
1answer
19 views

MySQL how to migrate to new server without data lost?

I'm using AWS RDS, with 1 master & 1 slave. Just now I alter 1 of the table and hangup halfway, so I force stop the process. Now the database got some problem. Let say I wanted to instantiate a ...
1
vote
1answer
26 views

Is there any AWS RDS Utility to Manage Master Slave mysql db with read write splitting?

I am looking for a solution for production which can manage the read and write splitting on master and slave connection as i can't affford to define multiple connection string for R/W in whole ...
0
votes
1answer
247 views

enabling BINARY LOG on AWS RDS MySQL

Context I am trying to enable BINARY LOGs on a MySQL RDS instance. Issue I used CALL mysql.rds_set_configuration('binlog retention hours', 24) without encountering an error. And using CALL mysql....
3
votes
1answer
332 views

Postgres 9.4 wal_level=logical increases disk space

I am trying to use the AWS Database Migration Service to migrate data from an RDS Postgres instance to an Aurora MySQL instance. Database Migration Service requires the wal_level to be set as logical ...
1
vote
0answers
63 views

AWS RDS PostgreSQL - Managing Permissions

Relatively new to AWS RDS PostgreSQL environment. We are creating a database with multiple schemas. Users are grouped by "schema_role" that have privileges to create objects in assigned schemas. My ...
1
vote
0answers
150 views

Database Mail on Amazon RDS / SQL Server

Since Database Mail is not supported on Amazon RDS with SQL Server, can anyone offer any suggestions on how to send e-mail notifications for failed SQL Server jobs in Amazon RDS? Thanks in advance ...
1
vote
1answer
47 views

Migrating PostgreSQL DB from AWS to Alibaba Cloud

I'm migrating PostgreSQL RDS instance from AWS located in Frankfurt to the RDS instance in Alibaba Cloud also located in Frankfurt. I use Data Transmission tool from Alibaba Cloud. It connects both DB ...
1
vote
0answers
67 views

AWS RDS postrgres massive disk use, small tables

I can't figure out why our AWS postgres server has consumed all of it's space. We just had to up the storage space allocated to it, but can't find any hint from postgres that it's using that much ...
1
vote
0answers
14 views

Can I do profiles of an Oracle RDS instance on Amazon?

Is there any way to get histories of queries from a 3rd party application to an RDS Oracle instance? We have a DB with less than a million rows, and we are running some queries through a 3rd party ...
2
votes
1answer
218 views

PostgreSQL - can I use logical replication from a replica's WAL?

I would like to use logical replication. However, as PostgreSQL works now, it can eat up the whole disk and then block the database. Especially in Amazon Web Services RDS, this is a problem because ...
0
votes
1answer
24 views

One SQL Server RDS instance plus one Ubuntu instance cost money on my initial free trial year [closed]

Why do I get charged when I only have one micro instance running as Ubuntu and another one a RDS. Does the extra RDS count as a separate instance? My RDS is Microsoft SQL Server exchange which should ...
0
votes
1answer
23 views

Some dates replicated with a +4 offset

I've set up replication between an EC2 instance as master and a MySQL 5.5 RDS instance as slave. Everything is (mostly) fine except for one odd thing: the dates in a transaction table are either ...
2
votes
0answers
41 views

Query store works in dev, but not production in Amazon RDS

I'm having an issue getting query store to collect and record data on our production workload, however, it works as expected on our non-production instances (development and staging). The only ...