Questions tagged [aws]

Amazon Web Services.

Filter by
Sorted by
Tagged with
1 vote
1 answer
40 views

Mysql 5.7 Slave replication is Slow

We are trying to debug a slave lag issue - it is currently lagging behind the master by 24 hours. Deployed on a AWS EC2 machine Database size is around 600 GB Grows at roughly 500 MB to 1 GB per day ...
user1428716's user avatar
0 votes
0 answers
19 views

Unable to connect to AWS mysql RDS instance

I created an AWS mySQL RDS instance (free tier), but i am unable to connect to it from workbench or cli. I have enabled public access to the DB while creation and allowed "All traffic" while ...
Ankit Rustagi's user avatar
0 votes
0 answers
12 views

What is a good mechanism to get production database data into other environments along with de identifying it

I am sure this is a solved problem and many people would have a great process already in place. How do I easily get data in my production server to other environments like staging and testing. We ...
George Joseph's user avatar
0 votes
0 answers
21 views

bitnami /opt/bitnami/mysql/data increases in size over time

I'm having a similar issue as to what is described in this post which never received an answer. Essentially, I'm running bitnami and my server space is filling up over time on what is a very simple ...
user284564's user avatar
1 vote
1 answer
48 views

Upgrade Postgres RDS in AWS fails major version upgrade

I have been attempting to upgrade our AWS RDS Postgres from 11.22 to 12.17 and/or 15.5 In both instances I get the following error in the error log: executing: SELECT datname, datallowconn FROM ...
sweetfa's user avatar
  • 188
1 vote
1 answer
32 views

Understand AWS RDS Multi-AZ Sync Replication

Multi-AZ AWS RDS docs state: What is “synchronous block level replication?” Given that this replication is at the disk level, not DB proper, is this form as reliable as DB replication?
Kevin Meredith's user avatar
1 vote
0 answers
414 views

AWS RDS Postgres: How to diagnose CheckpointLag and potential slowups using AWS' Monitoring suite?

We are currently hosting a postgres RDS database and our team is noticing slowup in our querying service. I'm noticing a spike in the metric, CheckpointLag and I've been tasked in trying to find where ...
Andrew Narvaez's user avatar
2 votes
0 answers
13 views

Aurora mysql throttle during writes

I came across a situation where I need expert opinion. Our application ingests data into table A in aurora mysql 3.02 every 5 seconds. This is a write intensive process. During this time, I am using ...
Falcon's user avatar
  • 91
0 votes
0 answers
19 views

SSMS. Anyway to connect via AWS session-manager to an mssql instance?

I have a sqlserver (express) instance running on an ubuntu server ec2 instance. This is on an AWS private subnet so I cannot just open port 1433 for sql access. We use AWS session manager to connect ...
Jamie GF's user avatar
0 votes
1 answer
21 views

aurora mysql - migrating large tables

We have write intensive application using aurora mysql 3.02 with 2xlarge instance size in prod. I want to migrate 10 tables (biggest one being 450GB) from 2nd aurora mysql into this prod db. Tried ...
JollyRoger's user avatar
0 votes
0 answers
38 views

MySQL time field type conversion issue with AWS DMS

I have a DB MySQL v5.6 community edition as a source DB and AWS RDS MySQL v5.7 as target in AWS DMS and have an issue with time field type. DMS task is full load and replication. During full load all ...
blagi's user avatar
  • 1
0 votes
0 answers
16 views

Does AWS Aurora MySQL Load Balance Reads Across Availability Zones?

I am running an AWS Aurora MySQL multi-AZ cluster with four nodes in two availability zone reader A and writer C are in one AZ, and reader B and D are in another AZ. It seems like reader A is ...
db_guy's user avatar
  • 1
0 votes
0 answers
39 views

Optimizing SELECT COUNT(DISTINCT) on a table increasing daily

Let's say we have a table Daily_users which has the columns student_id, school_id, grade, timestamp. We collect usage data of students daily and so the table grows daily (note that there could be ...
dezdichado's user avatar
1 vote
0 answers
31 views

Is there any tool that can be used to backup and restore individual schemas and not the entire database?

Can someone help me with any tool that can be used to incrementally back up the individual schemas and restore them instead of backing up the entire DB? We need this for the Aurora MySQL DB RDS ...
Omkar's user avatar
  • 11
0 votes
0 answers
43 views

Data validation for RDS PostgreSQL migration

I'm planning to replace a bunch of RDS PostgreSQL databases using this method defined by AWS. The DMS task will run will be CDC-only. I came up with data validation requirements for the migration and ...
trouble_bucket's user avatar
0 votes
1 answer
99 views

MySQL - AWS RDS - Replication node is stopped

I have a replication node on RDS that when shown on AWS Console it states that there's an error on RDS replication node (ERROR) and it has stopped replicating. What can I do to restart the replica? ...
JohnnyAce's user avatar
  • 101
1 vote
2 answers
342 views

AWS Aurora performance degradation after upgrade from MySQL v5.6 to 8.0

Kindly suggest which parameters to look for.. Following is the Performance Insights for our MySQL 8.0 AWS Aurora cluster.. We are consuming 3000+ queries per second and most queries return immediately....
Rajat Jain's user avatar
0 votes
1 answer
38 views

Amazon AWS credits system for SQL Server Connections

I remember there was some credit system in 2019 in AWS Sql Server, which regulated how many times you could connect per second (minute?), based on how much you paid. Over night, during idle, you would ...
T.S.'s user avatar
  • 216
0 votes
0 answers
30 views

Updating attributes, including PK and SK. Move up to 10 Billion records to new table, while still capturing live changes

Looking to shorten the attributes for some of our tables in DynamoDB, including the PK and SK and am currently brainstorming on what would be the best way to achieve this. The largest table has 10 ...
cb1295's user avatar
  • 101
0 votes
0 answers
48 views

How to Restore RDS TDE enabled backup into another RDS SQL Server 2019?

I enabled TDE encryption on RDS SQL SERVER with default RDS CERTIFICATE. I took native backup of same RDS on S3 bucket and want to restore same backup file into another RDS SQL SERVER. Source - RDS ...
Md Mumtaz Alam's user avatar
0 votes
0 answers
73 views

Redshift: Any difference in performance between # and temporary tables?

Is there any difference between the below two styles of using temporary tables in Redshift -- in terms of cluster performance (or) R/W into and from the table? I am new to Redshift, hence bit unaware ...
ranit.b's user avatar
  • 131
0 votes
0 answers
136 views

Assigning new role to already existing user in RDS

"We have an RDS instance hosted for Aurora PostgreSQL, specifically using the 'db.r5.xlarge' instance type. When we initially set up the RDS instance, a default user named 'rdsadmin' was ...
Naresh Barule's user avatar
0 votes
1 answer
22 views

Is it possible to use Mongo's Ops Manager with a DocumentDB instance on AWS?

We currently use Ops Manager to manage our on-prem MongoDB instances. We are, however, moving toward using native AWS services instead. As such, we are looking to use DocumentDB with our newer ...
Michael Oryl's user avatar
0 votes
1 answer
214 views

Get ERD from my Redshift database

I am a newbie in database management/governance. The problem: I have my companies Postgres RDB in AWS Redshift. So this is not a private project, but enterprise environment. I add new tables/columns, ...
hunsnowboarder's user avatar
0 votes
0 answers
12 views

Migrating Access DB using SQL Server Migration AssistantAWS SQL Server RDS instance . I made sure that I have the correct port and instance name

Connection to SQL Server failed. A network-related or instance-specific error occurred while establishing a connection to SQL Server. The server was not found or was not accessible. Verify that the ...
Abiel Yemane's user avatar
1 vote
1 answer
96 views

Migrate of Encrypt Columns from SQL Server 2005 To 2019 RDS AWS

good morning, Perform a migration of an On Premise database: Microsoft SQL Server 2005 - 9.00.5000.00 (X64) Dec 10, 2010 10:38:40 Copyright (c) 1988-2005 Microsoft Corporation Enterprise Edition (64-...
Omar Noa's user avatar
  • 125
0 votes
1 answer
72 views

Is creating a new table better than partitioning for my use case?

Problem: i have new data that is being generated monthly. When this new data becomes available, my existing rows in my table becomes stale and I have to delete all of them. I am considering two ...
Tinker's user avatar
  • 119
0 votes
0 answers
72 views

MySQL on RDS / AWS (Amazon): performance_schema has no SQL_TEXT and QUERY_SAMPLE_TEXT

We're using Mysql 8.0.32 on RDS, with Performance Insights and auto-managed performance_schema. The performance_schema mostly works, but some fields are absent. On performance_schema....
John Smith's user avatar
0 votes
1 answer
398 views

Can I run commands from aws_s3 extensions as non-root on PostgreSQL?

I'm trying to copy data from S3 to PostgreSQL (Amazon AWS RDS). I've set up the following: CREATE EXTENSION aws_s3 cascade schema reporting; CREATE DATABASE my_database; \connect my_database; -- ...
AdagioMolto's user avatar
1 vote
1 answer
240 views

aws ec2 instance using instance profile role to connect to s3 bucket.. sql server 2022 backup getting operating system error 86

Looking to see if anyone else having this issue. I have a windows server 2019/sql server 2022 ec2 instance that has a instance profile using a role/policy to upload to an s3 bucket. I created a ...
KC_IT's user avatar
  • 11
1 vote
1 answer
253 views

SQLite on AWS EBS vs MySQL AWS RDS

I'm planning to host a web application that consists of a Front-end, Back-end (Written in NestJS + TypeORM). This Web application requires a database like many others. Something I'm struggling with ...
CXY's user avatar
  • 11
0 votes
0 answers
490 views

AWS Athena generic internal error when querying a table Glue created because 'columns has 110 elements while columns. Types has 106 elements!'

This error happens to me anytime I try to query the 'airports' table in my database which was created by a glue crawler I created for this purpose along with 3 other datasets. They were all csv files ...
Marlen's user avatar
  • 227
0 votes
0 answers
132 views

Best way to proxy all PostgreSQL database requests through a single server

I am currently use AWS to host a number of EC2 instances and Container Services of which some connect to an RDS PostgreSQL database. We have recently been tasked to migrate all of our Database ...
realnsleo's user avatar
  • 115
0 votes
0 answers
298 views

Sudden momentary dips in aws rds free storage space available

I have been experiencing some sudden momentary dips in the available aws rds free storage space available. Once the free space dips it goes into the storage optimization mode. I have a postgres table ...
dev_998's user avatar
1 vote
0 answers
78 views

Persistent problems connecting MySQL Workbench to an AWS RDS DB

I started off my attempt to figure out how to connect my local MySQL Workbench (8.0.32) client/application to an RDS Database on my analytics team's AWS Account by asking Bing AI and this is what it ...
Marlen's user avatar
  • 227
0 votes
1 answer
769 views

New rows are locked by select on PostgreSQL replica

have a strange trouble with getting new rows on replica on PostgreSQL on AWS. I have master database on AWS with constant flow inserts/updates not with big rate. And these changes are replicated ...
SkyGame's user avatar
1 vote
0 answers
57 views

Postgres: copy from 2 different DBs for identical tables

I have two identical DBs, under the same port and host. (they both postgres DBs and on AWS) I want to create a script\write any query (even though it is not possible to create a query that use data ...
Dor Cohen's user avatar
0 votes
0 answers
85 views

Is there a way to export AWS RDS postgres snapshot to on-premise server?

I am working towards exporting a snapshot of RDS Postgres to S3 and pull it to on-premise server to cater to a requirement where I can run the database locally. Has anyone tried this before? and can ...
Hanish Arora's user avatar
0 votes
0 answers
106 views

Describe table from Athena data source in DataGrip fails

Whenever I attempt to Describe an AWS Athena table in DataGrip it fails. The error states that is is a permissions error but I am fairly certain it is not. In fact, I can describe tables using ...
Mattboy91's user avatar
2 votes
2 answers
351 views

Operational Error on MySQL AWS RDS Instance

The heading pretty much describes it all, here are some more information on the Amazon RDS I am using. Engine: MySQL Community 8.0.28 Class db.r6g.large Multi-AZ no. The data volume is very small, ...
Della's user avatar
  • 73
2 votes
1 answer
98 views

AWS to Azure Degraded Performance With "Hash Match (Aggregate) Step"/"Temporary Disk" TempDB Performance Issue

Ok, so I have a series of AWS VM's, mostly using the z1d.3xlarge server class with built in SQL Server 2019, these servers each contain a NVMe of various size. (Not surprisingly) I've placed my SQL ...
David Rogers's user avatar
0 votes
0 answers
22 views

Where clause in which the value of column2 changes based on column1

So I have a table which has State1: id column1 column2 1 myboolvalue false 1 myecogvalue 0 1 myintvalue 1700 State2 id column1 column2 1 myboolvalue true 1 myecogvalue 0 1 myintvalue 1700 In ...
user1472972's user avatar
0 votes
1 answer
153 views

RDS Postgres v14.4 CPU utilization not going below 5% when idle

I have an RDS Postgres instance on a t3.small and am trying to drive down the CPU usage of my clients connecting to it (I have a few API services connected). I've stopped all my services connecting to ...
PGT's user avatar
  • 101
1 vote
0 answers
77 views

Finding distance between 2 geospatial location in aws neptune with opencypher query language

I am working with amazon neptune and using openCypher query language and doing some stuff using notebook. I have latitude and longitude of 2 points and I want to calculate the distance between these 2 ...
Vishal Jamdade's user avatar
1 vote
0 answers
76 views

How to encrypt a production unencrypted RDS Aurora MySQL 8 cluster

I have a running RDS Aurora MySQL 8.0.23 cluster running in production. The database is unencrypted and I need to enable encryption for it. As far as I understand, this is not possible to do directly. ...
revy's user avatar
  • 111
1 vote
0 answers
147 views

Redshift User password change permission denied

Redshift user not able to change its own password getting below error: ALTER USER or_user WITH PASSWORD 'md5<hash>'; ERROR:permission denied Also tried granting 'ALTER USER' privileges using ...
Aadu's user avatar
  • 11
1 vote
0 answers
80 views

Restart a Running Sum after Static Threshold

I've been stuck trying to solve the following problem for some time: I essentially want to restart the rolling sum if the rolling sum exceeds 3600, else continue summing. I've sort of have it working ...
WhimsicalWhale's user avatar
1 vote
0 answers
27 views

Best practice to store subitems

I am going to create my first Dynamodb database table. I have 3 options in my mind: 1. Create a long table where every subitem is a new row. Example: user John | item 1 | 2021 user John | item 2 | ...
L777's user avatar
  • 111
3 votes
2 answers
877 views

Need to keep each binlog files to 24 hrs

We have a requirement that we need to keep each binlog files(like mysql-bin-changelog.025249, mysql-bin-changelog.025250, mysql-bin-changelog.025251....) of MYSQL RDS to minimum 24 hrs. However, i see ...
Sumant Kumar's user avatar
1 vote
0 answers
108 views

Backup data from RDS to S3 and delete from RDS once copied to S3

We have a requirement werein we have to backup data from RDS(MYSQL and Postgres) to S3 incrementally and to delete the already copied data from RDS. I thought of using aws data-pipeline for this, ...
Sumant Kumar's user avatar

1
2 3 4 5
10