Questions tagged [amazon-dms]

AWS Database Migration Service (AWS DMS)

Filter by
Sorted by
Tagged with
0
votes
0answers
35 views

Ideal CDC Latency for SQL Server Replication

I am seeking to understand what the ideal latency for an implementation of CDC in SQL Server Standard (2017) is. The latency I am referring to can be found from the sys.dm_cdc_log_scan_sessions DMV ...
0
votes
0answers
12 views

Why add secondary indices before AWS DMS CDC?

https://docs.aws.amazon.com/dms/latest/userguide/CHAP_BestPractices.html For a full load + CDC task, we recommend that you add secondary indexes before the CDC phase. Because AWS DMS uses logical ...
0
votes
0answers
10 views

How to skip DMS validation on records which are deleted in target DB in DMS task “full load + ongoing replication”?

Continuously I am running DMS task with "full load + on-going replication" and enabled "validation" as well. Replication is working as expected but validation is getting failed ...
0
votes
2answers
68 views

How does AWS DMS on-going replication works internally?

From the documentation it's mentioned that "DMS collects changes to the database logs using the database engine's native API" and replicates to target. But, I didn't see anywhere that, at ...
0
votes
0answers
10 views

How to validate source and target tables are sync or not in AWS DMS task ongoing replication?

I would like to know how to validate source and target database tables are in sync at some point of time with AWS DMS task type as "Full load, ongoing replication"? Source database Tables ...
0
votes
0answers
14 views

AWS DMS 'inventing' data rows?

I have been testing AWS' DMS for a while, considering a move from MySQL on EC2 to Aurora serverless, and I have observed several times that extra rows are inserted into certain tables; always the same ...
1
vote
0answers
88 views

How to modify the block size of my S3 parquet files that are being queried in Athena?

I read that adjusting the block size of the parquet files being queried with Athena can affect and possibly improve the performance of the queries. My parquet files for my database are currently ...
0
votes
1answer
34 views

Migrate Oracle 12c to 18c in AWS RDS

Currently we have an Amazon RDS Oracle 12c instance and we need to upgrade it to Oracle 18c in a new RDS instance. What is the correct approach to do this? Can we set up an 18c instance staright ...
0
votes
0answers
191 views

AWS DMS Log growth problem - SQL Server as Source

I have a problem using the AWS Database Migration Service for implementing a transactional replication from SQL Server as a source database engine, a help is highly appreciated. The 'safeguardPolicy' ...
0
votes
0answers
451 views

Postgresql v10.1 - How to fix ERROR: duplicate key value violates unique constraint

I'm not sure how this happened to this table but have an issue with ERROR: duplicate key value violates unique constraint trying to use AWS's DMS service to move a postgres v10.1 DB to RDS v10 The ...
0
votes
1answer
217 views

AWS DMS: 2 million CDCIncomingChanges resolved without target throughput

We're attempting to use AWS DMS to replicate MS-SQL to a customer's on-prem DB, and running into a confusing situation. At 13:00 UTC there are over 2 million CDCIncomingChanges, with CDCTargetLatency ...
2
votes
1answer
898 views

Do not replicate Delete operations AWS DMS

I am using AWS DMS to replicate ongoing changes with SQL Server as a source and target endpoint. The tasks are running and replicating data with low latency. However, I need the tasks configured not ...
0
votes
1answer
28 views

Redshift is missing in target database list of AWS SCT Schema Convertion Tool

I want to convert schema of SQL Server database to Amazon Redshift using AWS SCT tool But as target database, Redshift is not listed When I use PostgreSQL compatible with IP address of the cluster, ...
1
vote
0answers
3k views

AWS DMS Fails with “Command failed to load data with exit error code 1”

I am trying to Migrate my Postgresql RDS to Aurora Postgresql using DMS. All my tasks are failing, and I am unable to understand what can be done to help the tasks progress. The error from cloud ...
2
votes
1answer
85 views

AWS DMS - How to select different databases for source and target points for a task

Does aws DMS(Data Migration service) allow to select different databases for source and target points for a task in a replication instance? My source engine is MySQL. example: I want to move table A ...
2
votes
1answer
322 views

Replication from Amazon's RDS to Postgres via DMS errors out

I have a transactional replication from SQL Server 2008 to RDS SQL Server 2016 in 2014 compatibility mode. This works okay. I now want to replicate this RDS database via DMS to Postgresql. This errors ...
2
votes
2answers
3k views

Failure with ongoing replication from SQL Server RDS using AWS DMS

I'm trying to replicate from an SQL Server RDS database using DMS, and running into problems. I am able to load all data from one table into the destination (~1M rows) as a single 'Migrate existing ...
2
votes
1answer
5k views

AWS DMS endpoint test connection error

I am trying to migrate Microsoft SQL Server databases from on-premise to an RDS instance. I have created a SQL Server 2014 Express Edition instance in RDS and I have SQL Server 2014 Express Edition on ...
4
votes
1answer
2k views

Spike in AWS RDS Oldest Replication Slot lag

Does anyone know about this "Oldest Replication Slot Lag" in AWS RDS? What does it represent? I have a PostgreSQL instance on RDS (with Logical Replication switched on) for transferring data from ...
3
votes
1answer
731 views

Create event trigger as non-superuser in Postgres

Is it possible to give a role or a set of attributes to a non-superuser in postgres that would allow the user to create an EVENT TRIGGER? Simple example of what (obviously) doesn't work in psql: =&...
1
vote
1answer
273 views

Why did the data type of my DB change?

I had PostgreSQL installation in an EC2 instance. I wanted to migrate to RDS and thus used the DMS service. However, I later came to realize that the data type of the columns have been changed. The ...
7
votes
2answers
4k views

AWS DMS creates tables with no auto_increment

I am migrating my databases to Amazon's RDS using their DMS tool. Pretty much everything looks great except that columns that were marked as auto_increment on the source database did not get marked ...