Questions tagged [amazon-dms]

AWS Database Migration Service (AWS DMS)

Filter by
Sorted by
Tagged with
0
votes
0answers
50 views

What does MISSING_TARGET means on Amazon DMS (Database Migration Service) validation?

I'm running Amazon DMS from RDS to Aurora, the error when full restarting (never been successful before) from awsdms_validation_failures_v1 tables are: [ { "TASK_NAME": "...
0
votes
0answers
8 views

How to connect Oracle from AWS DMS by Terraform?

If use oracle source endpoint for DB migration on AWS DMS, we only have service name, but can't set it by terraform's aws_dms_endpint, is there a way to connect? resource "aws_dms_endpoint" &...
0
votes
0answers
100 views

AWS DMS Task failed with error: Error executing source loop; Stream component failed at subtask 0

I want to migrate my PostgresDB hosted in Citus cloud service to AWS RDS Aurora Postgres. I am using AWS DMS service. Have created task but getting following errors: Last failure message Last Error ...
0
votes
1answer
36 views

How to set PostgreSQL's permission when migrate other database to it on AWS?

We want to migrate an Oracle DB to a PostgreSQL DB in RDS with DMS. There is an official guide for preparision in the PostgreSQL's DB: https://docs.aws.amazon.com/dms/latest/sbs/chap-oracle2postgresql....
0
votes
0answers
54 views

Continous data replication between two databases(same RDS instance) in AWS RDS

We have multiple databases in a single RDS instance. Forex A, B, C A and B DB contains the plans table. But some of the fields will be missing under the plans table in B DB. What is the smart way to ...
0
votes
0answers
29 views

Timestamp is off by an hour When Migrating from Mysql to Sql server AWS DMS

We are trying to migrate a MySQL database on AWS RDS to SQL Server Database on AWS. Both the Source and Target Database are created in PST Time zone. Replication Instance Version : 3.4.4 Mysql Version:...
0
votes
0answers
161 views

AWS DMS migration not migrated Foreign keys, sequences and indexes got renamed

I have used DMS for AURORA PostgreSQL to PostgreSQL SCHEMA Migration. Migrate Data only type is used for DMS activity. After a Full load of Data, all tables were created on the target endpoint with ...
0
votes
0answers
114 views

Ideal CDC Latency for SQL Server Replication

I am seeking to understand what the ideal latency for an implementation of CDC in SQL Server Standard (2017) is. The latency I am referring to can be found from the sys.dm_cdc_log_scan_sessions DMV ...
0
votes
0answers
57 views

Why add secondary indices before AWS DMS CDC?

https://docs.aws.amazon.com/dms/latest/userguide/CHAP_BestPractices.html For a full load + CDC task, we recommend that you add secondary indexes before the CDC phase. Because AWS DMS uses logical ...
1
vote
2answers
475 views

How does AWS DMS on-going replication works internally?

From the documentation it's mentioned that "DMS collects changes to the database logs using the database engine's native API" and replicates to target. But, I didn't see anywhere that, at ...
1
vote
0answers
147 views

How to modify the block size of my S3 parquet files that are being queried in Athena?

I read that adjusting the block size of the parquet files being queried with Athena can affect and possibly improve the performance of the queries. My parquet files for my database are currently ...
0
votes
1answer
40 views

Migrate Oracle 12c to 18c in AWS RDS

Currently we have an Amazon RDS Oracle 12c instance and we need to upgrade it to Oracle 18c in a new RDS instance. What is the correct approach to do this? Can we set up an 18c instance staright ...
0
votes
0answers
376 views

AWS DMS Log growth problem - SQL Server as Source

I have a problem using the AWS Database Migration Service for implementing a transactional replication from SQL Server as a source database engine, a help is highly appreciated. The 'safeguardPolicy' ...
0
votes
0answers
815 views

Postgresql v10.1 - How to fix ERROR: duplicate key value violates unique constraint

I'm not sure how this happened to this table but have an issue with ERROR: duplicate key value violates unique constraint trying to use AWS's DMS service to move a postgres v10.1 DB to RDS v10 The ...
0
votes
1answer
361 views

AWS DMS: 2 million CDCIncomingChanges resolved without target throughput

We're attempting to use AWS DMS to replicate MS-SQL to a customer's on-prem DB, and running into a confusing situation. At 13:00 UTC there are over 2 million CDCIncomingChanges, with CDCTargetLatency ...
2
votes
1answer
2k views

Do not replicate Delete operations AWS DMS

I am using AWS DMS to replicate ongoing changes with SQL Server as a source and target endpoint. The tasks are running and replicating data with low latency. However, I need the tasks configured not ...
0
votes
1answer
40 views

Redshift is missing in target database list of AWS SCT Schema Convertion Tool

I want to convert schema of SQL Server database to Amazon Redshift using AWS SCT tool But as target database, Redshift is not listed When I use PostgreSQL compatible with IP address of the cluster, ...
1
vote
0answers
4k views

AWS DMS Fails with "Command failed to load data with exit error code 1"

I am trying to Migrate my Postgresql RDS to Aurora Postgresql using DMS. All my tasks are failing, and I am unable to understand what can be done to help the tasks progress. The error from cloud ...
2
votes
1answer
131 views

AWS DMS - How to select different databases for source and target points for a task

Does aws DMS(Data Migration service) allow to select different databases for source and target points for a task in a replication instance? My source engine is MySQL. example: I want to move table A ...
2
votes
1answer
360 views

Replication from Amazon's RDS to Postgres via DMS errors out

I have a transactional replication from SQL Server 2008 to RDS SQL Server 2016 in 2014 compatibility mode. This works okay. I now want to replicate this RDS database via DMS to Postgresql. This errors ...
2
votes
2answers
4k views

Failure with ongoing replication from SQL Server RDS using AWS DMS

I'm trying to replicate from an SQL Server RDS database using DMS, and running into problems. I am able to load all data from one table into the destination (~1M rows) as a single 'Migrate existing ...
2
votes
1answer
5k views

AWS DMS endpoint test connection error

I am trying to migrate Microsoft SQL Server databases from on-premise to an RDS instance. I have created a SQL Server 2014 Express Edition instance in RDS and I have SQL Server 2014 Express Edition on ...
4
votes
1answer
3k views

Spike in AWS RDS Oldest Replication Slot lag

Does anyone know about this "Oldest Replication Slot Lag" in AWS RDS? What does it represent? I have a PostgreSQL instance on RDS (with Logical Replication switched on) for transferring data from ...
4
votes
1answer
1k views

Create event trigger as non-superuser in Postgres

Is it possible to give a role or a set of attributes to a non-superuser in postgres that would allow the user to create an EVENT TRIGGER? Simple example of what (obviously) doesn't work in psql: =&...
1
vote
1answer
322 views

Why did the data type of my DB change?

I had PostgreSQL installation in an EC2 instance. I wanted to migrate to RDS and thus used the DMS service. However, I later came to realize that the data type of the columns have been changed. The ...
7
votes
2answers
5k views

AWS DMS creates tables with no auto_increment

I am migrating my databases to Amazon's RDS using their DMS tool. Pretty much everything looks great except that columns that were marked as auto_increment on the source database did not get marked ...