Database Administrators

Questions tagged [data-synchronization]

Ask Question

The tag has no usage guidance.

174 questions
Newest
Active
Bountied
Unanswered
Filter by
Sorted by
Tagged with
0
votes
2answers
48 views

what are the best ways to sync two databases in sql server or azure sql db?

I have a question like syncing two different databases available on two different servers/instances. lets say Source be the source server and sourcedb is the source database. destinationdb is the ...
0
votes
1answer
30 views

How to resynchronize replica in Postgresql

I have a server with Centos6 and Postgresql 9.2, I have set up a replica in postgresql to another server of the same characteristics, today in the morning I have an error in the archiver process on ...
0
votes
0answers
9 views

Merge Replication not deleting unmatched filter rows from Subscriber Database

I have applied filters on articles in SQL Merge Replication and syncing the data using MergeSynchronizationAgent via Web Synchronization. The data is syncing as per the applied filters from publisher ...
0
votes
1answer
48 views

Will a MERGE between two tables ever be faster than a DROP and SELECT INTO on the second table?

Is there a scenario where it's faster for synchronizing the data from TableA to TableB by using a MERGE query as opposed to dropping TableB and doing a SELECT * INTO TableB FROM TableA?
1
vote
2answers
39 views

For AlwaysOn AGs, can a secondary replica cause contention on the primary when the resources of the secondary are maxed out?

Is it possible and in what ways can the secondary replica cause contention against the primary replica when the secondary replica's resources are maxed out (e.g. does the primary "lock" up while ...
0
votes
1answer
28 views

How to use a MySQL database both remotely and locally

I cannot find the best solution for my problem. I made a C++ application which runs on a Kiosk under Ubuntu that needs to store and retrieve data from a MySQL database and these same data need to be ...
0
votes
0answers
34 views

Data replication between Oracle and Postgres

Is there a way to replicate the DML changes that happen in a Postgres table into a table in Oracle database? My Postgres database is RDS in AWS environment. So I am unable to use the extension ...
7
votes
1answer
242 views

Is there a way to determine what kind of data is sitting in the Redo Queue for an AlwaysOn AG Secondary Replica?

Do any of the DMVs or is there another way to expose what kind of data is in the Redo Queue that's in process of being synced up to a secondary replica? (E.g. is it table data and which table, or is ...
2
votes
1answer
140 views

What's the cause for an AlwaysOn AG Secondary Replica to have a high Redo Queue Size and Estimated Recovery Time with a good Redo Rate?

SQL14 is the Primary server, SQL16 is the Secondary Replica, and they're setup using synchronous commit availability mode: As of yesterday it appeared that data stopped synchronizing from the primary ...
1
vote
1answer
22 views

How would I maintain referential integrity across a database where I use versioned records while keeping data in sync?

I am building a database that consists of a few tables that are used as data sources for a form our application generates. [form] [question] [responses] id id id name ...
0
votes
0answers
37 views

Options for syncing from a MASTER table to a COPY table?

I have a MASTER table and a COPY table in separate databases (both are Oracle 12c). I want to sync the MASTER table with the COPY table on a weekly basis. I can think of a few options for syncing ...
0
votes
1answer
26 views

Any way of forcing MySQL to use smaller files?

This is actually Maria DB. I'm using it on W10 and Linux Mint 18.3. The issue here is that I recently strated to use Google Backup & Sync to sync between my various machines running W10 (I'm ...
0
votes
1answer
59 views

Best way to replicate MySQL database tables

I'm trying to wrap my head around the many options on how to possibly sync database tables automatically from one database to the next (and next, and next, ...). We're trying to create a very simple ...
0
votes
3answers
116 views

Integration: Keep two systems in sync

I have a GIS system with 40 tables, ranging from 1,000 to 60,000 rows per table. The tables are the system of record for assets in a municipality. The GIS assets in the tables get integrated to a ...
1
vote
0answers
28 views

SQL Server Merge Replication Error: The format of a message during Web synchronization was invalid

I am doing Merge Replication using Web Synchronization. On Subscriber end, there is SQL Express 2012 on Windows 10 Pro. On publisher end, there is SQL Server 2016 on Windows Server 2016. Web ...
0
votes
1answer
45 views

SQL transaction: Delete between two selects possible?

I have two SELECT statements within a transaction (repeatable read) Select @firstItem =id from myTable Where .... --Do some more magic, so I can't concat the the two queries!!!! and Select * from ...
0
votes
2answers
68 views

Sync database table schema and stored procedures

We have 2 databases. One is at our server, the other is local. We need to sync them both in a manner that local database has all data and server database has no data only empty tables and stored ...
0
votes
0answers
25 views

Database synchronization 2 times a day -MariaDB

I have 2 different servers. The first one is server1 and the other is server2. On servers, one works for websites (server1) and the other for mobile applications (server2) for security purposes. I ...
0
votes
1answer
87 views

Add a new node to Mongo Replicaset using Rsync

I have a 3 shard mongo cluster. Each shard has a 3 node replica set. On each shard, the data size is 3 TB. I want to add 1 more node to each replica set. But its taking lot of time. The initial sync ...
0
votes
0answers
87 views

Azure SQL Data Sync: How to Increase Synchronisation speed after bulk purge/update in Azure SQL Data Sync Service?

I have two tables across two regions in Azure SQL Databases. There is a Bi-directional Data Sync configured between those two databases with automatic frequency of 15 minutes and conflict resolution ...
0
votes
1answer
108 views

Change Data Capture in MySQL/PHP by writing to a MySQL table (rather than streaming to Kafka/Rabbit/etc)?

I have a small internal web app I'm developing with PHP and MySQL. I'm looking to sync client webpages to a server by requesting all changes since a certain date. I've found a number of solutions ...
0
votes
0answers
9 views

Elastic search data synchronization with different databases

We are using elastic search hosted in AWS for apps wide search in our organization. We had initially dumped our existing data using logstash. However, we are struck at keeping the Elastic DB in sync ...
0
votes
3answers
424 views

Sync between two database on azure

I would like to ask a question how to setup azure syncing of two database on azure i need real time data replication to the other database
0
votes
1answer
41 views

Load data from a temporal table to another temporal table in Azure

Currently we have only a Live Database where all our data resides. I have created a separate Azure server and DB for development. The DEV DB should be some what up to date with the Live DB for ...
0
votes
1answer
68 views

Master Master replication rows not sync properly

I have a wordpress website that run on 3 machines Machine1 | Machine 2 {nginx+lsyncd+mysql} visitor > cloudflare > haproxy ------ ...
0
votes
0answers
187 views

Sync PostgreSQL with Cloud and multi Local Locations

I need help with a complex (for me) multi server setup with PostgreSQL. I have to setup a Cloud Server and 3 Local Servers for our company. Each Server will have: Linux Ubuntu 16.04 Docker ...
0
votes
0answers
2k views

SQL Server 2016 Availability Group (Primary Unable to Read/Write)

We have a 3 replica SQL Server 2016 availability group. When the secondary synchronous goes unhealthy the database that resides on the primary becomes unreadable / unwritable, at this time the primary ...
0
votes
1answer
91 views

MySQL synchronization

I have a cloud-based MySQL instance (slave) and am planning a solution where a remote instance (master) will be based on a ship. The ship will go in and out of international waters and therefore will ...
0
votes
1answer
26 views

Tools to ingest data to database in periods [closed]

We have an application that can work with Oracle or MySql or SQLServer databases. Also, there is a 3rd party data source that we need to have it's latest data records in our database every 15 minutes. ...
1
vote
2answers
673 views

Sync two postgres databases from two sperate locations with no network

I have 2 postgres databases running the same schemes on two different computers, that are not guaranteed to have any network connection while having to handle read/write requests. Because they ...
0
votes
1answer
69 views

How to insert data from a local MSSQL db table to a remote MSSQL db table using WCF application coded in .NET [closed]

I made a WPF application using VS2013, coded in .NET. It is working fine in my local SQL Server. But I want to use it to upload data from a local database to a remote database. How can I do this? I ...
0
votes
1answer
19 views

Archival copy of table, including overwrote data [closed]

I have database server, with a database and table. The database and table can not be changed by me to ensure 3rd party support but the server configuration and MySQL configuration can be. On that ...
0
votes
1answer
201 views

MySQL slave only views

We are kind of struggling while creating the infrastructure for our BI sector. I had read on this link that it is possible to create views on a read-only slave. Still, when I run the query I get "...
1
vote
1answer
25 views

Backup weekly current production db to Historical db server [closed]

I have a production sql db of 600gb and a historical server where i move the full db every month. Now we want to have only the last 3 months information on the production server, and move every week ...
1
vote
2answers
71 views

Automating Redshift data dump to a PostgreSQL DB every hour

GIS analyst with minimal experience of this back-end stuff but a big task at hand. I have a redshift database that changes multiple times a day. I want to use this "live" data to make web maps and I ...
0
votes
2answers
73 views

Synchronize SQL server databases

We have the following scenario: We have several SQL serves instances in distributed geographic areas (distributed buildings) (in a city or maybe globally) All the SQL servers run one snapshot of a ...
1
vote
1answer
121 views

Problems of having DR as Synchronous Commit

In our always on set up we have One Primary and One Secondary as Synchronous Commit and the DR as asynchronous commit. If i want to change the DR to Synchronous Commit will there be any performance ...
1
vote
3answers
599 views

Mysql master-master: single table out of sync

I have a master-master MySQL 5.7, everything works fine except for one error which is rising from time to time. If I run a show slave status\G on server2 I have an error on a table: ... Last_Errno: ...
0
votes
1answer
33 views

Failover from Primary to Asyn Secondary Replica

In my environment we have 1 Primary 1 Synchornous Secondary and 1 Asynchronous Secondary Replica (Off site). We are planning to do a manual failover to the Asynchronous Secondary Replica (Off site) ...
2
votes
0answers
71 views

Replacing full contents of SQL tables without user disruptions

I have a SQL Express 2012 DB in which there are tables that need frequent full "refreshs" (on-hours) from an external source without any disruption of the users. Let's say the tables are Item, ...
2
votes
1answer
1k views

Efficient join technique for two very large tables

I am working on a concept for database synchronization recently. The scenario is as follows: there is a master table "Items" with 1M+ rows in it CREATE TABLE [dbo].[Item]( [Id] [...
0
votes
0answers
94 views

MariaDB galera cluster with Mroonga in wrapper mode doesn't synch

MariaDB Galera Cluster states that the storage engine needs to be InnoDB. I am using Mroonga on some tables in wrapper mode {which uses InnoDB under the hood as storage engine}. The problem I am ...
0
votes
2answers
40 views

Keeping database in synch

This might seem like a stupid question. Can i restore logs of one database to another existing database of same schema.? I have a database d1 in Server A.I took backup of that and restored as ...
0
votes
1answer
26 views

Get updated rows without triggers or timestamps

I'm working on a project with a client. The client has a MySQL Database with a few large tables (~100 million records each). I've pulled the initial data. I am required to sync the client's database ...
0
votes
1answer
106 views

ADD new node Replication in MongoDB

Here i found some trouble. and i don't known why! Now I have one replication with 3 members (1 of primary, 2 of secondary), And i want to add another one (secondary) to sync the data. the data has ...
0
votes
1answer
18 views

Regularly clone/backup 2 MySQL databases unidirectionally from PC to Laptop both running Windows

I have a PC running Windows XP with a custom ERP system and MySQL Server 4.x (A) and a Laptop running Windows 10, same MySQL 4.x and same custom ERP (B). I'm afraid I can't upgrade PC nor MySQL, etc. ...
1
vote
2answers
62 views

Aggregating high volumes of data from many MySQL servers

I have 4 servers of MySQL, each receives around 4 million records a day. I need to aggregate all the inserted records into another main server after doing some mapping processing to the aggregated ...
1
vote
0answers
574 views

SQL Server One Way Data Synchronization

I have 2 SQL Server Databases A and B, and I want to synchronize (continuously, every 10 minutes, max) the data from 70-80% percent of the tables from A to B (just A -> B, B is a read only database), ...
0
votes
1answer
226 views

How to prevent data loss during intra-site failover

We are looking to build a MS SQL server (either SQL server 2016 standard or enterprise edition) solution but are having some troubles. This post can be lengthy and if you think it is TLDR, our ...
1
vote
0answers
89 views

Synchronisation of multiple databases with GUID type

I have two databases. One is on mobile and uses SQLite and another one is on Microsoft azure. I want to sync data in both directions. Sometimes some data is saved on azure db and should be ...

1 2 3 4