Questions tagged [data-synchronization]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
0
votes
1answer
502 views

PostgreSQL warm standby: sync WAL files

I'm new to PostgreSQL (using ver 8.4.20) and need to setup a master and standby SQL server setup. I am planning to use warm standby setup. I have read the docs on PG and understand the basics, but a ...
0
votes
1answer
41 views

SQL transaction: Delete between two selects possible?

I have two SELECT statements within a transaction (repeatable read) Select @firstItem =id from myTable Where .... --Do some more magic, so I can't concat the the two queries!!!! and Select * from ...
0
votes
2answers
53 views

Sync database table schema and stored procedures

We have 2 databases. One is at our server, the other is local. We need to sync them both in a manner that local database has all data and server database has no data only empty tables and stored ...
0
votes
0answers
17 views

Database synchronization 2 times a day -MariaDB

I have 2 different servers. The first one is server1 and the other is server2. On servers, one works for websites (server1) and the other for mobile applications (server2) for security purposes. I ...
1
vote
1answer
168 views

Partial SQL Server database synchronization

I have 2 SQL Server databases and they have somewhat different schemas. But there is a table with person attributes. Name, address, city, email, etc... And an account key. on both tables. Can SQL ...
4
votes
1answer
996 views

MongoDB can't add new replica set member [rsSync] SEVERE: Got signal: 6

I have a replica set and I added a new member to the set. The initialSync begins for the new member and rs.status (on primary) shows STARTUP2 as status. However, after a long enough time, there's a ...
3
votes
2answers
1k views

Syncronize mysql databases between local and hosted servers automatically

We have many websites with Development, Staging and Production servers. We have many developers for many projects. We need a solution to synchronize the developer and staging databases. After that one ...
0
votes
1answer
25 views

Add a new node to Mongo Replicaset using Rsync

I have a 3 shard mongo cluster. Each shard has a 3 node replica set. On each shard, the data size is 3 TB. I want to add 1 more node to each replica set. But its taking lot of time. The initial sync ...
0
votes
3answers
468 views

Move large mysql table data from one server to another

I have a table to which millions of data are inserted every day. As the table size grows more than 10 GB, I have issues with the performance of server in fetching apis and generating reports, which ...
0
votes
0answers
39 views

Azure SQL Data Sync: How to Increase Synchronisation speed after bulk purge/update in Azure SQL Data Sync Service?

I have two tables across two regions in Azure SQL Databases. There is a Bi-directional Data Sync configured between those two databases with automatic frequency of 15 minutes and conflict resolution ...
0
votes
1answer
34 views

Change Data Capture in MySQL/PHP by writing to a MySQL table (rather than streaming to Kafka/Rabbit/etc)?

I have a small internal web app I'm developing with PHP and MySQL. I'm looking to sync client webpages to a server by requesting all changes since a certain date. I've found a number of solutions ...
0
votes
1answer
86 views

ADD new node Replication in MongoDB

Here i found some trouble. and i don't known why! Now I have one replication with 3 members (1 of primary, 2 of secondary), And i want to add another one (secondary) to sync the data. the data has ...
0
votes
0answers
7 views

Elastic search data synchronization with different databases

We are using elastic search hosted in AWS for apps wide search in our organization. We had initially dumped our existing data using logstash. However, we are struck at keeping the Elastic DB in sync ...
0
votes
3answers
80 views

Sync between two database on azure

I would like to ask a question how to setup azure syncing of two database on azure i need real time data replication to the other database
1
vote
2answers
55 views

Automating Redshift data dump to a PostgreSQL DB every hour

GIS analyst with minimal experience of this back-end stuff but a big task at hand. I have a redshift database that changes multiple times a day. I want to use this "live" data to make web maps and I ...
0
votes
1answer
27 views

Load data from a temporal table to another temporal table in Azure

Currently we have only a Live Database where all our data resides. I have created a separate Azure server and DB for development. The DEV DB should be some what up to date with the Live DB for ...
0
votes
1answer
201 views

Selective synchronization between distributed clusters

What's the best practice for the following scenario: I've an embeded device with a single, lightweight database; a powerful server with a cluster; a cluster in the cloud. I'd like to synchronize the ...
0
votes
1answer
176 views

SQL Server 2012 AlwaysOn Availability Group

We have an application that needs access to the database all the time to work properly and we are planning on deploying SQL Server 2012 AlwaysOn Availability Groups on Windows Server 2012. We have ...
0
votes
2answers
237 views

Local and cloud database sync missing data only

We have set up an IOT device which records a lot of data. This data always makes it into the local gateway mysql database, and if there is an internet connection then it also goes into the cloud ...
0
votes
1answer
61 views

Master Master replication rows not sync properly

I have a wordpress website that run on 3 machines Machine1 | Machine 2 {nginx+lsyncd+mysql} visitor > cloudflare > haproxy ------ ...
4
votes
1answer
5k views

Sync postgreSQL with SQL Server database- on data change event

I have one PostgreSQL database and its data are being changed regularly. I want to sync all its data with my SQL Server database. One thing I can do is use query to check all required tables and ...
3
votes
2answers
3k views

MySQL Master-Master Replication not syncing

SETUP: I have a WAMP MySQL Master-Master replication setup on 2 machines with sync_binlog=1 for safety. Machine config: Windows Azure Standard 2: 2 core, 4GB RAM, Windows Server 2008, MySQL 5.6.12, ...
0
votes
0answers
139 views

Sync PostgreSQL with Cloud and multi Local Locations

I need help with a complex (for me) multi server setup with PostgreSQL. I have to setup a Cloud Server and 3 Local Servers for our company. Each Server will have: Linux Ubuntu 16.04 Docker ...
0
votes
0answers
871 views

SQL Server 2016 Availability Group (Primary Unable to Read/Write)

We have a 3 replica SQL Server 2016 availability group. When the secondary synchronous goes unhealthy the database that resides on the primary becomes unreadable / unwritable, at this time the primary ...
0
votes
1answer
41 views

MySQL synchronization

I have a cloud-based MySQL instance (slave) and am planning a solution where a remote instance (master) will be based on a ship. The ship will go in and out of international waters and therefore will ...
0
votes
1answer
25 views

Tools to ingest data to database in periods [closed]

We have an application that can work with Oracle or MySql or SQLServer databases. Also, there is a 3rd party data source that we need to have it's latest data records in our database every 15 minutes. ...
0
votes
2answers
330 views

Sync two postgres databases from two sperate locations with no network

I have 2 postgres databases running the same schemes on two different computers, that are not guaranteed to have any network connection while having to handle read/write requests. Because they ...
0
votes
1answer
46 views

How to insert data from a local MSSQL db table to a remote MSSQL db table using WCF application coded in .NET [closed]

I made a WPF application using VS2013, coded in .NET. It is working fine in my local SQL Server. But I want to use it to upload data from a local database to a remote database. How can I do this? I ...
0
votes
1answer
19 views

Archival copy of table, including overwrote data [closed]

I have database server, with a database and table. The database and table can not be changed by me to ensure 3rd party support but the server configuration and MySQL configuration can be. On that ...
0
votes
1answer
177 views

MySQL slave only views

We are kind of struggling while creating the infrastructure for our BI sector. I had read on this link that it is possible to create views on a read-only slave. Still, when I run the query I get "...
2
votes
1answer
2k views

How to Sync a MySQL DB with a Oracle DB?

I have access from 5 views of an Oracle DB located outside of my organization. I need to sync my db that is a mySQL DB with the oracle DB (Oracle views will be the master, my db will be the slave). I ...
17
votes
4answers
108k views

Sync two MySQL databases in two different locations

I have two identical MySQL databases one in an internal server and the other in a web hosting server. I want to update the database on the web host each day with the database on the internal server. ...
1
vote
1answer
23 views

Backup weekly current production db to Historical db server [closed]

I have a production sql db of 600gb and a historical server where i move the full db every month. Now we want to have only the last 3 months information on the production server, and move every week ...
0
votes
2answers
64 views

Synchronize SQL server databases

We have the following scenario: We have several SQL serves instances in distributed geographic areas (distributed buildings) (in a city or maybe globally) All the SQL servers run one snapshot of a ...
1
vote
1answer
108 views

Problems of having DR as Synchronous Commit

In our always on set up we have One Primary and One Secondary as Synchronous Commit and the DR as asynchronous commit. If i want to change the DR to Synchronous Commit will there be any performance ...
1
vote
3answers
462 views

Mysql master-master: single table out of sync

I have a master-master MySQL 5.7, everything works fine except for one error which is rising from time to time. If I run a show slave status\G on server2 I have an error on a table: ... Last_Errno: ...
0
votes
1answer
33 views

Failover from Primary to Asyn Secondary Replica

In my environment we have 1 Primary 1 Synchornous Secondary and 1 Asynchronous Secondary Replica (Off site). We are planning to do a manual failover to the Asynchronous Secondary Replica (Off site) ...
0
votes
1answer
18 views

Regularly clone/backup 2 MySQL databases unidirectionally from PC to Laptop both running Windows

I have a PC running Windows XP with a custom ERP system and MySQL Server 4.x (A) and a Laptop running Windows 10, same MySQL 4.x and same custom ERP (B). I'm afraid I can't upgrade PC nor MySQL, etc. ...
5
votes
1answer
3k views

Very slow merge replication synchronization

I had an unforeseen issue with a sub going down (generic error, was probably a connection issue) and now that I've reconnected the sub it is insanely slow re-syncing. It seems to download about 1000 ...
2
votes
1answer
766 views

Efficient join technique for two very large tables

I am working on a concept for database synchronization recently. The scenario is as follows: there is a master table "Items" with 1M+ rows in it CREATE TABLE [dbo].[Item]( [Id] [...
2
votes
0answers
67 views

Replacing full contents of SQL tables without user disruptions

I have a SQL Express 2012 DB in which there are tables that need frequent full "refreshs" (on-hours) from an external source without any disruption of the users. Let's say the tables are Item, ...
0
votes
0answers
83 views

MariaDB galera cluster with Mroonga in wrapper mode doesn't synch

MariaDB Galera Cluster states that the storage engine needs to be InnoDB. I am using Mroonga on some tables in wrapper mode {which uses InnoDB under the hood as storage engine}. The problem I am ...
0
votes
2answers
39 views

Keeping database in synch

This might seem like a stupid question. Can i restore logs of one database to another existing database of same schema.? I have a database d1 in Server A.I took backup of that and restored as ...
3
votes
1answer
953 views

Live Database Sync. MySQL - SQL Server [closed]

I have a rare scenario. Is there any possibility to achieve the target? Here is the situation: I have developed a responsive site for a supermarket. I am using php with foundation framework and the ...
0
votes
1answer
26 views

Get updated rows without triggers or timestamps

I'm working on a project with a client. The client has a MySQL Database with a few large tables (~100 million records each). I've pulled the initial data. I am required to sync the client's database ...
1
vote
2answers
52 views

Aggregating high volumes of data from many MySQL servers

I have 4 servers of MySQL, each receives around 4 million records a day. I need to aggregate all the inserted records into another main server after doing some mapping processing to the aggregated ...
1
vote
1answer
1k views

Syncing data from primary member to secondary after election

Maybe this is kind a stupid question but, I'm novice in configuring replication and I need to clear something before makeing anything else. Moment ago I configured replica set with 3 members in it. ...
1
vote
0answers
470 views

SQL Server One Way Data Synchronization

I have 2 SQL Server Databases A and B, and I want to synchronize (continuously, every 10 minutes, max) the data from 70-80% percent of the tables from A to B (just A -> B, B is a read only database), ...
0
votes
1answer
190 views

How to prevent data loss during intra-site failover

We are looking to build a MS SQL server (either SQL server 2016 standard or enterprise edition) solution but are having some troubles. This post can be lengthy and if you think it is TLDR, our ...
1
vote
0answers
75 views

Synchronisation of multiple databases with GUID type

I have two databases. One is on mobile and uses SQLite and another one is on Microsoft azure. I want to sync data in both directions. Sometimes some data is saved on azure db and should be ...