Stack Exchange Network

Stack Exchange network consists of 175 Q&A communities including Stack Overflow, the largest, most trusted online community for developers to learn, share their knowledge, and build their careers.

Visit Stack Exchange

Questions tagged [data-synchronization]

The tag has no usage guidance.

0
votes
1answer
391 views

PostgreSQL warm standby: sync WAL files

I'm new to PostgreSQL (using ver 8.4.20) and need to setup a master and standby SQL server setup. I am planning to use warm standby setup. I have read the docs on PG and understand the basics, but a ...
0
votes
1answer
42 views

Master Master replication rows not sync properly

I have a wordpress website that run on 3 machines Machine1 | Machine 2 {nginx+lsyncd+mysql} visitor > cloudflare > haproxy ------ ...
3
votes
1answer
5k views

Sync postgreSQL with SQL Server database- on data change event

I have one PostgreSQL database and its data are being changed regularly. I want to sync all its data with my SQL Server database. One thing I can do is use query to check all required tables and ...
0
votes
3answers
387 views

Move large mysql table data from one server to another

I have a table to which millions of data are inserted every day. As the table size grows more than 10 GB, I have issues with the performance of server in fetching apis and generating reports, which ...
3
votes
2answers
1k views

Syncronize mysql databases between local and hosted servers automatically

We have many websites with Development, Staging and Production servers. We have many developers for many projects. We need a solution to synchronize the developer and staging databases. After that one ...
3
votes
1answer
962 views

MongoDB can't add new replica set member [rsSync] SEVERE: Got signal: 6

I have a replica set and I added a new member to the set. The initialSync begins for the new member and rs.status (on primary) shows STARTUP2 as status. However, after a long enough time, there's a ...
3
votes
2answers
3k views

MySQL Master-Master Replication not syncing

SETUP: I have a WAMP MySQL Master-Master replication setup on 2 machines with sync_binlog=1 for safety. Machine config: Windows Azure Standard 2: 2 core, 4GB RAM, Windows Server 2008, MySQL 5.6.12, ...
0
votes
0answers
54 views

Sync PostgreSQL with Cloud and multi Local Locations

I need help with a complex (for me) multi server setup with PostgreSQL. I have to setup a Cloud Server and 3 Local Servers for our company. Each Server will have: Linux Ubuntu 16.04 Docker ...
0
votes
0answers
275 views

SQL Server 2016 Availability Group (Primary Unable to Read/Write)

We have a 3 replica SQL Server 2016 availability group. When the secondary synchronous goes unhealthy the database that resides on the primary becomes unreadable / unwritable, at this time the primary ...
0
votes
1answer
164 views

Selective synchronization between distributed clusters

What's the best practice for the following scenario: I've an embeded device with a single, lightweight database; a powerful server with a cluster; a cluster in the cloud. I'd like to synchronize the ...
0
votes
1answer
164 views

SQL Server 2012 AlwaysOn Availability Group

We have an application that needs access to the database all the time to work properly and we are planning on deploying SQL Server 2012 AlwaysOn Availability Groups on Windows Server 2012. We have ...
0
votes
1answer
18 views

MySQL synchronization

I have a cloud-based MySQL instance (slave) and am planning a solution where a remote instance (master) will be based on a ship. The ship will go in and out of international waters and therefore will ...
0
votes
2answers
213 views

Local and cloud database sync missing data only

We have set up an IOT device which records a lot of data. This data always makes it into the local gateway mysql database, and if there is an internet connection then it also goes into the cloud ...
0
votes
1answer
23 views

Tools to ingest data to database in periods [closed]

We have an application that can work with Oracle or MySql or SQLServer databases. Also, there is a 3rd party data source that we need to have it's latest data records in our database every 15 minutes. ...
0
votes
2answers
86 views

Sync two postgres databases from two sperate locations with no network

I have 2 postgres databases running the same schemes on two different computers, that are not guaranteed to have any network connection while having to handle read/write requests. Because they ...
0
votes
1answer
43 views

How to insert data from a local MSSQL db table to a remote MSSQL db table using WCF application coded in .NET [closed]

I made a WPF application using VS2013, coded in .NET. It is working fine in my local SQL Server. But I want to use it to upload data from a local database to a remote database. How can I do this? I ...
0
votes
1answer
19 views

Archival copy of table, including overwrote data [closed]

I have database server, with a database and table. The database and table can not be changed by me to ensure 3rd party support but the server configuration and MySQL configuration can be. On that ...
0
votes
1answer
126 views

MySQL slave only views

We are kind of struggling while creating the infrastructure for our BI sector. I had read on this link that it is possible to create views on a read-only slave. Still, when I run the query I get "...
1
vote
1answer
46 views

Automating Redshift data dump to a PostgreSQL DB every hour

GIS analyst with minimal experience of this back-end stuff but a big task at hand. I have a redshift database that changes multiple times a day. I want to use this "live" data to make web maps and I ...
2
votes
1answer
2k views

How to Sync a MySQL DB with a Oracle DB?

I have access from 5 views of an Oracle DB located outside of my organization. I need to sync my db that is a mySQL DB with the oracle DB (Oracle views will be the master, my db will be the slave). I ...
16
votes
4answers
98k views

Sync two MySQL databases in two different locations

I have two identical MySQL databases one in an internal server and the other in a web hosting server. I want to update the database on the web host each day with the database on the internal server. ...
1
vote
1answer
22 views

Backup weekly current production db to Historical db server [closed]

I have a production sql db of 600gb and a historical server where i move the full db every month. Now we want to have only the last 3 months information on the production server, and move every week ...
0
votes
2answers
50 views

Synchronize SQL server databases

We have the following scenario: We have several SQL serves instances in distributed geographic areas (distributed buildings) (in a city or maybe globally) All the SQL servers run one snapshot of a ...
1
vote
1answer
97 views

Problems of having DR as Synchronous Commit

In our always on set up we have One Primary and One Secondary as Synchronous Commit and the DR as asynchronous commit. If i want to change the DR to Synchronous Commit will there be any performance ...
1
vote
3answers
324 views

Mysql master-master: single table out of sync

I have a master-master MySQL 5.7, everything works fine except for one error which is rising from time to time. If I run a show slave status\G on server2 I have an error on a table: ... Last_Errno: ...
0
votes
1answer
33 views

Failover from Primary to Asyn Secondary Replica

In my environment we have 1 Primary 1 Synchornous Secondary and 1 Asynchronous Secondary Replica (Off site). We are planning to do a manual failover to the Asynchronous Secondary Replica (Off site) ...
0
votes
1answer
17 views

Regularly clone/backup 2 MySQL databases unidirectionally from PC to Laptop both running Windows

I have a PC running Windows XP with a custom ERP system and MySQL Server 4.x (A) and a Laptop running Windows 10, same MySQL 4.x and same custom ERP (B). I'm afraid I can't upgrade PC nor MySQL, etc. ...
5
votes
1answer
3k views

Very slow merge replication synchronization

I had an unforeseen issue with a sub going down (generic error, was probably a connection issue) and now that I've reconnected the sub it is insanely slow re-syncing. It seems to download about 1000 ...
2
votes
1answer
389 views

Efficient join technique for two very large tables

I am working on a concept for database synchronization recently. The scenario is as follows: there is a master table "Items" with 1M+ rows in it CREATE TABLE [dbo].[Item]( [Id] [...
2
votes
0answers
65 views

Replacing full contents of SQL tables without user disruptions

I have a SQL Express 2012 DB in which there are tables that need frequent full "refreshs" (on-hours) from an external source without any disruption of the users. Let's say the tables are Item, ...
0
votes
0answers
77 views

MariaDB galera cluster with Mroonga in wrapper mode doesn't synch

MariaDB Galera Cluster states that the storage engine needs to be InnoDB. I am using Mroonga on some tables in wrapper mode {which uses InnoDB under the hood as storage engine}. The problem I am ...
0
votes
2answers
39 views

Keeping database in synch

This might seem like a stupid question. Can i restore logs of one database to another existing database of same schema.? I have a database d1 in Server A.I took backup of that and restored as ...
3
votes
1answer
889 views

Live Database Sync. MySQL - SQL Server [closed]

I have a rare scenario. Is there any possibility to achieve the target? Here is the situation: I have developed a responsive site for a supermarket. I am using php with foundation framework and the ...
0
votes
1answer
25 views

Get updated rows without triggers or timestamps

I'm working on a project with a client. The client has a MySQL Database with a few large tables (~100 million records each). I've pulled the initial data. I am required to sync the client's database ...
0
votes
1answer
71 views

ADD new node Replication in MongoDB

Here i found some trouble. and i don't known why! Now I have one replication with 3 members (1 of primary, 2 of secondary), And i want to add another one (secondary) to sync the data. the data has ...
1
vote
2answers
48 views

Aggregating high volumes of data from many MySQL servers

I have 4 servers of MySQL, each receives around 4 million records a day. I need to aggregate all the inserted records into another main server after doing some mapping processing to the aggregated ...
1
vote
1answer
1k views

Syncing data from primary member to secondary after election

Maybe this is kind a stupid question but, I'm novice in configuring replication and I need to clear something before makeing anything else. Moment ago I configured replica set with 3 members in it. ...
1
vote
0answers
371 views

SQL Server One Way Data Synchronization

I have 2 SQL Server Databases A and B, and I want to synchronize (continuously, every 10 minutes, max) the data from 70-80% percent of the tables from A to B (just A -> B, B is a read only database), ...
0
votes
1answer
169 views

How to prevent data loss during intra-site failover

We are looking to build a MS SQL server (either SQL server 2016 standard or enterprise edition) solution but are having some troubles. This post can be lengthy and if you think it is TLDR, our ...
1
vote
0answers
60 views

Synchronisation of multiple databases with GUID type

I have two databases. One is on mobile and uses SQLite and another one is on Microsoft azure. I want to sync data in both directions. Sometimes some data is saved on azure db and should be ...
0
votes
1answer
32 views

Compare the contents of a single column and sync rows in that colum [closed]

This is SQL Server - I have 3 rows of data in a single table based on location I want the data for a single field to match in all three locations e.g I have parts in three locations, location 1, 2, ...
1
vote
0answers
47 views

data synchronization between two dbs

I need your help on some replication matter I guess. I'm actually not a dba, but I need to do some work on my db: I have a remote db, with table1, table2 and a local db with table3 and table4 in local ...
1
vote
1answer
590 views

How can I synchronise Always Encrypted data from On-Premises to Azure SQL Database (near real time)?

Let's say I have On Premises SQL Server 2016 SP1 and Azure SQL Database. There is no way at this point to redirect whole solution directly to Azure SQL Database and I need to have a copy of the ...
1
vote
1answer
724 views

Sync two mysql database one in intranet and the other on internet

I'm making the training and placement module for my college. But I'm facing problems to sync the databases, one that will be used by the students and the other that will be used by the HR of a company....
2
votes
1answer
558 views

Sync MySQL database and Quickbooks Database

I use Quickbooks as an accounting software. I also have a MySQL database where I record data on orders, customers, inventory, employees and etc. Is there a way for me to sync the two databases? For ...
0
votes
2answers
70 views

Set up a SQL Server database based on an Excel file which refreshes automatically

Can I set up a Server database based on an Excel file, which refreshes automatically with any changes in the source Excel file? I am currently using SQL Server 2008.
2
votes
1answer
6k views

Offline to Online database synchronization programmatically using PHP and MySQL [closed]

I am working on a project in which the client requires an online as well as an offline application. Offline application data will be manually synced to online database linked to the web application. ...
6
votes
1answer
329 views

sync MS SQL Server 2014 and Express 2014 Database using Stored Procedure

I have C# windows form application and I have same database schema on both MS SQL Server(for master user) and on SQL Express(for clients). My database size is around 2 GB for each client. I want to ...
0
votes
1answer
324 views

Data drift on Row-Based-Replication

i've realized that one of my mysql slaves has missing rows. select count on specific table on master: 9605010 on slave: 9593831 slave is completely sync, no seconds_behind_master, no errors, no slow ...
1
vote
1answer
213 views

Merge Replication customize synchronization cycle and its performance

I'm trying to implement Merge Replication between just two servers, a publisher and one Subscriber. Assume these tables : --Main table in Publisher Ticket (id, userId, reqId, blockedDate, usedDate, ...