Skip to main content

Questions tagged [data-synchronization]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
1 vote
1 answer
5k views

SQL Server AlwaysON : start sync with secondary for selected databases

I have an SQL Server 2012 AlwaysON cluster composed of : win-mssql1 : witness file share win-mssql2 (INSTANCE 1) : primary server win-mssql3 (INSTANCE 2) : secondary server Recently I had the ...
Mickael's user avatar
  • 325
0 votes
1 answer
190 views

Sync SQL Server Transaction Logs to Redshift

I am researching the plausibility of syncing SQL Server logs to an AWS Redshift data warehouse. Redshift has the COPY command to do parallel loads from S3 to Redshift already. Additionally, there are ...
ratchet's user avatar
  • 60
3 votes
0 answers
752 views

Merge replication subscriptions are repeating the same actions endlessly

We have a merge publication set up on SQL Server 2008R2, with several subscribers. Synchronisation is done through the internet. Over the last few days, some subscribers are unable to synchronise. In ...
George T's user avatar
  • 245
3 votes
2 answers
6k views

org.postgresql.util.PSQLException: ERROR: canceling statement due to conflict with recovery

I currently have a PostgreSQL slave node that is presenting problems, that don't arise in the master node. Seems to be related with the node sync process. Complete stacktrace: org.postgresql.util....
Gonzalo Vasquez's user avatar
1 vote
0 answers
277 views

PostgreSQL Single Mode Command

I've been working for a while with PostgreSQL and I managed to find out a way to use pg_rewind function in order to resynchronize an old master after a new promoted master (old standby). (using repmgr ...
ltandrei's user avatar
1 vote
1 answer
53 views

Sync while Restore Operation

I am trying to restore the Latest content to one of my Primary Replica Database which is part of AOAG. My question is during the Restore operation, 1) Will the synchronization still happens between ...
Learning_Learning's user avatar
0 votes
2 answers
286 views

Data sync from different SQL Server versions databases

So I have a SQL Server 7.0 database that can not be upgraded. it is only allowed to have data read and written in it. I created a SQL Server 2008 R2 database which is the same structure. I want to ...
Mohamedali Hamdi's user avatar
5 votes
1 answer
3k views

MongoDB replication: going into maintenance mode with 10333 other maintenance mode tasks in progress

I have a MongoDB instance where resync is required. 2016-11-07T11:59:23.330+0000 I REPL [ReplicationExecutor] syncing from: x.x.x.x:27017 2016-11-07T11:59:23.354+0000 W REPL [rsBackgroundSync]...
Sybil's user avatar
  • 2,518
2 votes
1 answer
4k views

How to Sync a MySQL DB with a Oracle DB?

I have access from 5 views of an Oracle DB located outside of my organization. I need to sync my db that is a mySQL DB with the oracle DB (Oracle views will be the master, my db will be the slave). I ...
chr0x's user avatar
  • 121
1 vote
0 answers
1k views

Synchronization between MS-SQL on premise database and azure database

Is there any stable way to synchronize a table between a MS SQL Server on premise database and a table in an Azure database? So far i have found the following possibilities, but they are not stable: ...
Stephan's user avatar
  • 11
1 vote
1 answer
80 views

MySQL database sync options

What are some of the good options to sync two or more MySQL databases of the same schema, situated at different locations; reliably? We have four database in four different locations. we tried using ...
Varshal Davda's user avatar
0 votes
1 answer
2k views

STARTUP2 mode - command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:644 locks:{}

MongoDB 3.2.8 is in STARTUP2 mode building indexes at the moment. A replicaset with 3 nodes. 2016-08-15T08:11:19.385+0200 I - [rsSync] Index Build: 387200/2273552 17% 2016-08-15T08:11:19.425+...
Sybil's user avatar
  • 2,518
0 votes
3 answers
1k views

Move large mysql table data from one server to another

I have a table to which millions of data are inserted every day. As the table size grows more than 10 GB, I have issues with the performance of server in fetching apis and generating reports, which ...
avash's user avatar
  • 1
3 votes
1 answer
1k views

Live Database Sync. MySQL - SQL Server [closed]

I have a rare scenario. Is there any possibility to achieve the target? Here is the situation: I have developed a responsive site for a supermarket. I am using php with foundation framework and the ...
sujith karivelil's user avatar
5 votes
1 answer
5k views

Very slow merge replication synchronization

I had an unforeseen issue with a sub going down (generic error, was probably a connection issue) and now that I've reconnected the sub it is insanely slow re-syncing. It seems to download about 1000 ...
tmwoods's user avatar
  • 145
5 votes
1 answer
1k views

How to manage primary key value while multiple secondary server sync with primary server?

we have three secondary database server in different cities and one primary server. my question is i want asynchronous transaction commit to all three database but primary key data conflict occur ...
Gulrez Khan's user avatar
1 vote
1 answer
1k views

Sync two mysql database one in intranet and the other on internet

I'm making the training and placement module for my college. But I'm facing problems to sync the databases, one that will be used by the students and the other that will be used by the HR of a company....
Ankit Ladhania's user avatar
1 vote
1 answer
827 views

Best solution to keep a big table synched in 2 DB

I manage a few tables with more than 1 billion records. Daily, their ETLs run, reading data from flat files and inserting a few thousand records on each of them. Now I need to keep these same tables ...
Hikari's user avatar
  • 1,553
1 vote
1 answer
2k views

Syncing data from primary member to secondary after election

Maybe this is kind a stupid question but, I'm novice in configuring replication and I need to clear something before makeing anything else. Moment ago I configured replica set with 3 members in it. ...
Superbrain_bug's user avatar
2 votes
0 answers
229 views

Distributing MS Access Database

I develop an application that saves records in MS Access DB. Each user has it own DB copy on his local machine, and there is a central DB that reflects all the copies from everyone. The central DB is ...
user3165438's user avatar
2 votes
0 answers
51 views

Asynchronous Availability Group Secondary Verify Up To Date with Primary Before Backup

I was wondering if there was a way to include a verification step before a backup on a secondary replica under asynchronous commit mode in availability groups to verify that the secondary replica is ...
Travis's user avatar
  • 21
0 votes
1 answer
863 views

Split data across databases/machines

I have two questions about how to partition data across servers. Can I create and connect two or more databases, with the records correctly associated, using only a mapping table stored in a third (...
Lori's user avatar
  • 121
3 votes
1 answer
3k views

Syncing a SQL Server table with a CSV file

I have recently started a project with sensors that add data to a single CSV file as data the data. I would like to have this data stored in a SQL Server database in a relatively real-time manner. I ...
BenP1192's user avatar
  • 131
1 vote
1 answer
945 views

Synchronize MySQL database from remote MySQL database

The documentation mentions a sync function, but that function is not available from the Database menu as shown in the screenshots there. Is this functionality available elsewhere? Using reverse ...
matanox's user avatar
  • 297
0 votes
1 answer
574 views

mysql diff and add diff records into new database

I have two database on two different hosts: host A has database A and table A table A contains records with primary key 1 to 10 host B has database B and table B table B contains records with ...
mOsEs's user avatar
  • 1
3 votes
0 answers
3k views

MySQL along with Firebase for data sync

I'm currently working on a mobile app powered by a web platform, and the mobile app will have some offline capabilities. The application has a small amount of DB entities, and only about 3 of them ...
lsouza's user avatar
  • 131
4 votes
1 answer
1k views

How do I synchronize rows in tables in remote databases?

I'm actually developing a synchronization tool in vb.net, I have two database that have on each table records field GUID, this field help to have the same PK on both database. On each record there is ...
Dillinger's user avatar
  • 141
1 vote
0 answers
137 views

How to sync incomplete replication records in MySQL

if replication breaks and you end up with a couple of records not pushed out to the slave, is there a way to update the slave without stopping locks on the master and manually transferring a new ...
doeJ's user avatar
  • 33
2 votes
0 answers
48 views

Bandwidth-efficient, fail-safe database resync with long backlogs

I'm looking for a DB system that allows slaves to resync even if there exists a long backlog. In addition these resyncs must be as bandwidth-efficent as possible as the nodes are connected over GSM/...
Bob's user avatar
  • 21
4 votes
1 answer
240 views

Checking existence and syncing data with millions of rows

I am developing sms based service platform. In India, we have two different types of routes to send sms - promo & trans. Sms sent via promo route has to be checked against nationally maintained ...
Ehs4n's user avatar
  • 211
1 vote
1 answer
104 views

Syinc databases mySQL to Oracle

I'm new in "databaase administration" the problem I am facing is that I want to have an exact copy of a table, from MySQL database (website database) to oracle database (a local one). What I've done ...
Charaf Eddine Mechalikh's user avatar
1 vote
1 answer
123 views

Synchronizing two MySQL Server both serving clients after reconnect

I am not a pro in DB...here is my case. I have 2 MySQL databases on ServerA and ServerB and clients in 2 buildings, with only network connection between them and no more outer network available. I ...
ben2613's user avatar
  • 11
1 vote
2 answers
512 views

Sync data between 2 databases Oracle 10g

I have 2 databases DB_LIVE and DB_NEW, both have different credentials. I have a Data Read access on DB_LIVE and I am owner of DB_NEW which is a completely blank and raw db provided to me. I want to ...
Nitin Chhajer's user avatar
1 vote
1 answer
3k views

DBClientCursor::init call() failed

During syncing a slave(SECONDRY) node, I have DBClientCursor::init call() failed error and it's start syncing from scratch, the full log is provided: Tue Nov 10 05:54:56.281 [rsSync] clone xxxxx....
Vahid Kharazi's user avatar
1 vote
0 answers
768 views

Is it possible to synchronize multiple databases in to 1 database with the same tables?

We are facing a situation where we have 5 different businesses with comparable data and are building 1 single application to deliver their data to common customers. In order to do this, the plan is ...
user1841243's user avatar
0 votes
2 answers
796 views

Replication Setup what's the value of MySQL auto_increment and offset in my.ini

I have setup master master MySQL replication to sync changes in both servers. Now I want to setup 6 servers, is that possible? I'm making 6 because when an area lost it connection over WAN it will ...
nathan's user avatar
  • 1
7 votes
2 answers
4k views

Instant synchronization of multiple SQL servers

First of all, I am sorry if this is a duplicate. I was unable to find anyone who adressed this particular question, or I might have failed to realize it as I read it. Most likely I used the wrong ...
Levi's user avatar
  • 360
1 vote
2 answers
2k views

Are expdp/impdp commands appropriate for daily schema sync?

I've done following comands: expdp system/password@localdb ^ schemas=SCH directory=dumps_dir dumpfile=SCH_%date%.dmp logfile=expdpSCH_%date%.log It runs great, without errors. But when I use command:...
Dracontis's user avatar
  • 113
2 votes
1 answer
411 views

Postgres: Merge database backup with development database

My database is quite large 50GB+ what I've always had to do when I want to sync my development database with production is download a backup of production, drop my development database then restore ...
user1044281's user avatar
0 votes
1 answer
1k views

How to setup sync between MongoDB and C# .NET Application

What is the best practice to synchronize a MongoDB remote database with a C# .NET App that would allow queries to be responded to within the local file system and update itself when there is a change ...
Arul Verman's user avatar
1 vote
0 answers
928 views

Update remote MySQL database upon changes in local SQL Server database

I have a Web store running with MySQL on the remote host. And I have inventory management software using Microsoft SQL Server on my local system. I want to update product stock in the web store when ...
Asif Shaikh's user avatar
1 vote
1 answer
118 views

Sync data in SQL Server 2014 with Oracle database12c

I have installed Oracle database 12c enterprise on my laptop. How can I implement data synchronization between Oracle 12c and SQL Server 2014 that whenever an INSERT,UPDATE,DELETE or ... happend on ...
SajjaD's user avatar
  • 187
2 votes
2 answers
252 views

SQL Server 2012 AlwaysOn Availability Group

We have an application that needs access to the database at all times to work properly and we are planning on deploying SQL Server 2012 AlwaysOn Availability Groups on Windows Server 2012. We have two ...
user72471's user avatar
2 votes
0 answers
432 views

Database sharding, denormalization and synchronization

In sharding, it is advisable to follow a share nothing, shard everything approach. Essentially, this translates to: data that are to be used together are to be stored together (i.e. in a single shard)....
ahron's user avatar
  • 813
0 votes
1 answer
93 views

How should I handle unknown primary keys? [closed]

I'm working as a database-administrator at a school. Recently the school upgraded its pupil administrative software into a web-based solution. This works great, but this web-based solution is missing ...
dietervdf's user avatar
  • 167
1 vote
1 answer
4k views

Synchronise Oracle Tables to SQL Server

Our ERP is using an Oracle database while our BI system is based on SQL Server. We need to get the changed data in Oracle and copy it in our staging area. At the moment we get the changed rows by ...
Josh Alvo's user avatar
  • 105
4 votes
1 answer
3k views

Data synchronization across multiple databases

I have a Django application which uses PostgreSQL as a database. The application stores hierarchical data. It is like a warehouse management system with multiple branches and hierarchy. The current ...
user1318496's user avatar
0 votes
1 answer
59 views

SQL redundant databases both sets being modified independently yet staying concurrent

I have a server in location 1. This location has slow external internet but all the employees. Location 2 has fast external internet but no people are there. I have a mobile app that I would like to ...
Odis Harkins's user avatar
2 votes
0 answers
186 views

Keep selected tables synchronized across MySQL databases

I've a need that requires me to keep a number of tables from a database (db1) synchronized with another database (db2). db1 & db2 have different structures and a set of tables and their data from ...
Kanuj Bhatnagar's user avatar
17 votes
5 answers
84k views

Syncing two databases in SQL Server

I have two SQL Server databases. One is client (Windows application) and the second is on the server. I want to sync these two databases every so often (e.g. every 2 minutes!). I have read about ...
Emad Farrokhi's user avatar