Stack Exchange Network

Stack Exchange network consists of 175 Q&A communities including Stack Overflow, the largest, most trusted online community for developers to learn, share their knowledge, and build their careers.

Visit Stack Exchange

Questions tagged [data-synchronization]

The tag has no usage guidance.

0
votes
1answer
32 views

Compare the contents of a single column and sync rows in that colum [closed]

This is SQL Server - I have 3 rows of data in a single table based on location I want the data for a single field to match in all three locations e.g I have parts in three locations, location 1, 2, ...
0
votes
1answer
337 views

Data drift on Row-Based-Replication

i've realized that one of my mysql slaves has missing rows. select count on specific table on master: 9605010 on slave: 9593831 slave is completely sync, no seconds_behind_master, no errors, no slow ...
0
votes
1answer
126 views

Sync SQL Server Transaction Logs to Redshift

I am researching the plausibility of syncing SQL Server logs to an AWS Redshift data warehouse. Redshift has the COPY command to do parallel loads from S3 to Redshift already. Additionally, there are ...
0
votes
1answer
51 views

How should I handle unknown primary keys? [closed]

I'm working as a database-administrator at a school. Recently the school upgraded its pupil administrative software into a web-based solution. This works great, but this web-based solution is missing ...
0
votes
1answer
351 views

Size of data in secondary exceeded primary after its initial resync from primary in MongoDB

I step down the primary node, deleted its data and performed the initial resync from new primary. But when i checked the size of data after the completion of initial resync, I found that the size of ...
0
votes
2answers
70 views

Set up a SQL Server database based on an Excel file which refreshes automatically

Can I set up a Server database based on an Excel file, which refreshes automatically with any changes in the source Excel file? I am currently using SQL Server 2008.
0
votes
1answer
3k views

Tool to synchronize PostgreSQL DDL and data databases [closed]

We have several developers who each have a local database for testing. We often make DDL and/or data changes to the master database that we need to replicate to each development machine. The framework ...
0
votes
1answer
3k views

Real-time merge of two databases on different servers

One of the requirements our customer has given is to merge two databases running on two different machines in real time. This means that we have to build some sync policy (or use SQL Server tools to ...
0
votes
2answers
136 views

Sync two postgres databases from two sperate locations with no network

I have 2 postgres databases running the same schemes on two different computers, that are not guaranteed to have any network connection while having to handle read/write requests. Because they ...
0
votes
1answer
19 views

Archival copy of table, including overwrote data [closed]

I have database server, with a database and table. The database and table can not be changed by me to ensure 3rd party support but the server configuration and MySQL configuration can be. On that ...
0
votes
1answer
25 views

Get updated rows without triggers or timestamps

I'm working on a project with a client. The client has a MySQL Database with a few large tables (~100 million records each). I've pulled the initial data. I am required to sync the client's database ...
0
votes
1answer
169 views

How to prevent data loss during intra-site failover

We are looking to build a MS SQL server (either SQL server 2016 standard or enterprise edition) solution but are having some troubles. This post can be lengthy and if you think it is TLDR, our ...
0
votes
1answer
51 views

Updating data when data is from an external source

A government organization provides data in a series of files which can be re-engineered and imported into a database. The files are updated monthly. I have been able to reengineer the database in ...
0
votes
2answers
84 views

Data sync from different SQL Server versions databases

So I have a SQL Server 7.0 database that can not be upgraded. it is only allowed to have data read and written in it. I created a SQL Server 2008 R2 database which is the same structure. I want to ...
0
votes
1answer
928 views

STARTUP2 mode - command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:644 locks:{}

MongoDB 3.2.8 is in STARTUP2 mode building indexes at the moment. A replicaset with 3 nodes. 2016-08-15T08:11:19.385+0200 I - [rsSync] Index Build: 387200/2273552 17% 2016-08-15T08:11:19.425+...
0
votes
1answer
564 views

Split data across databases/machines

I have two questions about how to partition data across servers. Can I create and connect two or more databases, with the records correctly associated, using only a mapping table stored in a third (...
0
votes
2answers
234 views

Replication Setup what's the value of MySQL auto_increment and offset in my.ini

I have setup master master MySQL replication to sync changes in both servers. Now I want to setup 6 servers, is that possible? I'm making 6 because when an area lost it connection over WAN it will ...
0
votes
1answer
819 views

How to setup sync between MongoDB and C# .NET Application

What is the best practice to synchronize a MongoDB remote database with a C# .NET App that would allow queries to be responded to within the local file system and update itself when there is a change ...
0
votes
1answer
47 views

SQL redundant databases both sets being modified independently yet staying concurrent

I have a server in location 1. This location has slow external internet but all the employees. Location 2 has fast external internet but no people are there. I have a mobile app that I would like to ...
0
votes
1answer
800 views

How to handle lock timeout error in MySQL?

I am getting below listed error many times in my application log. 2015-05-19 10:27:57,842 ERROR [Timer-3] [org.hibernate.util.JDBCExceptionReporter] Lock wait timeout exceeded; try restarting ...
0
votes
1answer
196 views

How to keep the data warehouse synchronised with the source systems? [closed]

I'm a DBA who is responsible for exporting data from an ERP system for Business Intelligence purposes. The data from ERP system is being sent to the data warehouse and they are used in the ETL process....
0
votes
1answer
500 views

sync all tables between 2 databases [closed]

I need some information on how to synchronize all tables and views in sql server. What I wanted to do is basically I want all production server has the same tables and views structures as the staging ...
0
votes
3answers
1k views

Keeping an up to date copy of a SQL Server database on another server [closed]

We outsourced some of our business functions to another company. That company makes use of the same software as we do and we would like to keep a update to date copy of their database on our servers ...
0
votes
1answer
2k views

Database design for mobile app

At first I would like to say hello to all of you, since it is my first post here on DB Administrators. I am writing an app which store drinks and their data. At the beginning it was storing all in ...
0
votes
2answers
1k views

How can I push data from my local MAMP database to my remote database?

I'm developing a site locally using MAMP Pro, and I've created a mysql database locally that have the same structure as the remote server. (username and password are different though) I'm inserting ...
0
votes
1answer
25 views

Best way to back-up MySQL production database to another database [closed]

The case: I have a very large MySQL production database. Due to performance problems I want to periodically clean-up this database automatically. Before cleaning-up I want to do an incremental backup ...
0
votes
1answer
48 views

Master Master replication rows not sync properly

I have a wordpress website that run on 3 machines Machine1 | Machine 2 {nginx+lsyncd+mysql} visitor > cloudflare > haproxy ------ ...
0
votes
0answers
70 views

Sync PostgreSQL with Cloud and multi Local Locations

I need help with a complex (for me) multi server setup with PostgreSQL. I have to setup a Cloud Server and 3 Local Servers for our company. Each Server will have: Linux Ubuntu 16.04 Docker ...
0
votes
0answers
409 views

SQL Server 2016 Availability Group (Primary Unable to Read/Write)

We have a 3 replica SQL Server 2016 availability group. When the secondary synchronous goes unhealthy the database that resides on the primary becomes unreadable / unwritable, at this time the primary ...
0
votes
1answer
24 views

MySQL synchronization

I have a cloud-based MySQL instance (slave) and am planning a solution where a remote instance (master) will be based on a ship. The ship will go in and out of international waters and therefore will ...
0
votes
1answer
149 views

MySQL slave only views

We are kind of struggling while creating the infrastructure for our BI sector. I had read on this link that it is possible to create views on a read-only slave. Still, when I run the query I get "...
0
votes
2answers
58 views

Synchronize SQL server databases

We have the following scenario: We have several SQL serves instances in distributed geographic areas (distributed buildings) (in a city or maybe globally) All the SQL servers run one snapshot of a ...
0
votes
1answer
33 views

Failover from Primary to Asyn Secondary Replica

In my environment we have 1 Primary 1 Synchornous Secondary and 1 Asynchronous Secondary Replica (Off site). We are planning to do a manual failover to the Asynchronous Secondary Replica (Off site) ...
0
votes
0answers
80 views

MariaDB galera cluster with Mroonga in wrapper mode doesn't synch

MariaDB Galera Cluster states that the storage engine needs to be InnoDB. I am using Mroonga on some tables in wrapper mode {which uses InnoDB under the hood as storage engine}. The problem I am ...
0
votes
1answer
75 views

ADD new node Replication in MongoDB

Here i found some trouble. and i don't known why! Now I have one replication with 3 members (1 of primary, 2 of secondary), And i want to add another one (secondary) to sync the data. the data has ...
0
votes
1answer
17 views

Regularly clone/backup 2 MySQL databases unidirectionally from PC to Laptop both running Windows

I have a PC running Windows XP with a custom ERP system and MySQL Server 4.x (A) and a Laptop running Windows 10, same MySQL 4.x and same custom ERP (B). I'm afraid I can't upgrade PC nor MySQL, etc. ...
0
votes
1answer
419 views

PostgreSQL warm standby: sync WAL files

I'm new to PostgreSQL (using ver 8.4.20) and need to setup a master and standby SQL server setup. I am planning to use warm standby setup. I have read the docs on PG and understand the basics, but a ...
0
votes
2answers
220 views

Local and cloud database sync missing data only

We have set up an IOT device which records a lot of data. This data always makes it into the local gateway mysql database, and if there is an internet connection then it also goes into the cloud ...
0
votes
1answer
171 views

Selective synchronization between distributed clusters

What's the best practice for the following scenario: I've an embeded device with a single, lightweight database; a powerful server with a cluster; a cluster in the cloud. I'd like to synchronize the ...
0
votes
1answer
2k views

Why CTX_DDL.SYNC_INDEX procedure doesn't work?

I'm following the Oracle documentation to create indexes with Oracle Text. The problem is, when I update my data and want to synchronize my index with the CTX_DDL.SYNC_INDEX procedure (according to ...
0
votes
1answer
59 views

MySQL database sync options

What are some of the good options to sync two or more MySQL databases of the same schema, situated at different locations; reliably? We have four database in four different locations. we tried using ...
0
votes
3answers
398 views

Move large mysql table data from one server to another

I have a table to which millions of data are inserted every day. As the table size grows more than 10 GB, I have issues with the performance of server in fetching apis and generating reports, which ...
0
votes
0answers
493 views

Syncing DB's between local and live server?

I need to sync two tables between MySQL databases. I have read about MySql Replication. But not sure whether it can be used in this scenario. What I want to achieve is explained below. There are two ...
0
votes
0answers
55 views

Mysql, best synchronization option

Hope the question isn't too vague. I have a user who has a HOSTED web application that helps run his day to day business. The application is very useful to the client and his customers, as they can ...
0
votes
1answer
164 views

SQL Server 2012 AlwaysOn Availability Group

We have an application that needs access to the database all the time to work properly and we are planning on deploying SQL Server 2012 AlwaysOn Availability Groups on Windows Server 2012. We have ...
0
votes
1answer
68 views

What postgres sync solution should I use to duplicate production, but read it from another application?

I'm a little out of my league with my current problem, but I'm looking for a solution where the following conditions are met: My production database reads and writes as it currently does My ...
0
votes
1answer
20 views

Are my MongoDB servers right in setting?

I have a small web site, so I used two servers. A: master 4G Ram, 96G SSD B: slave 2G RAM, 96G SSD The B server is always for backup, no read, no write. In my application, many users can (and will) ...
0
votes
1answer
832 views

SymmetricDS not using Lookup Transform on primary key

I'm syncing records between two MySQL databases using SymmetricDS, but need to keep the primary key (fieldname = "id") fields unique. Symmetric doesn't seem to want to obey the "lookup" transform_type ...
0
votes
1answer
213 views

Keeping bank transactions in sync

I'm counting on your expertise in this one, I'm developing a scrapper for banking transactions history. My problem is, scrapping should be done regularly and the bank doesn't supply any unique ...
0
votes
1answer
463 views

ODBC configuration

I have an internal system which includes a Database and I'm also using QuickBooks Accounting package. Is there anyway I can sync my Quickbooks database with my internal system database? What I want to ...