Questions tagged [data-synchronization]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
0
votes
1answer
25 views

Tools to ingest data to database in periods [closed]

We have an application that can work with Oracle or MySql or SQLServer databases. Also, there is a 3rd party data source that we need to have it's latest data records in our database every 15 minutes. ...
0
votes
1answer
46 views

How to insert data from a local MSSQL db table to a remote MSSQL db table using WCF application coded in .NET [closed]

I made a WPF application using VS2013, coded in .NET. It is working fine in my local SQL Server. But I want to use it to upload data from a local database to a remote database. How can I do this? I ...
0
votes
1answer
32 views

Compare the contents of a single column and sync rows in that colum [closed]

This is SQL Server - I have 3 rows of data in a single table based on location I want the data for a single field to match in all three locations e.g I have parts in three locations, location 1, 2, ...
0
votes
1answer
368 views

Data drift on Row-Based-Replication

i've realized that one of my mysql slaves has missing rows. select count on specific table on master: 9605010 on slave: 9593831 slave is completely sync, no seconds_behind_master, no errors, no slow ...
0
votes
1answer
131 views

Sync SQL Server Transaction Logs to Redshift

I am researching the plausibility of syncing SQL Server logs to an AWS Redshift data warehouse. Redshift has the COPY command to do parallel loads from S3 to Redshift already. Additionally, there are ...
0
votes
1answer
51 views

How should I handle unknown primary keys? [closed]

I'm working as a database-administrator at a school. Recently the school upgraded its pupil administrative software into a web-based solution. This works great, but this web-based solution is missing ...
0
votes
1answer
358 views

Size of data in secondary exceeded primary after its initial resync from primary in MongoDB

I step down the primary node, deleted its data and performed the initial resync from new primary. But when i checked the size of data after the completion of initial resync, I found that the size of ...
0
votes
2answers
71 views

Set up a SQL Server database based on an Excel file which refreshes automatically

Can I set up a Server database based on an Excel file, which refreshes automatically with any changes in the source Excel file? I am currently using SQL Server 2008.
0
votes
1answer
3k views

Tool to synchronize PostgreSQL DDL and data databases [closed]

We have several developers who each have a local database for testing. We often make DDL and/or data changes to the master database that we need to replicate to each development machine. The framework ...
0
votes
1answer
3k views

Real-time merge of two databases on different servers

One of the requirements our customer has given is to merge two databases running on two different machines in real time. This means that we have to build some sync policy (or use SQL Server tools to ...
0
votes
1answer
24 views

Change Data Capture in MySQL/PHP by writing to a MySQL table (rather than streaming to Kafka/Rabbit/etc)?

I have a small internal web app I'm developing with PHP and MySQL. I'm looking to sync client webpages to a server by requesting all changes since a certain date. I've found a number of solutions ...
0
votes
2answers
280 views

Sync two postgres databases from two sperate locations with no network

I have 2 postgres databases running the same schemes on two different computers, that are not guaranteed to have any network connection while having to handle read/write requests. Because they ...
0
votes
1answer
19 views

Archival copy of table, including overwrote data [closed]

I have database server, with a database and table. The database and table can not be changed by me to ensure 3rd party support but the server configuration and MySQL configuration can be. On that ...
0
votes
1answer
25 views

Get updated rows without triggers or timestamps

I'm working on a project with a client. The client has a MySQL Database with a few large tables (~100 million records each). I've pulled the initial data. I am required to sync the client's database ...
0
votes
1answer
182 views

How to prevent data loss during intra-site failover

We are looking to build a MS SQL server (either SQL server 2016 standard or enterprise edition) solution but are having some troubles. This post can be lengthy and if you think it is TLDR, our ...
0
votes
1answer
51 views

Updating data when data is from an external source

A government organization provides data in a series of files which can be re-engineered and imported into a database. The files are updated monthly. I have been able to reengineer the database in ...
0
votes
2answers
87 views

Data sync from different SQL Server versions databases

So I have a SQL Server 7.0 database that can not be upgraded. it is only allowed to have data read and written in it. I created a SQL Server 2008 R2 database which is the same structure. I want to ...
0
votes
1answer
983 views

STARTUP2 mode - command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:644 locks:{}

MongoDB 3.2.8 is in STARTUP2 mode building indexes at the moment. A replicaset with 3 nodes. 2016-08-15T08:11:19.385+0200 I - [rsSync] Index Build: 387200/2273552 17% 2016-08-15T08:11:19.425+...
0
votes
1answer
580 views

Split data across databases/machines

I have two questions about how to partition data across servers. Can I create and connect two or more databases, with the records correctly associated, using only a mapping table stored in a third (...
0
votes
2answers
274 views

Replication Setup what's the value of MySQL auto_increment and offset in my.ini

I have setup master master MySQL replication to sync changes in both servers. Now I want to setup 6 servers, is that possible? I'm making 6 because when an area lost it connection over WAN it will ...
0
votes
1answer
861 views

How to setup sync between MongoDB and C# .NET Application

What is the best practice to synchronize a MongoDB remote database with a C# .NET App that would allow queries to be responded to within the local file system and update itself when there is a change ...
0
votes
1answer
48 views

SQL redundant databases both sets being modified independently yet staying concurrent

I have a server in location 1. This location has slow external internet but all the employees. Location 2 has fast external internet but no people are there. I have a mobile app that I would like to ...
0
votes
1answer
846 views

How to handle lock timeout error in MySQL?

I am getting below listed error many times in my application log. 2015-05-19 10:27:57,842 ERROR [Timer-3] [org.hibernate.util.JDBCExceptionReporter] Lock wait timeout exceeded; try restarting ...
0
votes
1answer
209 views

How to keep the data warehouse synchronised with the source systems? [closed]

I'm a DBA who is responsible for exporting data from an ERP system for Business Intelligence purposes. The data from ERP system is being sent to the data warehouse and they are used in the ETL process....
0
votes
1answer
503 views

sync all tables between 2 databases [closed]

I need some information on how to synchronize all tables and views in sql server. What I wanted to do is basically I want all production server has the same tables and views structures as the staging ...
0
votes
3answers
1k views

Keeping an up to date copy of a SQL Server database on another server [closed]

We outsourced some of our business functions to another company. That company makes use of the same software as we do and we would like to keep a update to date copy of their database on our servers ...
0
votes
1answer
2k views

Database design for mobile app

At first I would like to say hello to all of you, since it is my first post here on DB Administrators. I am writing an app which store drinks and their data. At the beginning it was storing all in ...
0
votes
2answers
1k views

How can I push data from my local MAMP database to my remote database?

I'm developing a site locally using MAMP Pro, and I've created a mysql database locally that have the same structure as the remote server. (username and password are different though) I'm inserting ...
0
votes
1answer
22 views

Add a new node to Mongo Replicaset using Rsync

I have a 3 shard mongo cluster. Each shard has a 3 node replica set. On each shard, the data size is 3 TB. I want to add 1 more node to each replica set. But its taking lot of time. The initial sync ...
0
votes
0answers
36 views

Azure SQL Data Sync: How to Increase Synchronisation speed after bulk purge/update in Azure SQL Data Sync Service?

I have two tables across two regions in Azure SQL Databases. There is a Bi-directional Data Sync configured between those two databases with automatic frequency of 15 minutes and conflict resolution ...
0
votes
0answers
7 views

Elastic search data synchronization with different databases

We are using elastic search hosted in AWS for apps wide search in our organization. We had initially dumped our existing data using logstash. However, we are struck at keeping the Elastic DB in sync ...
0
votes
1answer
59 views

Master Master replication rows not sync properly

I have a wordpress website that run on 3 machines Machine1 | Machine 2 {nginx+lsyncd+mysql} visitor > cloudflare > haproxy ------ ...
0
votes
0answers
121 views

Sync PostgreSQL with Cloud and multi Local Locations

I need help with a complex (for me) multi server setup with PostgreSQL. I have to setup a Cloud Server and 3 Local Servers for our company. Each Server will have: Linux Ubuntu 16.04 Docker ...
0
votes
0answers
732 views

SQL Server 2016 Availability Group (Primary Unable to Read/Write)

We have a 3 replica SQL Server 2016 availability group. When the secondary synchronous goes unhealthy the database that resides on the primary becomes unreadable / unwritable, at this time the primary ...
0
votes
1answer
36 views

MySQL synchronization

I have a cloud-based MySQL instance (slave) and am planning a solution where a remote instance (master) will be based on a ship. The ship will go in and out of international waters and therefore will ...
0
votes
1answer
171 views

MySQL slave only views

We are kind of struggling while creating the infrastructure for our BI sector. I had read on this link that it is possible to create views on a read-only slave. Still, when I run the query I get "...
0
votes
2answers
63 views

Synchronize SQL server databases

We have the following scenario: We have several SQL serves instances in distributed geographic areas (distributed buildings) (in a city or maybe globally) All the SQL servers run one snapshot of a ...
0
votes
1answer
33 views

Failover from Primary to Asyn Secondary Replica

In my environment we have 1 Primary 1 Synchornous Secondary and 1 Asynchronous Secondary Replica (Off site). We are planning to do a manual failover to the Asynchronous Secondary Replica (Off site) ...
0
votes
0answers
82 views

MariaDB galera cluster with Mroonga in wrapper mode doesn't synch

MariaDB Galera Cluster states that the storage engine needs to be InnoDB. I am using Mroonga on some tables in wrapper mode {which uses InnoDB under the hood as storage engine}. The problem I am ...
0
votes
1answer
84 views

ADD new node Replication in MongoDB

Here i found some trouble. and i don't known why! Now I have one replication with 3 members (1 of primary, 2 of secondary), And i want to add another one (secondary) to sync the data. the data has ...
0
votes
1answer
18 views

Regularly clone/backup 2 MySQL databases unidirectionally from PC to Laptop both running Windows

I have a PC running Windows XP with a custom ERP system and MySQL Server 4.x (A) and a Laptop running Windows 10, same MySQL 4.x and same custom ERP (B). I'm afraid I can't upgrade PC nor MySQL, etc. ...
0
votes
1answer
486 views

PostgreSQL warm standby: sync WAL files

I'm new to PostgreSQL (using ver 8.4.20) and need to setup a master and standby SQL server setup. I am planning to use warm standby setup. I have read the docs on PG and understand the basics, but a ...
0
votes
2answers
231 views

Local and cloud database sync missing data only

We have set up an IOT device which records a lot of data. This data always makes it into the local gateway mysql database, and if there is an internet connection then it also goes into the cloud ...
0
votes
1answer
194 views

Selective synchronization between distributed clusters

What's the best practice for the following scenario: I've an embeded device with a single, lightweight database; a powerful server with a cluster; a cluster in the cloud. I'd like to synchronize the ...
0
votes
1answer
2k views

Why CTX_DDL.SYNC_INDEX procedure doesn't work?

I'm following the Oracle documentation to create indexes with Oracle Text. The problem is, when I update my data and want to synchronize my index with the CTX_DDL.SYNC_INDEX procedure (according to ...
0
votes
1answer
60 views

MySQL database sync options

What are some of the good options to sync two or more MySQL databases of the same schema, situated at different locations; reliably? We have four database in four different locations. we tried using ...
0
votes
3answers
446 views

Move large mysql table data from one server to another

I have a table to which millions of data are inserted every day. As the table size grows more than 10 GB, I have issues with the performance of server in fetching apis and generating reports, which ...
0
votes
0answers
499 views

Syncing DB's between local and live server?

I need to sync two tables between MySQL databases. I have read about MySql Replication. But not sure whether it can be used in this scenario. What I want to achieve is explained below. There are two ...
0
votes
0answers
55 views

Mysql, best synchronization option

Hope the question isn't too vague. I have a user who has a HOSTED web application that helps run his day to day business. The application is very useful to the client and his customers, as they can ...
0
votes
1answer
171 views

SQL Server 2012 AlwaysOn Availability Group

We have an application that needs access to the database all the time to work properly and we are planning on deploying SQL Server 2012 AlwaysOn Availability Groups on Windows Server 2012. We have ...