Questions tagged [data-synchronization]
The data-synchronization tag has no usage guidance.
164
questions
0
votes
0answers
29 views
Options for syncing from a MASTER table to a COPY table?
I have a MASTER table and a COPY table in separate databases (both are Oracle 12c).
I want to sync the MASTER table with the COPY table on a weekly basis. The goal is to keep the two tables exactly ...
0
votes
1answer
25 views
Any way of forcing MySQL to use smaller files?
This is actually Maria DB. I'm using it on W10 and Linux Mint 18.3.
The issue here is that I recently strated to use Google Backup & Sync to sync between my various machines running W10 (I'm ...
0
votes
1answer
42 views
Best way to replicate MySQL database tables
I'm trying to wrap my head around the many options on how to possibly sync database tables automatically from one database to the next (and next, and next, ...).
We're trying to create a very simple ...
0
votes
3answers
98 views
Integration: Keep two systems in sync
I have a GIS system with 40 tables, ranging from 1,000 to 60,000 rows per table. The tables are the system of record for assets in a municipality.
The GIS assets in the tables get integrated to a ...
1
vote
0answers
18 views
SQL Server Merge Replication Error: The format of a message during Web synchronization was invalid
I am doing Merge Replication using Web Synchronization. On Subscriber end, there is SQL Express 2012 on Windows 10 Pro. On publisher end, there is SQL Server 2016 on Windows Server 2016. Web ...
0
votes
1answer
43 views
SQL transaction: Delete between two selects possible?
I have two SELECT statements within a transaction (repeatable read)
Select @firstItem =id from myTable Where ....
--Do some more magic, so I can't concat the the two queries!!!!
and
Select * from ...
0
votes
2answers
57 views
Sync database table schema and stored procedures
We have 2 databases. One is at our server, the other is local. We need to sync them both in a manner that local database has all data and server database has no data only empty tables and stored ...
0
votes
0answers
19 views
Database synchronization 2 times a day -MariaDB
I have 2 different servers. The first one is server1 and the other is server2. On servers, one works for websites (server1) and the other for mobile applications (server2) for security purposes. I ...
0
votes
1answer
33 views
Add a new node to Mongo Replicaset using Rsync
I have a 3 shard mongo cluster. Each shard has a 3 node replica set. On each shard, the data size is 3 TB.
I want to add 1 more node to each replica set. But its taking lot of time. The initial sync ...
0
votes
0answers
45 views
Azure SQL Data Sync: How to Increase Synchronisation speed after bulk purge/update in Azure SQL Data Sync Service?
I have two tables across two regions in Azure SQL Databases. There is a Bi-directional Data Sync configured between those two databases with automatic frequency of 15 minutes and conflict resolution ...
0
votes
1answer
47 views
Change Data Capture in MySQL/PHP by writing to a MySQL table (rather than streaming to Kafka/Rabbit/etc)?
I have a small internal web app I'm developing with PHP and MySQL. I'm looking to sync client webpages to a server by requesting all changes since a certain date.
I've found a number of solutions ...
0
votes
0answers
8 views
Elastic search data synchronization with different databases
We are using elastic search hosted in AWS for apps wide search in our organization. We had initially dumped our existing data using logstash.
However, we are struck at keeping the Elastic DB in sync ...
0
votes
3answers
116 views
Sync between two database on azure
I would like to ask a question how to setup azure syncing of two database on azure
i need real time data replication to the other database
0
votes
1answer
29 views
Load data from a temporal table to another temporal table in Azure
Currently we have only a Live Database where all our data resides. I have created a separate Azure server and DB for development.
The DEV DB should be some what up to date with the Live DB for ...
0
votes
1answer
63 views
Master Master replication rows not sync properly
I have a wordpress website that run on 3 machines
Machine1 | Machine 2 {nginx+lsyncd+mysql}
visitor > cloudflare > haproxy ------
...
0
votes
0answers
149 views
Sync PostgreSQL with Cloud and multi Local Locations
I need help with a complex (for me) multi server setup with PostgreSQL.
I have to setup a Cloud Server and 3 Local Servers for our company.
Each Server will have:
Linux Ubuntu 16.04
Docker
...
0
votes
0answers
1k views
SQL Server 2016 Availability Group (Primary Unable to Read/Write)
We have a 3 replica SQL Server 2016 availability group. When the secondary synchronous goes unhealthy the database that resides on the primary becomes unreadable / unwritable, at this time the primary ...
0
votes
1answer
51 views
MySQL synchronization
I have a cloud-based MySQL instance (slave) and am planning a solution where a remote instance (master) will be based on a ship. The ship will go in and out of international waters and therefore will ...
0
votes
1answer
25 views
Tools to ingest data to database in periods [closed]
We have an application that can work with Oracle or MySql or SQLServer databases. Also, there is a 3rd party data source that we need to have it's latest data records in our database every 15 minutes. ...
0
votes
2answers
410 views
Sync two postgres databases from two sperate locations with no network
I have 2 postgres databases running the same schemes on two different computers, that are not guaranteed to have any network connection while having to handle read/write requests.
Because they ...
0
votes
1answer
46 views
How to insert data from a local MSSQL db table to a remote MSSQL db table using WCF application coded in .NET [closed]
I made a WPF application using VS2013, coded in .NET. It is working fine in my local SQL Server. But I want to use it to upload data from a local database to a remote database. How can I do this?
I ...
0
votes
1answer
19 views
Archival copy of table, including overwrote data [closed]
I have database server, with a database and table. The database and table can not be changed by me to ensure 3rd party support but the server configuration and MySQL configuration can be. On that ...
0
votes
1answer
184 views
MySQL slave only views
We are kind of struggling while creating the infrastructure for our BI sector.
I had read on this link that it is possible to create views on a read-only slave. Still, when I run the query I get
"...
1
vote
1answer
24 views
Backup weekly current production db to Historical db server [closed]
I have a production sql db of 600gb and a historical server where i move the full db every month.
Now we want to have only the last 3 months information on the production server, and move every week ...
1
vote
2answers
56 views
Automating Redshift data dump to a PostgreSQL DB every hour
GIS analyst with minimal experience of this back-end stuff but a big task at hand. I have a redshift database that changes multiple times a day. I want to use this "live" data to make web maps and I ...
0
votes
2answers
66 views
Synchronize SQL server databases
We have the following scenario:
We have several SQL serves instances in distributed geographic areas (distributed buildings) (in a city or maybe globally)
All the SQL servers run one snapshot of a ...
1
vote
1answer
113 views
Problems of having DR as Synchronous Commit
In our always on set up we have One Primary and One Secondary as Synchronous Commit and the DR as asynchronous commit. If i want to change the DR to Synchronous Commit will there be any performance ...
1
vote
3answers
496 views
Mysql master-master: single table out of sync
I have a master-master MySQL 5.7, everything works fine except for one error which is rising from time to time.
If I run a show slave status\G on server2 I have an error on a table:
...
Last_Errno: ...
0
votes
1answer
33 views
Failover from Primary to Asyn Secondary Replica
In my environment we have 1 Primary 1 Synchornous Secondary and 1 Asynchronous Secondary Replica (Off site). We are planning to do a manual failover to the Asynchronous Secondary Replica (Off site) ...
2
votes
0answers
69 views
Replacing full contents of SQL tables without user disruptions
I have a SQL Express 2012 DB in which there are tables that need frequent full "refreshs" (on-hours) from an external source without any disruption of the users. Let's say the tables are Item, ...
2
votes
1answer
924 views
Efficient join technique for two very large tables
I am working on a concept for database synchronization recently.
The scenario is as follows:
there is a master table "Items" with 1M+ rows in it
CREATE TABLE [dbo].[Item](
[Id] [...
0
votes
0answers
86 views
MariaDB galera cluster with Mroonga in wrapper mode doesn't synch
MariaDB Galera Cluster states that the storage engine needs to be InnoDB.
I am using Mroonga on some tables in wrapper mode {which uses InnoDB under the hood as storage engine}.
The problem I am ...
0
votes
2answers
39 views
Keeping database in synch
This might seem like a stupid question.
Can i restore logs of one database to another existing database of same schema.?
I have a database d1 in Server A.I took backup of that and restored as ...
0
votes
1answer
26 views
Get updated rows without triggers or timestamps
I'm working on a project with a client. The client has a MySQL Database with a few large tables (~100 million records each).
I've pulled the initial data.
I am required to sync the client's database ...
0
votes
1answer
91 views
ADD new node Replication in MongoDB
Here i found some trouble. and i don't known why!
Now I have one replication with 3 members (1 of primary, 2 of secondary),
And i want to add another one (secondary) to sync the data.
the data has ...
0
votes
1answer
18 views
Regularly clone/backup 2 MySQL databases unidirectionally from PC to Laptop both running Windows
I have a PC running Windows XP with a custom ERP system and MySQL Server 4.x (A) and a Laptop running Windows 10, same MySQL 4.x and same custom ERP (B). I'm afraid I can't upgrade PC nor MySQL, etc. ...
1
vote
2answers
52 views
Aggregating high volumes of data from many MySQL servers
I have 4 servers of MySQL, each receives around 4 million records a day.
I need to aggregate all the inserted records into another main server after doing some mapping processing to the aggregated ...
1
vote
0answers
490 views
SQL Server One Way Data Synchronization
I have 2 SQL Server Databases A and B, and I want to synchronize (continuously, every 10 minutes, max) the data from 70-80% percent of the tables from A to B (just A -> B, B is a read only database), ...
0
votes
1answer
198 views
How to prevent data loss during intra-site failover
We are looking to build a MS SQL server (either SQL server 2016 standard or enterprise edition) solution but are having some troubles. This post can be lengthy and if you think it is TLDR, our ...
1
vote
0answers
78 views
Synchronisation of multiple databases with GUID type
I have two databases. One is on mobile and uses SQLite and another one is on Microsoft azure.
I want to sync data in both directions. Sometimes some data is saved on azure db and should be ...
0
votes
1answer
32 views
Compare the contents of a single column and sync rows in that colum [closed]
This is SQL Server - I have 3 rows of data in a single table based on location I want the data for a single field to match in all three locations e.g I have parts in three locations, location 1, 2, ...
1
vote
0answers
54 views
data synchronization between two dbs
I need your help on some replication matter I guess.
I'm actually not a dba, but I need to do some work on my db:
I have a remote db, with table1, table2 and a local db with table3 and table4 in local ...
0
votes
1answer
522 views
PostgreSQL warm standby: sync WAL files
I'm new to PostgreSQL (using ver 8.4.20) and need to setup a master and standby SQL server setup. I am planning to use warm standby setup. I have read the docs on PG and understand the basics, but a ...
1
vote
1answer
658 views
How can I synchronise Always Encrypted data from On-Premises to Azure SQL Database (near real time)?
Let's say I have On Premises SQL Server 2016 SP1 and Azure SQL Database.
There is no way at this point to redirect whole solution directly to Azure SQL Database and I need to have a copy of the ...
6
votes
1answer
366 views
sync MS SQL Server 2014 and Express 2014 Database using Stored Procedure
I have C# windows form application and I have same database schema on both MS SQL Server(for master user) and on SQL Express(for clients). My database size is around 2 GB for each client.
I want to ...
0
votes
1answer
395 views
Data drift on Row-Based-Replication
i've realized that one of my mysql slaves has missing rows.
select count on specific table on master:
9605010
on slave:
9593831
slave is completely sync,
no seconds_behind_master,
no errors,
no slow ...
2
votes
1answer
638 views
Incremental sync for Sql Server
The Change Tracking feature of Sql Server allows to identify the modified rows of a modified database copy.
This is obviously helpful for sync jobs, as the database can then be synced incrementally.
...
1
vote
1answer
236 views
Merge Replication customize synchronization cycle and its performance
I'm trying to implement Merge Replication between just two servers, a publisher and one Subscriber.
Assume these tables :
--Main table in Publisher
Ticket (id, userId, reqId, blockedDate, usedDate, ...
0
votes
2answers
4k views
Linked Server : Syncing two tables on two SQL Servers
Suppose these database structure :
--On main server(server)
TicketRequest (id, date, count, start, end/*,and some other columns*/)
Ticket (id, reqId, blockedDate, usedDate, userId/*,and some other ...
2
votes
2answers
1k views
Post Mortem Analysis: PostgreSQL replication failed
We have a PostgreSQL 9.4.9 production server which was replicating to a slave instance, but today I discovered that the instance is out of sync!
The obvious actions would be to recreate the slave, ...
