Questions tagged [data-synchronization]
The data-synchronization tag has no usage guidance.
0
votes
1answer
25 views
Best way to back-up MySQL production database to another database [closed]
The case:
I have a very large MySQL production database. Due to performance problems I want to periodically clean-up this database automatically. Before cleaning-up I want to do an incremental backup ...
0
votes
1answer
48 views
Master Master replication rows not sync properly
I have a wordpress website that run on 3 machines
Machine1 | Machine 2 {nginx+lsyncd+mysql}
visitor > cloudflare > haproxy ------
...
0
votes
0answers
70 views
Sync PostgreSQL with Cloud and multi Local Locations
I need help with a complex (for me) multi server setup with PostgreSQL.
I have to setup a Cloud Server and 3 Local Servers for our company.
Each Server will have:
Linux Ubuntu 16.04
Docker
...
0
votes
0answers
409 views
SQL Server 2016 Availability Group (Primary Unable to Read/Write)
We have a 3 replica SQL Server 2016 availability group. When the secondary synchronous goes unhealthy the database that resides on the primary becomes unreadable / unwritable, at this time the primary ...
0
votes
1answer
24 views
MySQL synchronization
I have a cloud-based MySQL instance (slave) and am planning a solution where a remote instance (master) will be based on a ship. The ship will go in and out of international waters and therefore will ...
0
votes
1answer
24 views
Tools to ingest data to database in periods [closed]
We have an application that can work with Oracle or MySql or SQLServer databases. Also, there is a 3rd party data source that we need to have it's latest data records in our database every 15 minutes. ...
0
votes
2answers
136 views
Sync two postgres databases from two sperate locations with no network
I have 2 postgres databases running the same schemes on two different computers, that are not guaranteed to have any network connection while having to handle read/write requests.
Because they ...
0
votes
1answer
44 views
How to insert data from a local MSSQL db table to a remote MSSQL db table using WCF application coded in .NET [closed]
I made a WPF application using VS2013, coded in .NET. It is working fine in my local SQL Server. But I want to use it to upload data from a local database to a remote database. How can I do this?
I ...
0
votes
1answer
19 views
Archival copy of table, including overwrote data [closed]
I have database server, with a database and table. The database and table can not be changed by me to ensure 3rd party support but the server configuration and MySQL configuration can be. On that ...
0
votes
1answer
149 views
MySQL slave only views
We are kind of struggling while creating the infrastructure for our BI sector.
I had read on this link that it is possible to create views on a read-only slave. Still, when I run the query I get
"...
1
vote
1answer
22 views
Backup weekly current production db to Historical db server [closed]
I have a production sql db of 600gb and a historical server where i move the full db every month.
Now we want to have only the last 3 months information on the production server, and move every week ...
1
vote
1answer
47 views
Automating Redshift data dump to a PostgreSQL DB every hour
GIS analyst with minimal experience of this back-end stuff but a big task at hand. I have a redshift database that changes multiple times a day. I want to use this "live" data to make web maps and I ...
0
votes
2answers
58 views
Synchronize SQL server databases
We have the following scenario:
We have several SQL serves instances in distributed geographic areas (distributed buildings) (in a city or maybe globally)
All the SQL servers run one snapshot of a ...
1
vote
1answer
101 views
Problems of having DR as Synchronous Commit
In our always on set up we have One Primary and One Secondary as Synchronous Commit and the DR as asynchronous commit. If i want to change the DR to Synchronous Commit will there be any performance ...
1
vote
3answers
359 views
Mysql master-master: single table out of sync
I have a master-master MySQL 5.7, everything works fine except for one error which is rising from time to time.
If I run a show slave status\G on server2 I have an error on a table:
...
Last_Errno: ...
0
votes
1answer
33 views
Failover from Primary to Asyn Secondary Replica
In my environment we have 1 Primary 1 Synchornous Secondary and 1 Asynchronous Secondary Replica (Off site). We are planning to do a manual failover to the Asynchronous Secondary Replica (Off site) ...
2
votes
0answers
65 views
Replacing full contents of SQL tables without user disruptions
I have a SQL Express 2012 DB in which there are tables that need frequent full "refreshs" (on-hours) from an external source without any disruption of the users. Let's say the tables are Item, ...
2
votes
1answer
473 views
Efficient join technique for two very large tables
I am working on a concept for database synchronization recently.
The scenario is as follows:
there is a master table "Items" with 1M+ rows in it
CREATE TABLE [dbo].[Item](
[Id] [...
0
votes
0answers
80 views
MariaDB galera cluster with Mroonga in wrapper mode doesn't synch
MariaDB Galera Cluster states that the storage engine needs to be InnoDB.
I am using Mroonga on some tables in wrapper mode {which uses InnoDB under the hood as storage engine}.
The problem I am ...
0
votes
2answers
39 views
Keeping database in synch
This might seem like a stupid question.
Can i restore logs of one database to another existing database of same schema.?
I have a database d1 in Server A.I took backup of that and restored as ...
0
votes
1answer
25 views
Get updated rows without triggers or timestamps
I'm working on a project with a client. The client has a MySQL Database with a few large tables (~100 million records each).
I've pulled the initial data.
I am required to sync the client's database ...
0
votes
1answer
75 views
ADD new node Replication in MongoDB
Here i found some trouble. and i don't known why!
Now I have one replication with 3 members (1 of primary, 2 of secondary),
And i want to add another one (secondary) to sync the data.
the data has ...
0
votes
1answer
17 views
Regularly clone/backup 2 MySQL databases unidirectionally from PC to Laptop both running Windows
I have a PC running Windows XP with a custom ERP system and MySQL Server 4.x (A) and a Laptop running Windows 10, same MySQL 4.x and same custom ERP (B). I'm afraid I can't upgrade PC nor MySQL, etc. ...
1
vote
2answers
49 views
Aggregating high volumes of data from many MySQL servers
I have 4 servers of MySQL, each receives around 4 million records a day.
I need to aggregate all the inserted records into another main server after doing some mapping processing to the aggregated ...
1
vote
0answers
394 views
SQL Server One Way Data Synchronization
I have 2 SQL Server Databases A and B, and I want to synchronize (continuously, every 10 minutes, max) the data from 70-80% percent of the tables from A to B (just A -> B, B is a read only database), ...
0
votes
1answer
169 views
How to prevent data loss during intra-site failover
We are looking to build a MS SQL server (either SQL server 2016 standard or enterprise edition) solution but are having some troubles. This post can be lengthy and if you think it is TLDR, our ...
1
vote
0answers
61 views
Synchronisation of multiple databases with GUID type
I have two databases. One is on mobile and uses SQLite and another one is on Microsoft azure.
I want to sync data in both directions. Sometimes some data is saved on azure db and should be ...
0
votes
1answer
32 views
Compare the contents of a single column and sync rows in that colum [closed]
This is SQL Server - I have 3 rows of data in a single table based on location I want the data for a single field to match in all three locations e.g I have parts in three locations, location 1, 2, ...
1
vote
0answers
49 views
data synchronization between two dbs
I need your help on some replication matter I guess.
I'm actually not a dba, but I need to do some work on my db:
I have a remote db, with table1, table2 and a local db with table3 and table4 in local ...
0
votes
1answer
419 views
PostgreSQL warm standby: sync WAL files
I'm new to PostgreSQL (using ver 8.4.20) and need to setup a master and standby SQL server setup. I am planning to use warm standby setup. I have read the docs on PG and understand the basics, but a ...
1
vote
1answer
601 views
How can I synchronise Always Encrypted data from On-Premises to Azure SQL Database (near real time)?
Let's say I have On Premises SQL Server 2016 SP1 and Azure SQL Database.
There is no way at this point to redirect whole solution directly to Azure SQL Database and I need to have a copy of the ...
6
votes
1answer
337 views
sync MS SQL Server 2014 and Express 2014 Database using Stored Procedure
I have C# windows form application and I have same database schema on both MS SQL Server(for master user) and on SQL Express(for clients). My database size is around 2 GB for each client.
I want to ...
0
votes
1answer
337 views
Data drift on Row-Based-Replication
i've realized that one of my mysql slaves has missing rows.
select count on specific table on master:
9605010
on slave:
9593831
slave is completely sync,
no seconds_behind_master,
no errors,
no slow ...
2
votes
1answer
510 views
Incremental sync for Sql Server
The Change Tracking feature of Sql Server allows to identify the modified rows of a modified database copy.
This is obviously helpful for sync jobs, as the database can then be synced incrementally.
...
1
vote
1answer
218 views
Merge Replication customize synchronization cycle and its performance
I'm trying to implement Merge Replication between just two servers, a publisher and one Subscriber.
Assume these tables :
--Main table in Publisher
Ticket (id, userId, reqId, blockedDate, usedDate, ...
0
votes
2answers
3k views
Linked Server : Syncing two tables on two SQL Servers
Suppose these database structure :
--On main server(server)
TicketRequest (id, date, count, start, end/*,and some other columns*/)
Ticket (id, reqId, blockedDate, usedDate, userId/*,and some other ...
2
votes
2answers
1k views
Post Mortem Analysis: PostgreSQL replication failed
We have a PostgreSQL 9.4.9 production server which was replicating to a slave instance, but today I discovered that the instance is out of sync!
The obvious actions would be to recreate the slave, ...
1
vote
1answer
39 views
What's the correct behavior for mongoDB when mongo hosts in two DC can't talk to each other
Let's assume there are two data centers: DC1 and DC2.
In DC1:
Two mongodb hosts, one primary, one secondary. All mongo hosts in DC1 have the readPreferenceTag: dc:"DC1"
Two app host, the ...
2
votes
0answers
52 views
Periodically synchronise databases on 2 different servers
On my main development workstation I have around 20 databases. Every so often I will work from home on my laptop instead, where I also need a copy of these databases. Because working from home is ...
1
vote
1answer
145 views
Partial SQL Server database synchronization [closed]
I have 2 SQL Server databases and they have somewhat different schemas.
But there is a table with person attributes.
Name, address, city, email, etc...
And an account key. on both tables.
Can SQL ...
1
vote
2answers
372 views
What are possible ways of handling multiple users accessing the same database via custom web API? [closed]
I am very new to databases and Web design, but I understand enough to know that designing a good database is crucial, so I would like to prepare for that conceptually. However, I was unable to find ...
0
votes
2answers
220 views
Local and cloud database sync missing data only
We have set up an IOT device which records a lot of data. This data always makes it into the local gateway mysql database, and if there is an internet connection then it also goes into the cloud ...
0
votes
1answer
171 views
Selective synchronization between distributed clusters
What's the best practice for the following scenario:
I've an embeded device with a single, lightweight database;
a powerful server with a cluster;
a cluster in the cloud.
I'd like to synchronize the ...
1
vote
2answers
533 views
Azure SQL Database in different locations
I'm deploying a Sitecore website using Azure and Azure SQL, and one of the requirements is to have some of the databases in different Azure Regions but sharing the same data among the other databases.
...
0
votes
1answer
51 views
Updating data when data is from an external source
A government organization provides data in a series of files which can be re-engineered and imported into a database. The files are updated monthly. I have been able to reengineer the database in ...
2
votes
1answer
6k views
Offline to Online database synchronization programmatically using PHP and MySQL [closed]
I am working on a project in which the client requires an online as well as an offline application. Offline application data will be manually synced to online database linked to the web application.
...
1
vote
0answers
40 views
Table sync without admin rights
I have a client that really (really, REALLY!) wants to use a standard database server through a specific hosting company. That company offers vanilla installs of PostgreSQl and MySQL only.
The client ...
1
vote
0answers
160 views
Sync data from tables in two SQL Servers
In a following app arhicecture, local C# desktop app with SQL Server Express, which need to work offline sometimes and a central web app with SQL Server Enterprise, with db per local app.
I need to ...
0
votes
1answer
2k views
Why CTX_DDL.SYNC_INDEX procedure doesn't work?
I'm following the Oracle documentation to create indexes with Oracle Text. The problem is, when I update my data and want to synchronize my index with the CTX_DDL.SYNC_INDEX procedure (according to ...
2
votes
1answer
59 views
Oracle strategy
I would like to ask you to help me with following situation:
I have 2 servers. One is production and secondary is backup. Both are in 2 different geographical localizations. Switch between them in ...
