Questions tagged [data-synchronization]
The data-synchronization tag has no usage guidance.
186
questions
0
votes
0answers
11 views
Synchronise a database using another database
We are building an e-commerce marketplace application with MySQL as the database. Multiple vendors can manage their inventory here. Our primary vendor who owns this application wants to synchronize ...
0
votes
0answers
22 views
how to sync one table of AWS RDS to another RDS
I have requirement like need to synchronize one table of data (contain user list) in AWS RDS instance to another RDS Instance.
only particular user's table need to synchronize.
ex: RDS-1 have schema ...
-3
votes
2answers
111 views
Sync databases from different servers [closed]
I have the following setup:
One SQL Server on one side, another on the other. The two can't connect, so no possibility to a linked server. It is possible to place the MDFs and LDFs in a shared folder. ...
0
votes
2answers
73 views
Using Cloud and On Premise DB together in an Application
I am developing a textile shop application in .NET Core using the Entity framework. So I am developing it in Azure and using the same application for different shops using Shop ID as the primary key.
...
-1
votes
1answer
88 views
Query differences between two tables with identical definitions
I have two tables, A and B with identical columns. Table B can contain some rows where data are different from A. How can I write a query that shows rows that should be inserted into B, deleted from B,...
2
votes
2answers
169 views
Is partial synchronisation possible between two databases on different servers?
Imagine a scenario where you have a primary instance of a database and a secondary instance that is automatically synchronised - pretty much as with Availability Groups.
My question is whether I could ...
1
vote
0answers
28 views
Seeding new data daily in an ever changing database
I've been working with a data team that imports data from suppliers daily into a MySQL DB. The data from the supplier needs to be worked on by them and formatted properly before we can use it in ...
2
votes
2answers
155 views
How to ship new rows from the source to a target server?
Context
We have a SQL Server 'source' where daily 10M rows inserted to a table. No updates. I would like to ship the new rows to a 'target' server, then delete those (sooner or later) on the source ...
0
votes
1answer
420 views
Why availability group resource goes offline in WSFC?
Sometimes I find the AG Cluster role in offline state which results the AG in resolving state. It doesn't allow the application to access the databases during this time. And then after sometime it ...
3
votes
1answer
806 views
Setting up cloud database for syncing to local SQLite database
Background
I have a SQL Server database hosted on AWS RDS and there are web applications and WEB APIs that talk to the database. The database is a multi-tenant database and we are currently using SQL ...
0
votes
1answer
36 views
Database syncronization
I am working on a student project and I need some guidance on what solution I can use.
The goal of the project is to create a dummy web page that would send
dummy data to 2 databases(or read from one ...
0
votes
1answer
48 views
Database replication from local Postgres to live
I have a software whose data from its local Postgres server has to be synced to live database, so that I can query data from that live Postgres server via api. I am new to Postgres. So after a small ...
0
votes
2answers
163 views
Is it possible to use txid_current value for sync
I need to expose my data through Rest API for a mobile offline experience.
The idea is basically that a mobile client downloads all data to his device. after a week he wants to download only the ...
0
votes
1answer
1k views
What is the max network latency between synchronous-commit AlwaysOn Availability Groups [closed]
Is there a maximum supported network latency (ms) between two synchronous AlwaysOn replica?
I need to give this information to network administrators for configuring the link between the two nodes of ...
0
votes
1answer
48 views
Azure Data Sync Between Two Azure Databases
I would like to ask if I use Azure data sync with my two azure databases is there any way that I can still download data tier and install it on my local machine. I am planning to create a sync between ...
0
votes
2answers
343 views
what are the best ways to sync two databases in sql server or azure sql db?
I have a question like syncing two different databases available on two different servers/instances.
lets say Source be the source server and sourcedb is the source database.
destinationdb is the ...
0
votes
1answer
182 views
How to resynchronize replica in Postgresql
I have a server with Centos6 and Postgresql 9.2, I have set up a replica in postgresql to another server of the same characteristics, today in the morning I have an error in the archiver process on ...
1
vote
1answer
306 views
Will a MERGE between two tables ever be faster than a DROP and SELECT INTO on the second table?
Is there a scenario where it's faster for synchronizing the data from TableA to TableB by using a MERGE query as opposed to dropping TableB and doing a SELECT * INTO TableB FROM TableA?
1
vote
2answers
124 views
For AlwaysOn AGs, can a secondary replica cause contention on the primary when the resources of the secondary are maxed out?
Is it possible and in what ways can the secondary replica cause contention against the primary replica when the secondary replica's resources are maxed out (e.g. does the primary "lock" up while ...
0
votes
1answer
83 views
How to use a MySQL database both remotely and locally
I cannot find the best solution for my problem.
I made a C++ application which runs on a Kiosk under Ubuntu that needs to store and retrieve data from a MySQL database and these same data need to be ...
7
votes
1answer
287 views
Is there a way to determine what kind of data is sitting in the Redo Queue for an AlwaysOn AG Secondary Replica?
Do any of the DMVs or is there another way to expose what kind of data is in the Redo Queue that's in process of being synced up to a secondary replica? (E.g. is it table data and which table, or is ...
2
votes
1answer
4k views
What's the cause for an AlwaysOn AG Secondary Replica to have a high Redo Queue Size and Estimated Recovery Time with a good Redo Rate?
SQL14 is the Primary server, SQL16 is the Secondary Replica, and they're setup using synchronous commit availability mode:
As of yesterday it appeared that data stopped synchronizing from the primary ...
1
vote
1answer
39 views
How would I maintain referential integrity across a database where I use versioned records while keeping data in sync?
I am building a database that consists of a few tables that are used as data sources for a form our application generates.
[form] [question] [responses]
id id id
name ...
0
votes
0answers
39 views
Options for syncing from a MASTER table to a COPY table?
I have a MASTER table and a COPY table in separate databases (both are Oracle 12c).
I want to sync the MASTER table with the COPY table on a weekly basis.
I can think of a few options for syncing ...
0
votes
1answer
30 views
Any way of forcing MySQL to use smaller files?
This is actually Maria DB. I'm using it on W10 and Linux Mint 18.3.
The issue here is that I recently strated to use Google Backup & Sync to sync between my various machines running W10 (I'm ...
0
votes
1answer
148 views
Best way to replicate MySQL database tables
I'm trying to wrap my head around the many options on how to possibly sync database tables automatically from one database to the next (and next, and next, ...).
We're trying to create a very simple ...
1
vote
4answers
258 views
Integration: Keep two systems in sync
I have a GIS system with 40 tables, ranging from 1,000 to 60,000 rows per table. The tables are the system of record for assets in a municipality.
The GIS assets in the tables get integrated to a ...
1
vote
0answers
155 views
SQL Server Merge Replication Error: The format of a message during Web synchronization was invalid
I am doing Merge Replication using Web Synchronization. On Subscriber end, there is SQL Express 2012 on Windows 10 Pro. On publisher end, there is SQL Server 2016 on Windows Server 2016. Web ...
0
votes
1answer
123 views
SQL transaction: Delete between two selects possible?
I have two SELECT statements within a transaction (repeatable read)
Select @firstItem =id from myTable Where ....
--Do some more magic, so I can't concat the the two queries!!!!
and
Select * from ...
0
votes
2answers
374 views
Sync database table schema and stored procedures
We have 2 databases. One is at our server, the other is local. We need to sync them both in a manner that local database has all data and server database has no data only empty tables and stored ...
0
votes
0answers
53 views
Database synchronization 2 times a day -MariaDB
I have 2 different servers. The first one is server1 and the other is server2. On servers, one works for websites (server1) and the other for mobile applications (server2) for security purposes. I ...
0
votes
1answer
429 views
Add a new node to Mongo Replicaset using Rsync
I have a 3 shard mongo cluster. Each shard has a 3 node replica set. On each shard, the data size is 3 TB.
I want to add 1 more node to each replica set. But its taking lot of time. The initial sync ...
0
votes
1answer
310 views
Change Data Capture in MySQL/PHP by writing to a MySQL table (rather than streaming to Kafka/Rabbit/etc)?
I have a small internal web app I'm developing with PHP and MySQL. I'm looking to sync client webpages to a server by requesting all changes since a certain date.
I've found a number of solutions ...
0
votes
3answers
2k views
Sync between two database on azure
I would like to ask a question how to setup azure syncing of two database on azure
i need real time data replication to the other database
0
votes
1answer
761 views
Load data from a temporal table to another temporal table in Azure
Currently we have only a Live Database where all our data resides. I have created a separate Azure server and DB for development.
The DEV DB should be some what up to date with the Live DB for ...
0
votes
1answer
174 views
Master Master replication rows not sync properly
I have a wordpress website that run on 3 machines
Machine1 | Machine 2 {nginx+lsyncd+mysql}
visitor > cloudflare > haproxy ------
...
1
vote
0answers
345 views
Sync PostgreSQL with Cloud and multi Local Locations
I need help with a complex (for me) multi server setup with PostgreSQL.
I have to setup a Cloud Server and 3 Local Servers for our company.
Each Server will have:
Linux Ubuntu 16.04
Docker
...
0
votes
0answers
5k views
SQL Server 2016 Availability Group (Primary Unable to Read/Write)
We have a 3 replica SQL Server 2016 availability group. When the secondary synchronous goes unhealthy the database that resides on the primary becomes unreadable / unwritable, at this time the primary ...
0
votes
1answer
134 views
MySQL synchronization
I have a cloud-based MySQL instance (slave) and am planning a solution where a remote instance (master) will be based on a ship. The ship will go in and out of international waters and therefore will ...
0
votes
1answer
37 views
Tools to ingest data to database in periods [closed]
We have an application that can work with Oracle or MySql or SQLServer databases. Also, there is a 3rd party data source that we need to have it's latest data records in our database every 15 minutes. ...
2
votes
2answers
3k views
Sync two postgres databases from two sperate locations with no network
I have 2 postgres databases running the same schemes on two different computers, that are not guaranteed to have any network connection while having to handle read/write requests.
Because they ...
0
votes
1answer
1k views
How to insert data from a local MSSQL db table to a remote MSSQL db table using WCF application coded in .NET [closed]
I made a WPF application using VS2013, coded in .NET. It is working fine in my local SQL Server. But I want to use it to upload data from a local database to a remote database. How can I do this?
I ...
0
votes
1answer
19 views
Archival copy of table, including overwrote data [closed]
I have database server, with a database and table. The database and table can not be changed by me to ensure 3rd party support but the server configuration and MySQL configuration can be. On that ...
0
votes
1answer
295 views
MySQL slave only views
We are kind of struggling while creating the infrastructure for our BI sector.
I had read on this link that it is possible to create views on a read-only slave. Still, when I run the query I get
"...
1
vote
1answer
27 views
Backup weekly current production db to Historical db server [closed]
I have a production sql db of 600gb and a historical server where i move the full db every month.
Now we want to have only the last 3 months information on the production server, and move every week ...
1
vote
2answers
508 views
Automating Redshift data dump to a PostgreSQL DB every hour
GIS analyst with minimal experience of this back-end stuff but a big task at hand. I have a redshift database that changes multiple times a day. I want to use this "live" data to make web maps and I ...
0
votes
2answers
176 views
Synchronize SQL server databases
We have the following scenario:
We have several SQL serves instances in distributed geographic areas (distributed buildings) (in a city or maybe globally)
All the SQL servers run one snapshot of a ...
1
vote
1answer
218 views
Problems of having DR as Synchronous Commit
In our always on set up we have One Primary and One Secondary as Synchronous Commit and the DR as asynchronous commit. If i want to change the DR to Synchronous Commit will there be any performance ...
1
vote
3answers
1k views
Mysql master-master: single table out of sync
I have a master-master MySQL 5.7, everything works fine except for one error which is rising from time to time.
If I run a show slave status\G on server2 I have an error on a table:
...
Last_Errno: ...
0
votes
1answer
38 views
Failover from Primary to Asyn Secondary Replica
In my environment we have 1 Primary 1 Synchornous Secondary and 1 Asynchronous Secondary Replica (Off site). We are planning to do a manual failover to the Asynchronous Secondary Replica (Off site) ...