Skip to main content

Questions tagged [distributed-databases]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
0 votes
1 answer
45 views

I need to move from sqlite to a distributed setup. What are my options?

I have an sqlite db that has grown to 30gb and I'm still pushing data to it everyday. I have a couple services that write to it using libsqlite3. Soon it will become too big to keep locally. What is ...
thewolf's user avatar
  • 101
0 votes
0 answers
16 views

Distributions when only one physical node

Working on Azure Synapse, we have for now around 30 tables on a dev environment. I want to optimize the tables before replicating them in qal and prod env. As far as I understand, we only have one ...
Gregoire_M's user avatar
1 vote
2 answers
103 views

Safe upgrade routine for Cassandra

I've been tasked with upgrading an Ubuntu based Cassandra cluster - having no prior experience with Cassandra. I've tried digging through the docs but have been unable to find any instructions on how ...
azzid's user avatar
  • 113
0 votes
1 answer
3k views

The remote copy of database has not been rolled forward to a point in time that is encompassed in the local copy of the database log

Can someone help me with the issue I'm dealing with? I had to force failover from my primary datacenter to my secondary datacenter and I forgot to disable the log backup job. Meanwhile the new ...
alireza's user avatar
0 votes
1 answer
35 views

Should I create 2 different databases if they would keep 70% similar data?

I am writing a microservices based NodeJS-Cassandra application and I haVe few services they would need 70% similar data( like username, avatar, videos, etc.) and I am just wondering to know is it a ...
best_of_man's user avatar
3 votes
1 answer
118 views

How do distributed databases follow unique constraints?

Lets say i have an application where user can register, and the username has to be unqiue value. Now lets say i have N partitions and for each partition i have M replicas with multiple leaders. Now i ...
Johnyb's user avatar
  • 131
0 votes
2 answers
536 views

What is the real advantage of using a UUID instead of an auto-incremented element?

I've been looking at resources to understand UUIDs. I now understand what they are, but I still don't really see where they are truly useful. Most of the information I've found revolves around the ...
masonCherry's user avatar
0 votes
1 answer
166 views

How repeatable read isolation level and others are implemented in distributed/replicated databases?

I'm studying distributed systems/DBs and I'm struggling understanding isolation levels when we talk about distributed systems. Avoiding problems like dirty read, non-repeatable read, phantom reads, ...
Dev's user avatar
  • 1
9 votes
3 answers
5k views

Why is it more difficult to horizontally scale a relational database than a NoSQL database like MongoDB?

Is the main reason for the difficulty in horizontally scaling / distributing an RDBMS because of an adherence to ACID transactions? Is it the fact that multiple tables are so interconnected, or ...
Greg Thomas's user avatar
0 votes
1 answer
637 views

Multi master vs leader-follower

Sorry if I ask this basic question. I am reading different articles and trying to understand how it works. Lets suppose I have two master DB(MySQL) in two different availability zone and two different ...
Learner's user avatar
0 votes
1 answer
348 views

Shortest paths on huge graphs: Neo4J or OrientDB?

Kia Ora, I have a program that very frequently requires finding the fastest path (both the node sequence and total cost/length) on graphs containing ~50k nodes. Per run, I require on the order of ...
Jordan MacLachlan's user avatar
-1 votes
1 answer
1k views

Perform a transaction across multiple databases at the same time

I have a system which performs many actions frequently and am looking at splitting databases up a bit to spread out the load and speed up the system hopefully. The fear is that by splitting up these ...
Trevor's user avatar
  • 127
0 votes
0 answers
236 views

SQL Server linked server query issue

I am using SQL Server 2016 and recently one of the stored procedures I have been using is throwing error. I use a select statement with joins on many tables to the remote server using a linked server ...
ITHelpGuy's user avatar
  • 109
1 vote
1 answer
1k views

Postgres Citus error "complex joins are only supported when all distributed tables are joined on their distribution columns with equal operator"

I have two tables defined as distributed in Citus based on the same field: select create_distributed_table('gedi','clould_metadata_id'); select create_distributed_table('cloud_metadata','...
Mauro Assis's user avatar
2 votes
1 answer
36 views

How to model local exceptions to distributed tables

I am looking for possible ways to model a distributed table(s) and provide local exceptions to that table. Consider a situation where head office publishes a list of products/prices that is ...
rlb's user avatar
  • 123
1 vote
1 answer
176 views

TimescaleDB distributed setup strategy

What is the best setup strategy for TimescaleDB? My initial thoughts based on the TimescaleDB FAQ was that it is indeed recommended and possible to basically have one database that contains both time ...
Sylvain's user avatar
  • 189
0 votes
1 answer
16 views

Distribute database elements [closed]

I have questions regarding the distributed database elements and environment : What is the exact meaning of a transaction processor and where does it exists in a distributed environment ? What is ...
John adams's user avatar
0 votes
1 answer
142 views

Config enable sharding collection in MongoDB cluster

I'm a new in MongoDB cluster. I have a question about config enable shading collection in MongoDB: I have a cluster : Shard1: replical01/node1:27017, node2:27017 Shard2: replical02/node3:27017, ...
muon.ha's user avatar
1 vote
1 answer
105 views

Database distribution in AlwaysOn

Good morning all, I have an on Always On SQL server configuration where transactional replication is configured If I open SSMS I find that the distribution database is set to AlwaysOn on then I cannot ...
Abdallah Mehdoini's user avatar
2 votes
1 answer
1k views

What are version vectors?

Folks, I am currently learning about distributed data systems via the book "Designing Data-Intensive Applications". I think I have a pretty strong understanding about how version numbers in ...
Steven L.'s user avatar
  • 165
2 votes
2 answers
9k views

What configurations do I need to fix the "unable to begin a distributed transaction" error when trying to run a remote procedure?

This is the error message I'm receiving: Msg 7391, Level 16, State 2, Procedure spStoredProc, Line 62 [Batch Start Line 1] The operation could not be performed because OLE DB provider "SQLNCLI11" ...
J.D.'s user avatar
  • 38.3k
1 vote
1 answer
93 views

When is running a graph database like OrientDB in cluster mode required?

OrientDB can run in a distributed environment, supports ACID transactions and peer to peer replicaiton. According to the book "NoSQL Distilled: A Brief Guide to the Emerging World of Polyglot ...
Darkov's user avatar
  • 113
0 votes
1 answer
121 views

NON-Random UUID keys in custom distributed DB

Is there any reason other than security for using random (or even semi-random) UUIDs as primary keys to database records? Is there any reason why I should not WANT to be able to use the UUID to ...
squarewav's user avatar
  • 101
0 votes
1 answer
55 views

Multi master mysql with automerge data if node disconnected

I have final project for my course about distributed system, so here the case : A company need 3 database server ( example : database a,b,c ) who works together. So if someone insert a data to ...
Smith's user avatar
  • 3
0 votes
1 answer
2k views

Multi Master replication vs Single-Master performance

I'm trying to wrap my head around a hypothetical scenario. Imagine we have a very write-heavy distributed database and sharding is not an option. I wonder if / how is multi-leader replication (...
Lyubomir's user avatar
  • 103
1 vote
0 answers
20 views

details on how to connect to geographically close datacenter

I am reading a book about distributed systems. One of the options of data replication mentioned is the use of a "multi leader" approach and place each leader in a different datacenter. The main point ...
sanjihan's user avatar
  • 263
2 votes
1 answer
2k views

Horizontal and Vertical Fragmentation on Distributed Database

My Architecture: I need to build a database with SQL Server, where the data from each server is distributed to the other server. How can I achieve this kind of architecture? How do I maintain ...
Nemesius's user avatar
0 votes
0 answers
68 views

SQL Server Horizontal Partition on DDB

Hi i need to have three databases each one on one sql server that are on connected by network. The main concern is we need to have horizontal partition for a table by the id, How do we do that in ...
Nemesius's user avatar
1 vote
1 answer
250 views

What Geopartioning or distributed SQL database can I use? [closed]

I want to split medical data on multiple nodes because I have Swiss, Europeans and Americans and I need to store data in citizen country. I don't want to manage this function in App but in the SQL ...
Nicolas's user avatar
  • 13
10 votes
1 answer
6k views

What is the difference between Federated and Decentralized Data Warehouse?

I can not find any clear definitions or explanations of any of these. Both seem decentralized. It appears that in Federated DWH, the data is distributed and not integrated into a single repository and ...
LifeH2O's user avatar
  • 201
2 votes
1 answer
659 views

How can coupled databases be kept in sync with selective uni-directional syncing and with connections that can be off for days?

I am trying to create a database topology that looks like this: .------------. Bad Connection. Bad Connection. | Central DB | May go offline May go offline '-----...
284507243's user avatar
1 vote
1 answer
682 views

Queries return ReadFailure exception, "Replica(s) failed to execute read"

I've a cluster consisting of 5 cassandra nodes. The cassandra version used is cassandra-3.11.3-1.noarch The keyspace strategy and is defined as follows: CREATE KEYSPACE my_keyspace WITH ...
Valentin Bajrami's user avatar
1 vote
0 answers
19 views

Is a distributed database needed for a low-data use, quick read, low write, AP system?

this may not be the proper place to ask this question, but I was not welcome posting it on StackOverflow so I thought this may be a good place. If this is the wrong place, please refer me to the right ...
Code Wiget's user avatar
1 vote
0 answers
112 views

NuoDB - Where's the catch?

I've been reading on the promise of an ACID compliant database management system without sacrificing horizontal scaling capabilities. Where is the catch? Which part of the CAP theorem did they choose ...
IgorR's user avatar
  • 23
0 votes
1 answer
1k views

What's MongoDB's default behaviour when no sharded collection is specified

When we deploy a Sharded Cluster, without having a sharded collection in our database, what is the default behaviour of MongoDB? How does MongoDB, distributes the data across the shards?
mackatozis's user avatar
6 votes
1 answer
22k views

Insert into linked server fails with "The transaction manager has disabled its support for remote/network transactions"

Two servers: sq009 and sq202, both running SQL Server 2012 SP3. sq202 is the SQL Server hosting the DB for our ERP system, Sage 500. sq009 is the SQL Server hosting the DB for our IBM Maximo instance....
Brie's user avatar
  • 161
3 votes
0 answers
497 views

Git as distributed and decentralized storrage with regard to ACID and CAP

When using Git to store documents distributed and decentralized it can be considered as a database. How would the ACID properties and the CAP theorem correspond to git in this case? I think one has ...
white_gecko's user avatar
-1 votes
1 answer
995 views

Database structure for a customer shopkeeper website

I am working on a project in which there will be two spaces for the customer and the shopkeeper. Multiple shopkeepers can insert data and can modify the products in their shop(they will have a unique ...
Rohit Saroha's user avatar
1 vote
1 answer
54 views

Is there a way to configure a distributed environment with mongodb? [closed]

Can I configure a distributed environment system with mongodb? (For example, master and slave structures) My job is to insert the data into the master and read the data, Slave nodes read data by ...
김태수's user avatar
0 votes
1 answer
936 views

MySQL Replication after a set period of time

I have a question about MySQL replication: can I set the slave DBs to only poll the master DB for information once every 10 seconds? Our MySQL master DB is under fairly heavy load. By default, MySQL ...
teuber789's user avatar
  • 101
3 votes
1 answer
619 views

Best practice bring MS SQL database to remote sites

Currently we use terminalservers to enable remote users to work with a central LOB-application. The terminalserver is on the same LAN as the MS SQL-server. Now my question is: what is the preferred ...
roberth's user avatar
  • 131
1 vote
0 answers
112 views

What's an example of a Distributed Database Query?

Since I may not come across or get a chance to use a distributed database system. I would like to understand an example of a Distributed Database Query. I know that in a distributed system, you have ...
Pierte's user avatar
  • 11
3 votes
1 answer
113 views

Can Cassandra be used to increase database write rate?

I am developing a database for an analysis job that requires parsing terabytes of information into a database. My job is to create and populate a database and using it to answer analyst's questions. ...
kingledion's user avatar
1 vote
0 answers
81 views

Is it possible to have a partition to distribute transaction load horizontally in SQL Server 2016?

In Cassandra, you can have a partition key to align partitions to particular server nodes. My understanding is that you can distribute transactional responsibility horizontally in SQL Server 2016 (...
hawkeye's user avatar
  • 167
0 votes
1 answer
1k views

Distributed database for worldwide LIDAR point cloud [closed]

I have an idea for a project that would build a free worldwide 3D scan of the real world. You may think of it as a high-definition version of OpenStreetMap (OSM) project. The point cloud data would ...
Kozuch's user avatar
  • 111
0 votes
1 answer
148 views

generate unique primary key for all clients from the local database and NOT the server

I'm using MySQL Innodb database to work as a distributed database among many places and also each place will work offline but at the end all the data will be centralized in one server, I want to ...
Bayar's user avatar
  • 101
2 votes
1 answer
1k views

Replication Subscribers and AlwaysOn Availability Groups (SQL Server)

I have AlwaysOn Availability Groups configured with Replication Subscribers, and is currently running successfully with one publisher using the command below. -- commands to execute at the publisher, ...
Gulrez Khan's user avatar
7 votes
1 answer
19k views

Horizontally scaling SQL Server, distributing the database with sharding

I wanted to know if there is any way to distribute a SQL Server (I'm using 2012 version) database accross multiple nodes. I'm trying to compare READ queries performance between SQL Server and MongoDB. ...
user98851's user avatar
3 votes
2 answers
3k views

Distributed database implementation in sql server

Currently, We have central Database at Head Office and users from sub offices ,scattered around the country, connect to central database. Now we want to distribute the database in disconnected mode at ...
user97461's user avatar
2 votes
0 answers
229 views

Distributing MS Access Database

I develop an application that saves records in MS Access DB. Each user has it own DB copy on his local machine, and there is a central DB that reflects all the copies from everyone. The central DB is ...
user3165438's user avatar