Stack Exchange Network

Stack Exchange network consists of 175 Q&A communities including Stack Overflow, the largest, most trusted online community for developers to learn, share their knowledge, and build their careers.

Visit Stack Exchange

Questions tagged [nosql]

A catch-all term describing database systems using various non-relational models. Such systems are usually engineered to be high-performance.

0
votes
0answers
10 views

NoSQL big DB retrieve performance

A question about retrieving performance for simple but bug key-value DBs on python3. I am working on a pipeline to compare several entries based on key-values (genetic variants found in patients with ...
0
votes
0answers
7 views

How can I complete a full export and import of Google BigTable

!/bin/bash BigTable_ExportTest.sh Edited original source script with new bucket and jar file. This script will backup BigTable Data Table by table and store it into a destination location as ...
1
vote
1answer
26 views

Sharding the Existing MongoDB

I've got 3 dedicated non-virtual servers (srv1-3). On one of them (srv1) i've got MongoDB in production, that already have got really big amount of data. At the present time there is no sharding or ...
0
votes
1answer
23 views

Can't change MongoDB default DB path

I know there are multiple questions on the same issue and I followed them but not sure what is happening here. First of all I am trying to change the default db path to a a separate mounted disk. And ...
0
votes
1answer
18 views

Does any MariaDB engine have the option to declaratively or configuratively abstract highly-redundant data?

I have an application which is architected in a "NoSQL" style around one fully denormalized "main table" which currently just holds a primary key and one JSON-valued column. For reasons which are ...
0
votes
1answer
41 views

How to efficiently design Firebase database for Home service Booking application? [closed]

I'm planning to build my own app. It's a home service App to link users with other providers. I'm recently used a NoSQL database, Firebase, and I am stuck with the design of the database for my app. ...
1
vote
0answers
11 views

Metadata overhead warnings in couchbase web

I have 3 node couchbase cluster which is working fine but now days I am getting many alerts as "Metadata overhead warning. Over 54% RAM allocated to bucket" on couchabse web UI. Please help to supress ...
0
votes
0answers
14 views

replication type of dynamodb

What is the replication type of the DynamoDB system? Like is it master slave, peer to peer, multi master, or something else. I know that that for global tables, DynamoDB has cross replication with ...
1
vote
1answer
31 views

Should I use a RDBMS JSON field or a NoSQL database to store large JSON datasets that I don't need to query?

I am building a website that allows users to retrieve a bunch of open source chart (eg UN data). I don't need to be able to query the data itself. I will instead extract certain meta data (keywords, ...
-1
votes
1answer
32 views

MongoDB Performance of Overwriting an Array Field vs Individually Updating the items

The problem I am facing is basically updating the inventory when an order is received in a MongoDB database.The general hierarchy is as follows Manufacturer: { ... Items: [ ... ...
0
votes
2answers
133 views

Audit Trail in NoSQL vs. Relational DB, audit trail feature in MongoDB [closed]

Two questions regarding selection a DB type and engine for the scenario when the Audit Trail functionality is a must: Is there any preference in DB type (NoSQL/Relational) choice when the Audit Trail ...
2
votes
1answer
56 views

Microsoft Column Store Database?

Using Microsoft technologies/products is it possible to create a column store database with column family sets? That is each row being able to have a different number and type of columns. Colmun ...
0
votes
1answer
37 views

What is the best way to cross check the record in multiple collections

I am developing the application in which system will show the campaign content to users which he/s never seen. To keep the logs either the specific user seen the specific content or not, i am ...
1
vote
1answer
66 views

Hierarchical / tree data - which type of database to use & design?

For querying (and writing to) a hierarchical structure (like a folder containing files and other folders, up to n levels deep, where n is pretty small, probably around 10, and there would be lots of ...
3
votes
1answer
44 views

MySQL and PostgreSQL has JSON data types, is it the same as NoSQL database? [closed]

MySQL and PostgreSQL introduced JSON data types, is it the same as NoSQL database? Why? NoSQL here is a class of data bases similar to MongoDb and DynamoDB.
0
votes
4answers
127 views

How to tell if a project needs a NoSQL database solution? [closed]

How to tell if a project needs a NoSQL database solution? I think that SQL limits define it. If the project needs bigger database or bigger fields then it needs NoSQL. Am I right? I looked into ...
0
votes
0answers
23 views

Should images be embedded in a MongoDB document when there is a one to many relationship?

Please see the DDL below from my CQRS write database: CREATE TABLE Offer (ID uniqueidentifier NOT NULL, Description varchar(50), Image varbinary(max), primary key (ID)) CREATE TABLE Person (ID ...
1
vote
0answers
11 views

How to store a multi-lingual “dictionnary” in a NoSQL database?

I hope this is the good Stack to ask this question, pardon me if it's not. I need to categorize images and need manipulate a lot of words. I'll explain what's bugging me first and then there is a ...
1
vote
1answer
50 views

Clustered Index Scan on 5+ billion rows instead of using non clusterd index for <1000 rows

We have a huge SQL 2017 database containing more than 5 billion internetpages. One of the table contains the info about the page: PageID is the primary clustered key and UriKey is the non clustered ...
1
vote
2answers
42 views

NoSQL or MySQL for storing API usage

I need to be able to track API usage in order to generate reports or charts later. I've been struggling to decide whether to use regular MySQL or something like MongoDB or Elastic Search which I don't ...
1
vote
1answer
44 views

Suitable NoSQL DB design for a fleet of IoT devices [closed]

This is my use case: 10,000 IoT devices Each IoT device sends its environmental data (temperature, pressure, etc.) every 30 seconds Data of each device will be kept for 24 hours The main requirement ...
1
vote
1answer
114 views

MongoDB aggregation $unwind and 1NF

I have a basic rhetorical/theoretical question for people experienced using both MongoDB and RDBMS. Surprised SO has no Data Munging or Data Engineering forum. In making an aggregation pipeline in ...
0
votes
1answer
60 views

What is the point of a consistent and partition tolerant multi-master DB Architecture as opposed to Master-Slave

I should emphasize that my question is in regard to CP (Consistent and Partition Tolerant) systems. A lot of widely used NoSQL databases such as Mongo and Redis seem to fall in the CP category. And ...
1
vote
0answers
28 views

Coffee shop static tag/attribute querying (satisfying AND & OR condition groups) - Relational DB/DBMS or NoSQL?

Let's say you are storing information about coffee shops, and you want to assign an arbitrary number/assortment of static tags/labels to each cafe which act like attributes (i.e., the cafe either has ...
1
vote
0answers
174 views

Which is better schema for given discussion forum, MongoDB

Lets have two variants of nosql collection for storing discussion comments. Assume discussion, where is only one thread/root comment with 100 replies. A./ collection: discussion_thread (id, ...
1
vote
1answer
648 views

MongoDB update multiple sub documents inside array, each according to a condition

I have a document like this: { wid: 1, items: [ {nid: 1, sent: 900}, {nid: 2, sent: 12}, {nid: 3, sent: 0}, {nid: 4, sent: 1} ] } Now consider I want to ...
1
vote
1answer
21 views

Using a real certificate with rethinkdb cert chain bundle

I know the rethinkdb guide uses a self signed cert as an example. If I wanted to use a real certificate that I purchased, how can I add the bundle to the server conf? I add the certificate I purchased ...
1
vote
1answer
128 views

How to deal with unbounded growth in cassandra shards

Let's say we have a website like youtube where we have a comment session per e video. Users want to be able to comment and to see the comments made by other users by comment creation time. This is ...
1
vote
0answers
37 views

Designing a globally distributed database

We are trying to design a globally distributed Azure Cosmos DB and we’re not sure how to best do that: There is data that should be replicated in every region to improve read performance. This data ...
0
votes
1answer
25 views

Data replication in Cassandra

We have a 5 node cluster in Cassandra in which we have created a keyspace with RF=3. After creating a column-family(table) when we insert the data into the same, it is getting replicated in all the ...
0
votes
1answer
19 views

SQL Join vs NoSQL Wide column

If we need to have 2 tables, one storing the author info(author_info), & another storing all the books info(book_info). author_info has authorId as it's primary key, whereas the book_info table ...
3
votes
3answers
81 views

Storing ~700 Tb in SQL Db

I am a newbie to Db's on a whole, and I came across a tutorial, wherein we needed to store ~700 Tb of data over a few years. It was mentioned that scaling SQL for such limits of data is not the best ...
0
votes
0answers
10 views

how to get the top record or one record of exactly the same(duplicate) records with no unique across - Hive

I would like to return one record out of duplicate records with no uniqueness to it. id FN LN school Tile 1234 David pottier john F K soft dev 1234 ...
0
votes
1answer
115 views

Is it a good choice to choose NoSQL for a finance management app? [closed]

I am working on a personal finance management application, which will also analyse the user's financial statement and give a good overview about their expenses and savings. What I am having trouble ...
-1
votes
1answer
88 views

Unstructured point cloud data from MongoDB vs filesystem

NOTE: I am using geographic locations here in my question, but those who do image processing likely face similar questions/issues. That is why I've titled the question using unstructured point could ...
0
votes
0answers
37 views

No Sql DB structure for Bookmarks application

For going ahead with a bookmark application what would be the best database model in NoSql(Collection/Document). Also, I'm using firebase so it's not possible to do query nested documents in a single ...
1
vote
0answers
113 views

What is a good schema for a database where users can search for inventory availability on certain dates (such as Airbnb)?

I apologize if this is not the right venue to ask such a question. This is my first time on this site and I'm open to suggestions. I am trying to find a good schema for a database that needs to ...
0
votes
0answers
41 views

Efficiently to exclude a list of documents when query in documentDb?

Let's say we have two collection, a User collection and a Item Collection. User collection, each User document store the purchase product ids of the user. Item collection, each Item document store ...
0
votes
0answers
25 views

Is storing redundant data part of the (CouchDB) self-contained data concept?

The CouchDB concept speaks about self-contained documents. In other words: ALL related data is stored in a single concept, instead of splitting them in multiple tables and reference each other using ...
0
votes
2answers
102 views

what is difference between RDBMS and NoSql on basis of how information is store in them?

I am searching web to understand the underlying concept of how actually information is stored in RDBMS and Nosql databases and found this: In the world of database technology, there are two main ...
2
votes
0answers
1k views

Cassandra - High Number of Dropped Mutations (Specific Table on a specific Node in the cluster)

History Leading to this issue: My Compression strategy in Production was LZ4 Compression. But I modified it to Deflate For compression change, we had to use nodetool Upgradesstables to forcefully ...
2
votes
0answers
811 views

NoSql - Dynamo db - when do you need multiple tables?

I'm experienced in RDBMS, but new to NoSql. This aws dynamodb design advice says that "most well designed applications require only one table". I'm trying to wrap my head around that. I don't see a ...
0
votes
0answers
43 views

Couchbase backup validation

Need help regarding backup validations for couchbase, what is the best way / easiest way to validate couchbase backups. we have recently moved to couchbase and totally new to couchbase, having some ...
3
votes
3answers
156 views

Continuously move data from server A to Server B while deleting the data in server A?

I'm developing an ad server that is expected to handle ad impressions/billion clicks per day. The most difficult challenge I am facing is moving data from one server to another. Basically the flow ...
1
vote
1answer
1k views

Structuring change history data in MongoDB / NoSQL

I have a Chart on which I need to track changes; the Chart has several properties. A Chart also has a long list of items. So in C#, my Chart object looks like this: public class Chart { public ...
2
votes
2answers
29 views

Is Cassandra's manual node addition/removal tasks tedious and practical in a large cluster?

I am evaluating using Cassandra as a large key-value store over about 500 commodity machines. AFAIK, Cassandra requires manual intervention during permanent machine failures (removing the deadnode, ...
0
votes
1answer
262 views

How do I compare 1000 items every minute over 1 million records in mongodb without pulling all the data?

I am developing a real time stock price alert system that gets new prices every 1 min. There are 1000 tradable assets from one exchange currently and I plan to add other exchanges soon and 1 million ...
0
votes
3answers
848 views

Why to put unstructured data in NoSQL DBs?

The statement that NoSQL databases are better for unstructured data because of their schemaless nature can be found everywhere. Frankly, I don't understand that. A human voice recording is often be ...
0
votes
1answer
47 views

How best to store complex cost information

I am creating a database to store data related to costs. The cost information can be very varied and I won't be able to fully determine all possible columns currently. An example piece of data might ...
1
vote
1answer
105 views

What are the disadvantages of using Couchbase's Global Secondary Indexes (GSI)?

Couchbase's documentation on GSI states that Global Secondary Index is a powerful solution for secondary lookup queries that are required for interactive applications that require low latencies. The ...