Stack Exchange Network

Stack Exchange network consists of 174 Q&A communities including Stack Overflow, the largest, most trusted online community for developers to learn, share their knowledge, and build their careers.

Visit Stack Exchange
Make your voice heard. Take the 2019 Developer Survey now

Questions tagged [nosql]

A catch-all term describing database systems using various non-relational models. Such systems are usually engineered to be high-performance.

0
votes
2answers
48 views

Audit Trail in NoSQL vs. Relational DB, audit trail feature in MongoDB [on hold]

Two questions regarding selection a DB type and engine for the scenario when the Audit Trail functionality is a must: Is there any preference in DB type (NoSQL/Relational) choice when the Audit Trail ...
2
votes
1answer
52 views

Microsoft Column Store Database?

Using Microsoft technologies/products is it possible to create a column store database with column family sets? That is each row being able to have a different number and type of columns. Colmun ...
-1
votes
1answer
30 views

Load a database into a host or in place to which I can access from different applications [closed]

I've just started working with databases. I create them and modify them using Python as a means to create dinamically a good amount of data. Moreover all the applications that I develop are written ...
-1
votes
0answers
44 views

Database Design for Study Hall Reservation (with shared chairs) [closed]

Suppose we have a study hall that we want to implement a reservation system for it. Users could reserve specific time-span as "fromDate" and "toDate" by a calendar. Every Valid selected time span ...
0
votes
1answer
34 views

What is the best way to cross check the record in multiple collections

I am developing the application in which system will show the campaign content to users which he/s never seen. To keep the logs either the specific user seen the specific content or not, i am ...
1
vote
1answer
51 views

Hierarchical / tree data - which type of database to use & design?

For querying (and writing to) a hierarchical structure (like a folder containing files and other folders, up to n levels deep, where n is pretty small, probably around 10, and there would be lots of ...
3
votes
1answer
42 views

MySQL and PostgreSQL has JSON data types, is it the same as NoSQL database? [closed]

MySQL and PostgreSQL introduced JSON data types, is it the same as NoSQL database? Why? NoSQL here is a class of data bases similar to MongoDb and DynamoDB.
0
votes
4answers
121 views

How to tell if a project needs a NoSQL database solution? [closed]

How to tell if a project needs a NoSQL database solution? I think that SQL limits define it. If the project needs bigger database or bigger fields then it needs NoSQL. Am I right? I looked into ...
0
votes
0answers
19 views

Should images be embedded in a MongoDB document when there is a one to many relationship?

Please see the DDL below from my CQRS write database: CREATE TABLE Offer (ID uniqueidentifier NOT NULL, Description varchar(50), Image varbinary(max), primary key (ID)) CREATE TABLE Person (ID ...
1
vote
0answers
9 views

How to store a multi-lingual “dictionnary” in a NoSQL database?

I hope this is the good Stack to ask this question, pardon me if it's not. I need to categorize images and need manipulate a lot of words. I'll explain what's bugging me first and then there is a ...
1
vote
1answer
45 views

Clustered Index Scan on 5+ billion rows instead of using non clusterd index for <1000 rows

We have a huge SQL 2017 database containing more than 5 billion internetpages. One of the table contains the info about the page: PageID is the primary clustered key and UriKey is the non clustered ...
1
vote
2answers
40 views

NoSQL or MySQL for storing API usage

I need to be able to track API usage in order to generate reports or charts later. I've been struggling to decide whether to use regular MySQL or something like MongoDB or Elastic Search which I don't ...
1
vote
1answer
40 views

Suitable NoSQL DB design for a fleet of IoT devices [closed]

This is my use case: 10,000 IoT devices Each IoT device sends its environmental data (temperature, pressure, etc.) every 30 seconds Data of each device will be kept for 24 hours The main requirement ...
1
vote
1answer
76 views

MongoDB aggregation $unwind and 1NF

I have a basic rhetorical/theoretical question for people experienced using both MongoDB and RDBMS. Surprised SO has no Data Munging or Data Engineering forum. In making an aggregation pipeline in ...
0
votes
1answer
47 views

What is the point of a consistent and partition tolerant multi-master DB Architecture as opposed to Master-Slave

I should emphasize that my question is in regard to CP (Consistent and Partition Tolerant) systems. A lot of widely used NoSQL databases such as Mongo and Redis seem to fall in the CP category. And ...
1
vote
0answers
22 views

Coffee shop static tag/attribute querying (satisfying AND & OR condition groups) - Relational DB/DBMS or NoSQL?

Let's say you are storing information about coffee shops, and you want to assign an arbitrary number/assortment of static tags/labels to each cafe which act like attributes (i.e., the cafe either has ...
1
vote
0answers
119 views

Which is better schema for given discussion forum, MongoDB

Lets have two variants of nosql collection for storing discussion comments. Assume discussion, where is only one thread/root comment with 100 replies. A./ collection: discussion_thread (id, ...
1
vote
1answer
327 views

MongoDB update multiple sub documents inside array, each according to a condition

I have a document like this: { wid: 1, items: [ {nid: 1, sent: 900}, {nid: 2, sent: 12}, {nid: 3, sent: 0}, {nid: 4, sent: 1} ] } Now consider I want to ...
1
vote
0answers
36 views

More scalable solution than MySQL - big inserts, analytic queries [closed]

We need to store a huge and growing amount of order data in a database. We currently use MySQL on AWS RDS for this purpose, but we are looking for a more scalable solution. We currently have around 50 ...
1
vote
1answer
17 views

Using a real certificate with rethinkdb cert chain bundle

I know the rethinkdb guide uses a self signed cert as an example. If I wanted to use a real certificate that I purchased, how can I add the bundle to the server conf? I add the certificate I purchased ...
1
vote
1answer
95 views

How to deal with unbounded growth in cassandra shards

Let's say we have a website like youtube where we have a comment session per e video. Users want to be able to comment and to see the comments made by other users by comment creation time. This is ...
1
vote
0answers
31 views

Designing a globally distributed database

We are trying to design a globally distributed Azure Cosmos DB and we’re not sure how to best do that: There is data that should be replicated in every region to improve read performance. This data ...
0
votes
0answers
388 views

How to connect to remote MongoDB server?

I am trying to connect remote mongoDB server but getting below error: pymongo.errors.ServerSelectionTimeoutError: 172.16.1.70:27017: timed out. The error is on line print(coll.count()) The Code ...
0
votes
1answer
23 views

Data replication in Cassandra

We have a 5 node cluster in Cassandra in which we have created a keyspace with RF=3. After creating a column-family(table) when we insert the data into the same, it is getting replicated in all the ...
1
vote
0answers
15 views

Scaling an SQL-based db and files towards a cloud-based system [closed]

The desktop applications I work on have a sqlite backend and involve working with large number of files( txt, image,reports etc) and we are planning to make it more scalable for the hundreds of ...
3
votes
0answers
120 views

When to Prefer SQL over NoSQL for a new Database [closed]

I have been searching on this question and finding various blogs and musings that do not have a lot of meat on the bones. I would like for the question to be broad, but will also present my particular ...
0
votes
1answer
19 views

SQL Join vs NoSQL Wide column

If we need to have 2 tables, one storing the author info(author_info), & another storing all the books info(book_info). author_info has authorId as it's primary key, whereas the book_info table ...
3
votes
3answers
77 views

Storing ~700 Tb in SQL Db

I am a newbie to Db's on a whole, and I came across a tutorial, wherein we needed to store ~700 Tb of data over a few years. It was mentioned that scaling SQL for such limits of data is not the best ...
0
votes
0answers
10 views

how to get the top record or one record of exactly the same(duplicate) records with no unique across - Hive

I would like to return one record out of duplicate records with no uniqueness to it. id FN LN school Tile 1234 David pottier john F K soft dev 1234 ...
0
votes
1answer
97 views

Is it a good choice to choose NoSQL for a finance management app? [closed]

I am working on a personal finance management application, which will also analyse the user's financial statement and give a good overview about their expenses and savings. What I am having trouble ...
1
vote
0answers
26 views

What database to use [closed]

There are literally hundreds of databases and I can't find one which feeds my needs. I need to be able to stores key-values under a kind of logically grouping with low latency (~20ms) and be able to ...
-1
votes
1answer
71 views

Unstructured point cloud data from MongoDB vs filesystem

NOTE: I am using geographic locations here in my question, but those who do image processing likely face similar questions/issues. That is why I've titled the question using unstructured point could ...
0
votes
0answers
30 views

No Sql DB structure for Bookmarks application

For going ahead with a bookmark application what would be the best database model in NoSql(Collection/Document). Also, I'm using firebase so it's not possible to do query nested documents in a single ...
1
vote
0answers
80 views

What is a good schema for a database where users can search for inventory availability on certain dates (such as Airbnb)?

I apologize if this is not the right venue to ask such a question. This is my first time on this site and I'm open to suggestions. I am trying to find a good schema for a database that needs to ...
0
votes
0answers
32 views

Efficiently to exclude a list of documents when query in documentDb?

Let's say we have two collection, a User collection and a Item Collection. User collection, each User document store the purchase product ids of the user. Item collection, each Item document store ...
0
votes
0answers
22 views

Is storing redundant data part of the (CouchDB) self-contained data concept?

The CouchDB concept speaks about self-contained documents. In other words: ALL related data is stored in a single concept, instead of splitting them in multiple tables and reference each other using ...
0
votes
2answers
96 views

what is difference between RDBMS and NoSql on basis of how information is store in them?

I am searching web to understand the underlying concept of how actually information is stored in RDBMS and Nosql databases and found this: In the world of database technology, there are two main ...
2
votes
0answers
1k views

Cassandra - High Number of Dropped Mutations (Specific Table on a specific Node in the cluster)

History Leading to this issue: My Compression strategy in Production was LZ4 Compression. But I modified it to Deflate For compression change, we had to use nodetool Upgradesstables to forcefully ...
2
votes
0answers
725 views

NoSql - Dynamo db - when do you need multiple tables?

I'm experienced in RDBMS, but new to NoSql. This aws dynamodb design advice says that "most well designed applications require only one table". I'm trying to wrap my head around that. I don't see a ...
0
votes
0answers
38 views

Couchbase backup validation

Need help regarding backup validations for couchbase, what is the best way / easiest way to validate couchbase backups. we have recently moved to couchbase and totally new to couchbase, having some ...
3
votes
3answers
145 views

Continuously move data from server A to Server B while deleting the data in server A?

I'm developing an ad server that is expected to handle ad impressions/billion clicks per day. The most difficult challenge I am facing is moving data from one server to another. Basically the flow ...
1
vote
0answers
30 views

Suggestions on an implementation of a data repository [closed]

am looking to create a data repository which can handle and store a number of XML files (to be specific: AutomationML files). I will explain it more clearly: The big picture is that the files should ...
1
vote
1answer
1k views

Structuring change history data in MongoDB / NoSQL

I have a Chart on which I need to track changes; the Chart has several properties. A Chart also has a long list of items. So in C#, my Chart object looks like this: public class Chart { public ...
2
votes
2answers
24 views

Is Cassandra's manual node addition/removal tasks tedious and practical in a large cluster?

I am evaluating using Cassandra as a large key-value store over about 500 commodity machines. AFAIK, Cassandra requires manual intervention during permanent machine failures (removing the deadnode, ...
0
votes
1answer
255 views

How do I compare 1000 items every minute over 1 million records in mongodb without pulling all the data?

I am developing a real time stock price alert system that gets new prices every 1 min. There are 1000 tradable assets from one exchange currently and I plan to add other exchanges soon and 1 million ...
0
votes
3answers
636 views

Why to put unstructured data in NoSQL DBs?

The statement that NoSQL databases are better for unstructured data because of their schemaless nature can be found everywhere. Frankly, I don't understand that. A human voice recording is often be ...
0
votes
1answer
44 views

How best to store complex cost information

I am creating a database to store data related to costs. The cost information can be very varied and I won't be able to fully determine all possible columns currently. An example piece of data might ...
1
vote
1answer
92 views

What are the disadvantages of using Couchbase's Global Secondary Indexes (GSI)?

Couchbase's documentation on GSI states that Global Secondary Index is a powerful solution for secondary lookup queries that are required for interactive applications that require low latencies. The ...
0
votes
2answers
61 views

Is our use case suitable for a NoSQL Database solution? [closed]

We are currently running a Python web app querying a SQL MariaDB (through SQLAlchemy). Unfortunately we have run into some hard limitations of MariaDB (number of joins are limited to 61) and are ...
-1
votes
1answer
105 views

How to design a graph database in this scenario?

here is my scenario. I have a pre-defined data type structure for books. Just take it as an example for the sake of simplicity. The structure looks like the image below. It's a Labeled Property Graph ...