Questions tagged [nosql]

A catch-all term describing database systems using various non-relational models. Such systems are usually engineered to be high-performance.

Filter by
Sorted by
Tagged with
-1 votes
0 answers
12 views

Best Databases options for Geo-Spatial data

I have following kind of DB schema in key value pairs. { id1: [{location: [lat1, long1]}, {location: [lat2, long2]}, ..., {location: [lat3, long3]}], id2: [{location: [lat4, long4]}, {location: [...
user avatar
0 votes
0 answers
20 views

Database design for fixed records

Potentially trivial database design which I'm trying to overthink. Let's say that I have: A fixed number of records (on the order of the 1000s, you can think about a static product catalog). The ...
user avatar
  • 1
0 votes
1 answer
38 views

Better way to store panel data in SQL or NoSQL

I have an Excel of raw panel data (cross sectional + time series) sent to me by customers (I cannot change this). For those not familiar, imagine the gdp time series for each country. I need to ...
user avatar
0 votes
0 answers
10 views

Attempting to remove Object from a Array where an attribute matches the value passed through the query

I am attempting to write a query that removes the element from the array based on the messageId associated with said object in the array. This is submitted through curl hence the formatting, I've ...
user avatar
1 vote
2 answers
617 views

Is SqlServer or NoSql more cost efficient when scaling horizontally

RDBMS are traditionally better for vertical scaling since it's harder to do horizontal scaling. As a result NoSql databases are cheaper since they can more easily scale horizontally. However in recent ...
user avatar
  • 137
0 votes
0 answers
18 views

Redis, replication and unreasonably high memory consumption

I'm trying to replicate a redis instance (keydb to be honest, but that's just a SMP flavor actually) with the following metrics: 16 Gb used memory, 24K rps, 4K clients, 1.4M items. While theoretically ...
user avatar
  • 197
1 vote
1 answer
92 views

Create an index for fields within an array of composite type

My question is a follow-up to the question answered here: https://stackoverflow.com/a/15041094/994263 Considering a table with an array column of a composite type, is it possible with PostgreSQL to ...
user avatar
  • 113
1 vote
3 answers
75 views

SQL or/with Nosql

I am designing a mobile app with basic functionality such as sign-up, Auth, posts, real time messages etc. I think for this kind of work Nosql should work better. But over a long period of time I want ...
user avatar
0 votes
0 answers
28 views

Database design for password manager app

I'm doing a school project where I have to design a password manager app. I was wondering what the data model would look like. I know that I will have the user database to store authentication ...
user avatar
0 votes
3 answers
79 views

Should I use SQL vs NoSQL for files catalog? [closed]

I will be implementing a system which will be storing 250 Million files/user. I want to perform list operations from the client side, where the client application will be fetching 100 records at a ...
user avatar
-1 votes
1 answer
110 views

Joining in NoSQL to get chat messages for a user

In my chat app i have private / group chats and I need to get messages for a user. Let me first explain the whole system. Messages: // group message { id: 1, text: 'hello', chat_id: 'AjK954_e5iP'...
user avatar
0 votes
0 answers
28 views

Transactional Inserts and updates in NoSQL

Let's say I'm using Database X which is NoSQL and doesn't support transactions. 1. Update A [error] server goes down 2. Insert B In a scenario, A is updated and suddenly our server goes down or the ...
user avatar
1 vote
0 answers
98 views

How to store and query a tree structure in Cosmos DB?

I'm migrating a relational DB over to Cosmos DB and am unsure about a tree structure. There are several thousand rows of data ("Offerings") where each offering can have child items arranged ...
user avatar
  • 111
0 votes
1 answer
45 views

Is it necessary to compact an OrientDB after deletions?

On a Sonatype Nexus repository server which uses an OrientDB instance as a database backend, we observe the database steadily growing despite the repository contents getting regularly deleted. We'd ...
user avatar
  • 115
0 votes
0 answers
40 views

CouchDB Docs getting Corrupted

What might be the reason to get data corrupted I am using CouchDB version: 1.6.1 In our project, we make all kinds of transactions with CouchDB like add, delete, edit. I am having many docs, for which ...
user avatar
1 vote
1 answer
54 views

What's the correct database behavior when two transactions change the same row/value?

I'm writing a database LRU cache in C++ for an embedded NoSQL database to solve a performance problem, and I'm trying to understand the correct assumed behavior and philosophy behind it. Say there's a ...
user avatar
0 votes
1 answer
52 views

What database & design would you use for legos [closed]

I'm trying to conceptualize an interesting problem I am designing for. Using lego's (the plastic construction toys) as an analogy seems to work well. If this is a fairly recognizable problem, then I'd ...
user avatar
  • 103
0 votes
0 answers
30 views

Help find a usecase to understand sql vs nosql issue [duplicate]

I have very little background in SQL (one pet project with PostgreSQL that demonstrated only basic queries up to joins) and no experience at all with NoSQL. I understand that there are many DB ...
user avatar
1 vote
1 answer
72 views

Postgresql multi-field index on jsonb data does full tablescan when field is not found

I have a table with millions of records. I need to query for the last-added record by timestamp, for a given field. Pretty simple stuff, trivial to do with SQL: CREATE TABLE records ( id integer,...
user avatar
  • 111
2 votes
2 answers
74 views

Are relational databases even viable for large eCommerce platforms? [closed]

I've been assigned to an eCommerce platform that has huge quantities of data ( hundreds of thousands of products, sellers, etc ) and I've been trying to choose the proper tools and approaches required ...
user avatar
  • 121
0 votes
1 answer
792 views

How can i convert all object Ids to string using query in MongoDB, note the structure is complex, So can't use $toString in $addFields and $project?

I have a really deep-nested JSON object generated by aggregation query, but I want to convert all the object ids to string format. Tried $toString in $addFields and $project. Since the object is ...
user avatar
0 votes
0 answers
17 views

How to interpret results of mongo explain and improve geo spatial query?

I have a collection in MongoDB where the documents have a structure like this: { "vechicleDetails": { "location": { "type": "Point", ...
user avatar
0 votes
1 answer
37 views

Relational or non-relational when dealing with highly relational, big data [closed]

I'm working on a project (in Java) that will be processing a large event stream (GBs every minute). This data is heavily processed to find relationships between events. This is done through a ...
user avatar
1 vote
2 answers
41 views

The meaning of Data Modeling in case of noSql

I learned about data modeling layers (conceptual/logical/physical). I would like to understand how does the modeling process work on non-relational schemas. Is there a need to "Normalize" ...
user avatar
0 votes
1 answer
57 views

Choosing between NoSQL and Relational databases while having both flexibility and consistency requirements [closed]

I've never worked with databases professionally and only toyed with database coding using a small sqlite db for my own music collection. Now I'm asked to build an internal database system at work for ...
user avatar
  • 111
0 votes
1 answer
154 views

Schema of unstructured data can be defined at query time

I am looking for an example to understand the following statement: Schema of unstructured data can be defined at query time
user avatar
  • 2,249
4 votes
3 answers
250 views

Inconsistency in Relational Databases

I generally get confused when the term consistency is used. NoSQL tutorials always refer to the reads whereas Relational tutorials refer to a consistent state (ensuring referential integrity ...
user avatar
  • 161
1 vote
3 answers
58 views

How to structure db where main records are large

I was wondering if I could ask for some quick opinions. I am prototyping an app which seems simple but I can’t readily arrive at an architecture that feels right. We have data that is simple and fits ...
user avatar
0 votes
1 answer
18 views

Mongodb migration and appending data to existing database

I have two databases in two different machines containing data in same schema. Both have relational mappings in form of ObjectIDs as it is done in NoSQL database. The task at hand is to pick one ...
user avatar
0 votes
1 answer
98 views

What could be the best DBMS to store airbnb data for price prediction [closed]

I have a school project in which I need to predict the airbnb listings prices in 5 different cities. So I have about 400,000 records each with 19 columns. All the examples on the internet that are ...
user avatar
  • 103
1 vote
3 answers
86 views

Can't NoSQL DB ensure consistency if it is residing in a single server?

As NoSQL DBs always prefer BASE over ACID. Everyone always says that you can't have ACID when you are working with a NoSQL DBs. For example, we have MongoDB (a popular NoSQL DB), which is hosted ...
user avatar
  • 161
-2 votes
1 answer
46 views

Are unstructured databases faster using arrays or many binary variables? [closed]

Is it faster (or otherwise better) to structure unstructured data like this: { label:"many_variables_example", "a":0, "b":1, "c":1, "d":1, &...
user avatar
25 votes
4 answers
6k views

If NoSQL stands for "Not only SQL", is SQL a subset of NoSQL?

The definition is a bit confusing - basically I'm asking if SQL is a subset of the NoSQl family: I'm asking this because "Not-only" means NoSQL is much larger, but still includes SQL as a ...
user avatar
  • 455
0 votes
0 answers
46 views

Suggestion for NoSQL database for global users

We are planning to build a social media application, lets say similar to Instagram but at much smaller scale, of course. The users could be from many geographies like US, Europe, Asia who could ...
user avatar
2 votes
1 answer
203 views

What exactly is an unstructured data and why to use Non-relational DBMS for that?

I read some posts online about Unstructured data like this one. It says Unstructured data is information that is not arranged according to a pre-set data model or schema, and therefore cannot be ...
user avatar
  • 23
1 vote
0 answers
473 views

How to repair a block based Rocksdb sst file with corrupt masked crc32 checksum in that case? [closed]

Environment I'm using the Ethereum cryptocurrency in a way which requires something called full Ethererum archival node where each new blocks (somewhat a batch of recent transactions) is added to the ...
user avatar
1 vote
0 answers
20 views

MongoDB Shema to support concurrent update on a document

We were working on a project with a 300 documents with currentValue field in a main collection, in order to track the history of each document of first collection. we created another collection named ...
user avatar
0 votes
0 answers
18 views

Only need the latest row - should I keep old records?

I have a use case where I'm crawling a site to gather information. This is happening maybe every 12-48 hours. With each crawl, data to populate a new document is gathered. I only really care about the ...
user avatar
1 vote
1 answer
2k views

Efficient way to get data for each date range intervals using single query | MongoDB

I have collections about products and purchases. I need to get statistics for each time interval. I need following: Name quantity (date 1 range) quantity (date 2 range) Name One 500 400 Name Two ...
user avatar
-4 votes
1 answer
37 views

About database design [closed]

I am considering data modeling (table design) And DB types(MySQL, MongoDB and so on). I am thinking of a service that handles financial information and economic indicators. Options have daily data by ...
user avatar
1 vote
0 answers
12 views

Want to add more options on User database schema to premade users

So I have this User MongoDB Schema, and I want to add other options to it. but if I do then the current users have to create a NEW Account to see the new changes. is there a way to update all the ...
user avatar
  • 11
0 votes
2 answers
50 views

show users doesn't show anything, although it has users

So I'm using MongoDB, and this is my first time dealing with a VPS on my own, I'm trying to view the users i have on the website. I know for a fact that there are signed up users, because I can signup ...
user avatar
  • 11
0 votes
1 answer
12 views

Help needed with several engines use case [closed]

We are developing an app, aprox 50k RPM read, 1k RPM write, it ask via key and get a JSON. The search is always made by key. I'm inclined to use one MySQL 8 table with a Id field and JSON field with ...
user avatar
  • 103
0 votes
0 answers
20 views

AWS DynamoDB table design

related question: https://stackoverflow.com/questions/65165530/aws-dynamodb-table-design I am trying to design a schema that will support the use cases (with 1 query per use case): "get all ...
user avatar
4 votes
3 answers
1k views

Why Cassandra is not considered a relational database?

Read this answer Relational databases are based on the relational model, an intuitive, straightforward way of representing data in tables. In a relational database, each row in the table is a record ...
user avatar
0 votes
1 answer
38 views

What type of database would you suggest for a large scale delivery company? RDBMS or NoSQL? [closed]

I've been learning the fundamentals of RDBMS and NoSQL systems. To start I thought NoSQL would be the way to go because of how large scale it could become, but understanding the importance of RDBMS ...
user avatar
  • 11
1 vote
3 answers
301 views

SQL vs NoSQL: Fetching All records in DynamoDB vs SQL Database

I am designing database for a project which requires frequent querying of all the records. The total number of records will be less than 500K. One of the databases I am considering is AWS DynamoDB ...
user avatar
0 votes
1 answer
33 views

What is the damage to the database if it uses high memory storage? Are there consequences for this use? Does it affect performance?

What is the damage to the database if it uses high memory storage? Are there consequences for this use? Does it affect performance? I need to understand a lot about this problem to be able to create ...
user avatar
1 vote
0 answers
90 views

Which NoSQL for storing images as 2D arrays (BLOBs)

I have large number of images that I need to access on per-pixel-basis in my app. The images are downloaded from web and are quite large (4k). Update is done several times a day (tousands of images), ...
user avatar
0 votes
2 answers
5k views

MongoDB - _id as String instead of ObjectId ? Relationship between collections or duplicate data?

Scenario: An entity called 'accessPoint' has an important attribute called 'network'. The application will display some parts of this network attribute, so I decided to store it inside accessPoint ...
user avatar

1
2 3 4 5
8