Questions tagged [nosql]

A catch-all term describing database systems using various non-relational models. Such systems are usually engineered to be high-performance.

Filter by
Sorted by
Tagged with
1
vote
1answer
20 views

How to convert a datefield from string to date?

Here is the query that I am using. What I need to extract is the data for the last 10 minutes. But no records found is the output for this query, I think this is due to the type of data that were ...
-1
votes
0answers
5 views

what built role i can choose while creating a user to connect my mongoDB instance for running mongosqld service [on hold]

i am setting up mongosqld service to connect to my mongod server. for this i am creating a user just to be able to perform task required for Mongosqld service. i am looking for some suitable built in ...
0
votes
0answers
9 views

Denormalisation of data for Firebase/Firestore NoSQL

I am having trouble working out how to efficiently query data in a similar structure to the below. This is just some test data I have thrown together. Im not even sure if it is possible in the way I ...
2
votes
0answers
17 views

Querying a High Cardinality Field

I am designing a data model for our orders for our upcoming Cassandra migration. An order has an orderId (arcane UUID field) and an orderNumber (user-friendly number). A getOrder query can be done by ...
1
vote
1answer
21 views

Design datastore persistence based on state of the Entity

I have an entity Content to persist in the database. The entity has an attribute LifeCycleState that denotes the present state of the content. For the sake of elaborating further, assume we have ...
0
votes
0answers
12 views

How do you merge older data with an apend only stream database?

I've been reading about streaming databases that record all events as immutable entries in an append-only log. Then map/reduce jobs or something like a "materialized view" is constructed reading the ...
0
votes
0answers
24 views

Storing objects in key/value stores - serialized or separate values?

I'm playing around with Go and BadgerDB, which is an embedded disk based (not in-memory like Redis) key/value store. There's just so little information about how to use key/values stores in general. ...
0
votes
0answers
23 views

NoSQL database for analytics

Need NoSQL database for analytics. Given: Large, partitioned Postgres(9.4) tables, with next structure: - device_id: UUID - monitored_date: TIMESTAMP - properties: jsonb (different keys) (...
0
votes
1answer
14 views

DynamoDB: How to model data that's shared and queried by all users?

I am very intrigued by DynamoDB, and it works incredibly well when I model the data for my main use case for my application. That being said, there is one specific use case that I can't wrap my head ...
0
votes
0answers
11 views

Are OLAP / NoSql / In-Memory database mutually exclusive concepts or can there be overlap between them?

I'm a data scientist with little knowledge of DB technology. I keep hearing 3 types of databases mentioned as key technologies for analytics and modeling solutions: NoSql databases OLAP cubes In-...
1
vote
0answers
11 views

Storing a large, sparse matrix in Apache Hbase? [closed]

I'm currently testing out Apache Hbase for our Matrix analytics service. I'm using a managed cluster running on AWS EMR. The matrices are sparse, and we have 50,000 columns, and up to 10 million ...
0
votes
1answer
32 views

What is a good practice for storing unstructured tables as a field in mongodb

Context: I am developing an application that requires handling tables that do not necessarily have an uniform structure (eg. different/extra columns). Those unstructured files also need to be grouped ...
1
vote
0answers
25 views

How to implement correctly from SQL to NoSQL (DynamoDB)?

I am just new in NoSQL and DynamoDB. I try to moving from using AWS RDS to DynamoDB. I have table user which can have more than one of work experiences and can have more than one of interest (table ...
0
votes
1answer
19 views

Spliting changes in separate collection/table or not?

I am using MongoDB to store products, user accounts and stuff on my server and so far it's going nice. But now I'm stuck deciding how do I "split" things apart, like: I have a database where ...
1
vote
0answers
23 views

Mongodb - Security weakness while using --authenticationDatabase admin? [duplicate]

I was trying to create a new Mongodb instance based on my old Mongo Database. In my current DB I have an user and password configured. So, I can access my database using: $ mongo --host $MONGO_HOST -...
0
votes
1answer
79 views

Multi-master (NoSQL) database solutions with cloud and no-premise option

We are currently investigating database options for distributed database (possibly globally distributed) where the data in general is stored in "cloud" (this would not be a special requirement). The ...
0
votes
1answer
27 views

Invoices kept in document with user information in no sql database is recommended?

I have a application which has tenant details like { "name" : "", "Address" : "" , ... Bills :[ current : {"rent":"" ,"electricity":"" ,"date":""}, previous : [{"rent":"" ,"electricity":"...
0
votes
0answers
135 views

What can Neo4j do that ArangoDB can't?

I'm in the process of choosing a database for a project related to biology and medicine. The main added value of a graph database will be the ability to explore and weight the relationship between ...
0
votes
0answers
28 views

NoSQL big DB retrieve performance

A question about retrieving performance for simple but bug key-value DBs on python3. I am working on a pipeline to compare several entries based on key-values (genetic variants found in patients with ...
0
votes
0answers
50 views

How can I complete a full export and import of Google BigTable

!/bin/bash BigTable_ExportTest.sh Edited original source script with new bucket and jar file. This script will backup BigTable Data Table by table and store it into a destination location as ...
1
vote
1answer
42 views

Sharding the Existing MongoDB

I've got 3 dedicated non-virtual servers (srv1-3). On one of them (srv1) i've got MongoDB in production, that already have got really big amount of data. At the present time there is no sharding or ...
0
votes
1answer
38 views

Can't change MongoDB default DB path

I know there are multiple questions on the same issue and I followed them but not sure what is happening here. First of all I am trying to change the default db path to a a separate mounted disk. And ...
0
votes
1answer
19 views

Does any MariaDB engine have the option to declaratively or configuratively abstract highly-redundant data?

I have an application which is architected in a "NoSQL" style around one fully denormalized "main table" which currently just holds a primary key and one JSON-valued column. For reasons which are ...
0
votes
1answer
163 views

How to efficiently design Firebase database for Home service Booking application? [closed]

I'm planning to build my own app. It's a home service App to link users with other providers. I'm recently used a NoSQL database, Firebase, and I am stuck with the design of the database for my app. ...
1
vote
0answers
42 views

Metadata overhead warnings in couchbase web

I have 3 node couchbase cluster which is working fine but now days I am getting many alerts as "Metadata overhead warning. Over 54% RAM allocated to bucket" on couchabse web UI. Please help to supress ...
0
votes
0answers
35 views

replication type of dynamodb

What is the replication type of the DynamoDB system? Like is it master slave, peer to peer, multi master, or something else. I know that that for global tables, DynamoDB has cross replication with ...
1
vote
1answer
48 views

Should I use a RDBMS JSON field or a NoSQL database to store large JSON datasets that I don't need to query?

I am building a website that allows users to retrieve a bunch of open source chart (eg UN data). I don't need to be able to query the data itself. I will instead extract certain meta data (keywords, ...
-1
votes
1answer
70 views

MongoDB Performance of Overwriting an Array Field vs Individually Updating the items

The problem I am facing is basically updating the inventory when an order is received in a MongoDB database.The general hierarchy is as follows Manufacturer: { ... Items: [ ... ...
0
votes
2answers
914 views

Audit Trail in NoSQL vs. Relational DB, audit trail feature in MongoDB [closed]

Two questions regarding selection a DB type and engine for the scenario when the Audit Trail functionality is a must: Is there any preference in DB type (NoSQL/Relational) choice when the Audit Trail ...
2
votes
1answer
63 views

Microsoft Column Store Database?

Using Microsoft technologies/products is it possible to create a column store database with column family sets? That is each row being able to have a different number and type of columns. Colmun ...
0
votes
1answer
41 views

What is the best way to cross check the record in multiple collections

I am developing the application in which system will show the campaign content to users which he/s never seen. To keep the logs either the specific user seen the specific content or not, i am ...
1
vote
1answer
100 views

Hierarchical / tree data - which type of database to use & design?

For querying (and writing to) a hierarchical structure (like a folder containing files and other folders, up to n levels deep, where n is pretty small, probably around 10, and there would be lots of ...
3
votes
1answer
48 views

MySQL and PostgreSQL has JSON data types, is it the same as NoSQL database? [closed]

MySQL and PostgreSQL introduced JSON data types, is it the same as NoSQL database? Why? NoSQL here is a class of data bases similar to MongoDb and DynamoDB.
0
votes
4answers
146 views

How to tell if a project needs a NoSQL database solution? [closed]

How to tell if a project needs a NoSQL database solution? I think that SQL limits define it. If the project needs bigger database or bigger fields then it needs NoSQL. Am I right? I looked into ...
0
votes
0answers
27 views

Should images be embedded in a MongoDB document when there is a one to many relationship?

Please see the DDL below from my CQRS write database: CREATE TABLE Offer (ID uniqueidentifier NOT NULL, Description varchar(50), Image varbinary(max), primary key (ID)) CREATE TABLE Person (ID ...
1
vote
0answers
13 views

How to store a multi-lingual “dictionnary” in a NoSQL database?

I hope this is the good Stack to ask this question, pardon me if it's not. I need to categorize images and need manipulate a lot of words. I'll explain what's bugging me first and then there is a ...
1
vote
1answer
103 views

Clustered Index Scan on 5+ billion rows instead of using non clusterd index for <1000 rows

We have a huge SQL 2017 database containing more than 5 billion internetpages. One of the table contains the info about the page: PageID is the primary clustered key and UriKey is the non clustered ...
1
vote
2answers
48 views

NoSQL or MySQL for storing API usage

I need to be able to track API usage in order to generate reports or charts later. I've been struggling to decide whether to use regular MySQL or something like MongoDB or Elastic Search which I don't ...
1
vote
1answer
52 views

Suitable NoSQL DB design for a fleet of IoT devices [closed]

This is my use case: 10,000 IoT devices Each IoT device sends its environmental data (temperature, pressure, etc.) every 30 seconds Data of each device will be kept for 24 hours The main requirement ...
1
vote
1answer
223 views

MongoDB aggregation $unwind and 1NF

I have a basic rhetorical/theoretical question for people experienced using both MongoDB and RDBMS. Surprised SO has no Data Munging or Data Engineering forum. In making an aggregation pipeline in ...
0
votes
1answer
171 views

What is the point of a consistent and partition tolerant multi-master DB Architecture as opposed to Master-Slave

I should emphasize that my question is in regard to CP (Consistent and Partition Tolerant) systems. A lot of widely used NoSQL databases such as Mongo and Redis seem to fall in the CP category. And ...
1
vote
0answers
54 views

Coffee shop static tag/attribute querying (satisfying AND & OR condition groups) - Relational DB/DBMS or NoSQL?

Let's say you are storing information about coffee shops, and you want to assign an arbitrary number/assortment of static tags/labels to each cafe which act like attributes (i.e., the cafe either has ...
1
vote
0answers
256 views

Which is better schema for given discussion forum, MongoDB

Lets have two variants of nosql collection for storing discussion comments. Assume discussion, where is only one thread/root comment with 100 replies. A./ collection: discussion_thread (id, ...
1
vote
1answer
2k views

MongoDB update multiple sub documents inside array, each according to a condition

I have a document like this: { wid: 1, items: [ {nid: 1, sent: 900}, {nid: 2, sent: 12}, {nid: 3, sent: 0}, {nid: 4, sent: 1} ] } Now consider I want to ...
1
vote
1answer
33 views

Using a real certificate with rethinkdb cert chain bundle

I know the rethinkdb guide uses a self signed cert as an example. If I wanted to use a real certificate that I purchased, how can I add the bundle to the server conf? I add the certificate I purchased ...
1
vote
1answer
278 views

How to deal with unbounded growth in cassandra shards

Let's say we have a website like youtube where we have a comment session per e video. Users want to be able to comment and to see the comments made by other users by comment creation time. This is ...
1
vote
0answers
110 views

Designing a globally distributed database

We are trying to design a globally distributed Azure Cosmos DB and we’re not sure how to best do that: There is data that should be replicated in every region to improve read performance. This data ...
0
votes
1answer
30 views

Data replication in Cassandra

We have a 5 node cluster in Cassandra in which we have created a keyspace with RF=3. After creating a column-family(table) when we insert the data into the same, it is getting replicated in all the ...
0
votes
1answer
27 views

SQL Join vs NoSQL Wide column

If we need to have 2 tables, one storing the author info(author_info), & another storing all the books info(book_info). author_info has authorId as it's primary key, whereas the book_info table ...
3
votes
3answers
88 views

Storing ~700 Tb in SQL Db

I am a newbie to Db's on a whole, and I came across a tutorial, wherein we needed to store ~700 Tb of data over a few years. It was mentioned that scaling SQL for such limits of data is not the best ...