Questions tagged [mongodb]
All versions of MongoDB - a scalable, high-performance, open source, document-oriented database.
2,276
questions
0
votes
0answers
55 views
How to speed up the mongo query for getting the min and max values in range?
I have a simple collection that contains two fields: timestamp and value (float). I need to get min and max values in the timestamp range.
The collection contains approx 10000000 documents.
I've add ...
0
votes
0answers
19 views
PostgreSQL for user management and another database for file management (Blob storage)
I am working on a project with video hosting and online editing platform with a microservice architecture in mind.
One of my teammates uses PostgreSQL SQL for user management, but I need to handle ...
0
votes
1answer
4k views
mongod.service: Failed with result 'exit-code'
I'm trying to run mongodb server :
sudo systemctl start mongod
this gives me no error, but when I try to check the status, I get error saying :
mua@mua ~ sudo systemctl status mongod ...
0
votes
2answers
570 views
"[ftdc] serverStatus was very slow" - MongoDB 4.0.4
I'm seeing very frequent messages like this in mongod.log and doesn't give an exact reason for the server status was very slow.
looks like ftdc logs more information but interpreting ftdc log is very ...
0
votes
1answer
62 views
Zoned and hashed sharding of existing, non-empty collection
I am trying to shard a existing collection. Collection is pretty big (about 100gb). Sharding should be done by 2 fields. First one is zone ['Europe', 'America'] and second one is _id.
So my sharding ...
1
vote
3answers
56 views
How to structure db where main records are large
I was wondering if I could ask for some quick opinions.
I am prototyping an app which seems simple but I can’t readily arrive at an architecture that feels right.
We have data that is simple and fits ...
0
votes
1answer
451 views
Standalone Mongodb suddenly failed and I'm unable to recover. Backups are also corrupt
Running on FreeBSD/ZFS for several months, users reported trouble. At this point I'm out of options so any help is apreciated.
The database backs a Node.js based authoring tool with a couple of users, ...
0
votes
1answer
27 views
Does mongo *really* need a dedicated volume, if I need to back it up?
TLDR; What's the easiest way to automate a mongodb backup of a 20-gig DB?
We run mongo on the same KVM (VPS) as the web app; the server runs Debian.
We/I don't need/want to backup the entire fs on a ...
1
vote
0answers
29 views
MongoDB latency decreases as throughput increases
I am trying to benchmark MongoDB and obtain a throughput vs. latency plot. I am using YCSB as the client and I increase the number of client threads to increase the load on the database. I ...
0
votes
0answers
22 views
What's the easiest way to automate Mongodb backups, for offline storage? [duplicate]
So, I'm almost finished building my first major production web app, and am wondering how to manage backups.
Weekly cold snapshot backups via my vps online admin seem ideal - but weekly downtime sounds ...
0
votes
0answers
109 views
Can MongoDB support TTL per document, not per index?
I am trying to do a Redis-like collection in MongoDB. I need a collection of documents that expire and are automatically deleted after a certain time.
I can use TTL Indexes but with this, every ...
0
votes
0answers
25 views
Modify number of file WiredTigerLog in mogodb
How can I modify the number of WiredTigerPreplog and WiredTigerLog in journal directory ?
There are allways 2 WiredTigerPrepl and 1 WiredTigerLog.
Thanks
MongoDB : "version": "4.4.4&...
0
votes
1answer
318 views
Rename all databases when doing a mongorestore?
I have a datadump but I need to change the name of every database while restoring them,
if a database is named "customers" it needs to be "customer2", "products" to "...
0
votes
2answers
69 views
Unable to start mongod daemon after upgrading OS from Ubuntu 16 to 18
Unable to start mongod daemon after upgrading OS from Ubuntu 16 to 18
root@dummy2:~# mongod --version
db version v4.0.4
git version: f288a3bdf201007f3693c58e140056adf8b04839
OpenSSL ...
0
votes
1answer
12 views
Mongodb migration and appending data to existing database
I have two databases in two different machines containing data in same schema. Both have relational mappings in form of ObjectIDs as it is done in NoSQL database. The task at hand is to pick one ...
0
votes
1answer
80 views
how to mongorestore mongoDB 4.2 to documentDB 4.0?
I need to do mongorestore from my mongodb 4.2 to DocumenDb 4.0 compatible i got the command from aws
which is this
mongorestore --ssl --host="abc.aws.com:27017" --username=user --password=...
0
votes
1answer
11 views
threshold replica lag for secondaryPrefered mongod
Example:
3 node on RS with mongos and mongoc(cluster)
On one Secondary node(on RS) we have replica lag, e.g. - 1h.
So, if my read preference is - secondaryPrefered and if I read data from RS, can it ...
1
vote
0answers
28 views
Mongodb Downgrade issue
I have upgraded mongodb to 4.4 from 4.2 in our dev server(RHEL 8). But unable to downgrade it from version 4.4 to 4.2 (Tried after changing package /etc/yum.repos.d/mongodb.repo). Getting error ...
0
votes
0answers
28 views
Why does the size of fields in a collection in mongodb database affect query performance?
I had a collection that was growing and with it's growth had a crazy increase in query response times.
The collection records looked something like this:
{
orderStat: { type: String },
items:...
0
votes
2answers
199 views
mongo db-Either all host names in a replica set configuration must be localhost references, or none must be; found 1 out of 2 [closed]
while adding secondary member in replica set, i get following error:
"Either all host names in a replica set configuration must be localhost references, or none must be; found 1 out of 2"
my ...
1
vote
2answers
47 views
Nosql vs sql for genre management
I'm looking to keep a simple database for movies, with details like Name, YearofRelease, Genre etc. The key factor is the genres entry, where a movie could fall into multiple genres. Using a sql based ...
0
votes
0answers
15 views
My Mongos can't authenticate to my replica set
I have 3 config servers in a replica set and when I use the command: sudo mongos --configdb crs/the 3 config servers:port# --keyfile "Keyfile",
I keep getting this error:
[mongosMain] Unable ...
0
votes
1answer
300 views
mongodump failing to connection replica set
I'm able to connect to secondary node from arbiter node of the replica set.
mongo -u backup02 -p backup02_password --port 8133 --host p1dummy:8133,p2dummy:8133,drdummy:8133 --authenticationDatabase ...
0
votes
1answer
82 views
what will happen if MongoDB primary host is down and secondary is out of sync. will we lose transaction?
In our environment, we have one primary(A) and two secondaries(B & C nodes) running in Mongodb 4.0 version. secondary(C) server is newly added and sync is happening on that. Cluster is running ...
0
votes
0answers
41 views
Why mongodb's storage size is larger on secondary than on primary?
I don't understand why the storage size is significantly larger on the secondary than on the primary (450 GB vs 375 GB).
hardware, operating system, file system and mongodb configurations are ...
0
votes
1answer
107 views
How to warm a MongoDB index
We're running a huge MongoDB with a large index (made of of four fields) which was created ad-hoc and should now be superseded by slimmer one (of the first two fields). But the problem is we can't ...
0
votes
1answer
56 views
Do you think using ObjectID as field name is a bad practice? What can go wrong if I follow this design?
I design a MongoDB collection where I am planning to use mongo ObjectID as a field name. The ObjectID is a PostID and in the array, I track all the userID who liked or disliked the post.
0
votes
0answers
80 views
How to ETL SQL Server resultset to mongo DB
Let's say I have multiple columns on sql server that I want to join and save the resultset into a single mongodb collection for faster lookup and calculations ( I'm talking about over 15 tables and ...
0
votes
0answers
16 views
Which design could be better for scale a MongoDB query for this usecase
Context
Imagine that you have two MongoDB collections, one called nodes and the other called mirrors.
Each mirror is replica of a node. So, in case the node is removed (for whatever reason), you ...
1
vote
3answers
71 views
Can't NoSQL DB ensure consistency if it is residing in a single server?
As NoSQL DBs always prefer BASE over ACID.
Everyone always says that you can't have ACID when you are working with a NoSQL DBs.
For example, we have MongoDB (a popular NoSQL DB), which is hosted ...
-2
votes
1answer
39 views
Are unstructured databases faster using arrays or many binary variables? [closed]
Is it faster (or otherwise better) to structure unstructured data like this:
{ label:"many_variables_example",
"a":0,
"b":1,
"c":1,
"d":1,
&...
0
votes
1answer
417 views
Which query performs better in MongoDB ($or or $facet)?
I have a query similar to the following;
db.getCollection('list').aggregate([
{
$facet: {
"events":[{
$match: {
'type': 'Event'
...
1
vote
1answer
619 views
Save output of a Mongo Command to a Variable bash script
I have been writing a script to find and kill slow mongodb queries, how can I store output of db.currentOp() in a variable?
current I am using this but failing
#! /bin/bash
out=""
mongo <...
1
vote
1answer
139 views
Shell Script to kill slow running Mongo Queries
I need to create a shell script that finds and kills long running mongo queries more than a specified threshold e.g. 15sec I plan to use db.currentOp(); and db.killOp(); to find and kill queries but I ...
0
votes
0answers
52 views
mongoose in node js won't connect to cluster when VPN enabled!
I'm trying to connect my node js app to MongoDB using mongoose. It works well and it connects without any problem. but when I want to connect MongoDB when my VPN is enabled it throws this error:
net:...
1
vote
0answers
223 views
How to simulate slow queries on MongoDB
I need to write a shell script that finds and kills long running mongodb queries, but I don't have access to the database that runs slow queries, how to I simulate running slow queries on my local ...
0
votes
1answer
35 views
Mongdb start up warning logging
Mongdb start up warning logging, I see lot questions around these warning in this forum however I wanted to know where does these warnings are logged. I could find them in mongod.log.
Can someone ...
0
votes
1answer
412 views
MongoDB Aggregate Poor Index Usage
I've been trying to understand the MongoDB Aggregate process so I can better optimize my queries and I'm confused by usage and $match and $sort together.
Sample DB has only one collection people
[{
...
0
votes
0answers
11 views
Append object to document node.js/mongodb
Say I have a mongodb document I'm trying to update. The schema is level1 (object)> level2 (object) > "objects".
If I want to add another object to the end, what is the method to do ...
0
votes
0answers
36 views
Appropriate language to write a Script that Kills Long running query MongoDB
I want to create a script that kills queries when they reach specific time threshold, I will be using db.currentOp() method to get information about currently running queries, and use db.killOp to ...
0
votes
1answer
196 views
An exception occurred while opening a connection to the server
I've encountered this from time to time and I cant seem to find the fix.
Usually when this error occur, I am seeing increasing number of connections being used while its connection is not being ...
0
votes
1answer
80 views
Unable to start mongod daemon and it looks its crashing
DummyD3 is node3 of 3 node replication cluster.
DummyD2 is primary and
DummyD1 is Secondary (which is in sync with primary).
I tried deleting the data under data path and did rsync from other ...
0
votes
0answers
57 views
Preserve tab and line break while insert JSON string to Document in MongoDB
I'm inserting new document to MongoDB as following:
db.crawl_api_config.insertOne({
apiHost: "logbasex.github.io",
apiUrl: "20221",
contentType: "Blog",
...
0
votes
0answers
44 views
Suggestion for NoSQL database for global users
We are planning to build a social media application, lets say similar to Instagram but at much smaller scale, of course.
The users could be from many geographies like US, Europe, Asia who could ...
0
votes
0answers
27 views
Listening to mongodb change streams for indexing to elasticsearch
We have a mongodb 4.0 replica set deployment with a collection that stores social media posts. This table sees a lot activity with updates amounting up to 1000 requests per second occasionally. We ...
0
votes
0answers
202 views
How to disable mongodb cache
I am performing some calculations on datasets and adding some new information to each collection row.
I have over 8 billion records in the database.
I do not need the cache as I am only going to ...
1
vote
0answers
71 views
Table(s) indexing strategy for separable data [closed]
Scenario: The data needs to be indexed by location, all of the rows include location info and also city info. I want to index by location, but there are millions of rows. The idea is that I can create ...
1
vote
2answers
272 views
how to run mongo export on macbook?
I am using mongodb Atlas (M0), which does not provide db backup feature. I am creating a nodejs script that will export all the collections automatically periodically.
So far I have done the following:...
1
vote
0answers
19 views
MongoDB Shema to support concurrent update on a document
We were working on a project with a 300 documents with currentValue field in a main collection, in order to track the history of each document of first collection. we created another collection named ...
0
votes
0answers
164 views
"Document Failed Validation" what is wrong with my schema validation
I am trying to create a collection with JsonSchema (really its "BsonSchema") validation. This is a document that I want to insert (with bogus values). Note that Id is coming from the mongo ...
