MongoDB : Document-Oriented NoSQL Database
1
vote
0answers
17 views
Add new shard - always best?
In our setup, we currently have 3 shard set sharded cluster, each shard being a replica set of 3. Our writes are about to go up significantly to implement a new feature, and we know the extra data ...
3
votes
1answer
22 views
Primary replica set server goes secondary after secondary fails
I have a 2 servers replica set that, after the secondary fails the primary goes into secondary mode while the secondary is in STARTUP2 (recovering). The problem with this is that I can't use the ...
2
votes
1answer
73 views
Best embed/reference/field strategy for many inserts (mongo)
I'm building a gaming backend with Mongo, and have some issues on how to best design the schema to maximize performance and database size.
My models:
User
Match
-ReferenceMany (User)
...
2
votes
1answer
36 views
Does Mongo have disappearing/phantom writes
I have heard that Mongo has something like phantom writes. For example, if I have a web request with the following db commands in a single unit of work:
a) update comments in article
b) update ...
0
votes
0answers
14 views
Is it possible to upgrade mongodb cluster without upgrading arbiters?
Is it possible to have running real nodes with version 2.4 and arbiter nodes with 2.0 or 1.8 in the replica set?
Upgrade guides for version 2.2 and 2.4, did not tell anything about upgrading ...
3
votes
0answers
27 views
MongoDB problems recovering a member of the replica set
I have a sharded database with 2 replica sets (RS1 and RS2) each one of the RSs with 2 servers. I had a problem yesterday with one member of the RS2, the mongod instance crashed throwing an error. ...
6
votes
1answer
46 views
Overview of how MongoDB uses its various threads
On one instance I have MongoDB using ~85 threads. In lieu of having time to investigate directly, I am curious:
What are the threads used for? Do they fall into a few high-level usage categories?
...
1
vote
1answer
144 views
Limit memory used for mongoDb
Is there any way to limit using RAM for mongodb on Debian? I'm looking for a solution fo about 8 hours, but have no results.
5
votes
1answer
69 views
Are shards distributed randomly across machines in MongoDB or are they in order?
Are shards distributed randomly across machines in MongoDB or are they in order?
For example, if I had a MongoDB cluster that was sharded across two machines and my shard key was a person's name, ...
1
vote
1answer
46 views
Mongo replication lag slowly increasing
I am running a replica-set in production with slaveOk = false using mongo 2.0.7 in AWS The replication lag on one of the servers is close to 58 hours. This replication lag is sometimes decreasing ( at ...
0
votes
1answer
55 views
Getting next and previous document
In a mongo collection I have a list of words (millions words).
{word:'a'}
{word:'b'}
{word:'x'}
{word:'y'}
{word:'z'}
I need to get lexical adjacent of a word. I am looking for most efficient ...
3
votes
1answer
47 views
Sharded key-value store using MongoDB
Would like to set up a key-value store that is sharded across multiple machines.
We are currently using MongoDB, is there a reason why we shouldn't use MongoDB for this purpose?
We also use Redis, ...
1
vote
2answers
881 views
Mongo replicated shard member not able to recover, stuck in STARTUP2 mode
I have following setup for a sharded replica set in Amazon VPC:
mongo1: 8G RAM Duo core (Primary)
mongo2: 8G RAM Duo core (Secondary)
mongo3: 4G RAM (Arbiter)
Mongo1 is the primary ...
0
votes
1answer
134 views
Choosing shard key and friendly URL Ids for my MongoDB
I have decided to use MongoDB as my Database for a web application. However, I have some difficulties to get started and I hope that you can help me out with a few questions.
I am developing my ...
2
votes
1answer
480 views
Mongo connection failing with 'Transport endpoint is not connected'
I have a 2 server installation.
A web server with Apache and a DB server with MongoDB.
I am load testing it, and on ~300 RPS I am getting this error:
PHP Fatal error: Uncaught exception ...
1
vote
1answer
59 views
Is it possible to upgrade MongoDB from 2.0 to 2.4 directly
We have a replica set with 2 members and one arbiter in production. 10gen documentation states that 2.0 to 2.2 is a binary-compatible “drop-in" upgrade and so it's 2.2 to 2.4. Is it safe to upgrade ...
0
votes
1answer
39 views
admin user can not login to other databases after upgrading to mongodb 2.4
I had a mongodb 2.2 database with auth enabled. but after upgrading to 2.4 my admin user can not login to any database other than admin database. I removed it from system.users then created another ...
1
vote
3answers
114 views
Relational vs Non-Relational Database for Events Database
I'm trying to find out whether an SQL or no-SQL solution would be better for creating an events database. I'm creating a ticketing system, similar to ticket master. I know that for either ...
1
vote
1answer
47 views
Structuring data in MongoDB for a to-do list type application
This is a fairly high level question as I am in the initial stages of planning this application, and am also very new to MongoDB and document-based databases in general. Disclaimer aside, I am ...
5
votes
1answer
342 views
Using MongoDB and PostgreSQL together
My current project is essentially a run of the mill document management system.
That said, there are some wrinkles (surprise, surprise). While some of
the wrinkles are fairly specific to the ...
1
vote
2answers
141 views
To find a version for your pc check with the software publisher install mongodb
I want to install MongoDb on windows 8 but when i try to run C:\mongodb\bin\mongod.exeiget this error:
To find a version for your pc check with the software publisher.
0
votes
0answers
35 views
MongoDB master - slave not syncing anymore
I have a setup with two MongoDB instances, one master and one slave. The sync worked perfectly fine for quite a while now, but suddenly stopped. The major problem is, that the guy who setup the ...
0
votes
0answers
31 views
The best approach to index dynamic query in MongoDB
I am working on log managment system where user will be able to upload logs from file. I have 'event' collection where I store all events from all sources (each source can have different log format ...
26
votes
5answers
2k views
Which database could handle storage of billions/trillions of records?
We are looking at developing a tool to capture and analyze netflow data, of which we gather tremendous amounts of. Each day we capture about ~1.4 billion flow records which would look like this in ...
0
votes
0answers
27 views
MongoDB: move documents before capping
The cappedCollection concept works well for most of my projects where cleaning old data without care makes sense.
For another projects, I need a more complex and safe concept. The requirement is ...
0
votes
0answers
36 views
MongoDB: Aggregation workaround by helper collection
Since I regularly run against mongodb's document size limit and also aggregation framework's group limitations >16M, depending on the amount of data I need to process, I look for a simple workaround.
...
0
votes
0answers
63 views
MongoDB: group and document size limitation with aggregation and MapReduce
Hitting the limitations of MongoDB (in a single machine environment), I wonder which part of MapReduce and aggregation with group/$group is causing the troubles.
Usually I use a mix of MR/Aggregation ...
0
votes
0answers
28 views
AWS Marketplace Mongo, how to create replica
I am new to mongo, one of the first things it appears needs to be done is to create mongo replica sets as this avoids mongo write locking issues.
I set up mongo on AWS by getting mongo off the AWS ...
1
vote
1answer
68 views
Which database is designed for storing and incrementing values?
We're trying to build a stats server that stores visits for each document on a section for a specific date, so we need a table that has the following parameters:
documentID
sectionID
date
visits
...
0
votes
0answers
12 views
Mongo replication lag slowly increasing [duplicate]
I am running a replica-set in production with slaveOk = false using mongo 2.0.7 in AWS The replication lag on one of the servers is close to 58 hours. This replication lag is sometimes decreasing ( at ...
1
vote
1answer
667 views
How to display query result in rockmongo by using execute method
I executed a command in mongo.exe
> db.tablebusiness.find({"_id": "the-simmons-paradise__41.85_-87.88"});
I got results:
Now I try similar command in rockmongo.
If I execute
...
1
vote
0answers
54 views
Where Hadoop Stands at MongoDB Side [closed]
I am making a research about Machine Learning and planning to use NoSQL databases. I know that MongoDB is a powerful solution.
However I want to learn that where Hadoop stands for MongoDB side.
My ...
0
votes
1answer
45 views
assistance with mongodb setup on windows server
I am currently setting up Mongo DB on a dedicated web server. I am not experienced with Mongo so I have some questions around its setup. I have done research in to Mongo etc but would like some ...
1
vote
2answers
127 views
MongoDB - Should I separate the journal and the data to different drives?
I have seen and heard from multiple sources that it can be a good idea, performance-wise, to write your db journal and your data files to separate disks.
What's the recommended way to do this (e.g. ...
3
votes
1answer
389 views
Mongo cannot find my collection
My mongodb server has a database named villageContents
It has a collection named tablebusiness
If I run mongo I saw
MongoDB shell version: 2.0.7
connecting to: test
>
I wonder what "test" is. ...
3
votes
2answers
371 views
Import and Export database in Mongo just like MySQL
I am newbie to the Mongo.Before this I have worked only with MySQL.In MySQL we can import and export database easily.I want to know is there any option available in Mongo to import and export database ...
0
votes
1answer
171 views
MongoDB Master and Slave Replication - Windows or Linux
I have recently moved my MS SQL Server Database to MongoDB (2.0) on Windows Server 2008. Its containing 2 databases with following stats. (both databases get around 100 reads/writes per second). These ...
2
votes
0answers
82 views
automated data sync after Primary node is down
I have this scenario, using version 2.2.2:
Node A, Primary, Priority: 10, Wireless network
Node B, Secondary, Priority: 9, VM Server1
Node C, Secondary, Priority: 8, VM Server1
Sequence:
In Node ...
1
vote
1answer
84 views
mongodb heartbeat - unicast, broadcast or multicast?
I can't find any good doc or article (except http://docs.mongodb.org/manual/core/replication-internals/) about this in the internet. Anyone knows how mongodb heart beat signal operates?
The reason ...
1
vote
0answers
72 views
How can I use mongoDB efficiently in this scenario?
I'm trying to build a system of documents that have hundreds of tags assigned to them, but each document-tag association has a certain condition it has to also meet so the document would be returned:
...
2
votes
1answer
139 views
Which database to use? [closed]
Hey there. I am looking for a free to use for commercial website database that should have these design features, in the given order:
Auto-Sharding (getting more free space by adding more server ...
1
vote
2answers
368 views
Huge index for covered queries (indexOnly: true) or (indexOnly: false) with collection scan
I have two questions, I'll give you the facts, then my questions.
The actual index I'm using for one of my queries has the following characteristics :
Multikey (contains 4 keys).
The average key ...
4
votes
1answer
133 views
what is mongodb telling me when it logs an update?
After several minutes of a large program that pushes a lot of data into mongo, my log starts to show a message for (I guess) each update. This seems awfully noisy, is there some special reason it ...
2
votes
2answers
117 views
Schema design for privacy settings in MongoDB
I have a set of documents that can have various privacy settings around them:
They can be completed public (any registered user) can view them
They can be viewable only by people following you (this
...
0
votes
1answer
33 views
How to save mongodb data sub data more properly in this case?
I have a business collection.
The businesses are reviewed by users.
Each user can only review a business once. Future reviews will simply replace the former one.
This is how we store it:
...
0
votes
0answers
88 views
To scale horizontally, is MySQL with sharding, memcache and master-slave replication better than MongoDB
I am building an api, to share discounts between users. Each discount can be linked with several users, using joins and many to many relationships.
Currently I am using MySQL and I am looking to ...
1
vote
1answer
242 views
Storing dictionaries in mongo
Is there any reliable and fast database architecture that allows to store a dictionary(containing up to hundred thousand words) using mongodb?
3
votes
1answer
224 views
MongoDB Not Using All Available RAM
I have something around 200 GB worth data stored in a mongo cluster. The physical memory on one of the instances which runs mongo is 8GB. Nothing else of any consequence runs on this instance. As near ...
1
vote
2answers
155 views
Mongodb multikey index and $all in queries
I have such structure of documents in my products collection:
{
title: 'Samsung Galaxy S III',
category_id: ObjectId("50bcc2f0b910a6c1936a4424"),
properties: [
{
title: 'OS',
...
2
votes
1answer
257 views
MongoDB geospatial query with sort - performance issues
I have query (which is very slow ~2,5s):
db.markers.find({ latlng: { '$within': { '$box': [ [ -16, -140 ], [ 75, 140 ] ] } } }).sort({_id: -1}).limit(1000)
When I run explain for this query I get
...
