A catch-all term describing database systems using various non-relational models. Such systems are usually engineered to be high-performance.

learn more… | top users | synonyms

63
votes
6answers
29k views

What are the differences between NoSQL and a traditional RDBMS?

What are the differences between NoSQL and a traditional RDBMS? Over the last few months, NoSQL has been frequently mentioned in the technical news. What are its most significant features relative to ...
62
votes
5answers
12k views

Why can't RDBM's cluster the way NoSQL does?

One of the big plusses for nosql DBMS is that they can cluster more easily. Supposedly with NoSQL you can create hundreds of cheap machines that store different pieces of data and query it all at ...
52
votes
5answers
17k views

Which database could handle storage of billions/trillions of records?

We are looking at developing a tool to capture and analyze netflow data, of which we gather tremendous amounts of. Each day we capture about ~1.4 billion flow records which would look like this in ...
43
votes
5answers
80k views

What is a Key/Value store database?

I've been looking at the wikipedia page for NoSQL and it lists several variations on the Key/Value store database, but I can't find any details on what it means by Key/Value store in this context. ...
26
votes
2answers
17k views

Timeseries: SQL or NoSQL?

I don't care about the general differences between SQL and NoSQL (or their traditional differences). I am currently looking at altering the storage of our internal time series. They all contain ...
17
votes
2answers
1k views

CouchDB vs MongoDB [closed]

Evaluating document-oriented storage, what are the pros and cons of CouchDB vs MongoDB?
16
votes
3answers
10k views

What does horizontal scaling mean?

In database context, I have come across horizontal scalability as one of the advantages of the NOSQL databases. What does the term mean? http://en.wikipedia.org/wiki/CouchDB http://en.wikipedia.org/...
15
votes
3answers
398 views

What are the canonical NoSQL resources for people who never used this technology?

I am getting more and more interested by the NoSQL technology and I can read several posts on SE about how it works and the different products available. However, I wonder if there are some canonical ...
15
votes
1answer
3k views

How do databases store index key values (on-disk) for variable length fields?

Context This question pertains to the low-level implementation details of indexes in both SQL and NoSQL database systems. Actual structure of the index (B+ tree, hash, SSTable, etc.) is irrelevant as ...
13
votes
2answers
2k views

Schema-less/flexible + ACID Database?

I am looking at rewriting a VB based on-premise (locally installed) application (invoicing+inventory) as a web based Clojure application for small enterprise customers. I am intending this to be ...
13
votes
2answers
1k views

NoSQL and RDBMS together?

I was wondering if there are any good solutions for recording data in a NoSQL database and then converting them over to an RDBMS? For example, if you wanted to capture some data quickly, like ...
12
votes
1answer
3k views

Amount of data per node in Neo4j

I need to store substantial amounts of data per node in Neo4j. The data is Unicode chunks of text. Actually not every node will have big chunks, but many of them will. I waded through the ...
12
votes
1answer
335 views

Highly Concurrent Storage System

Imagine your requirement is that you have 3 huge tables (structured data) with say 30 billion rows in each (total size of 4TB) and your many concurrent users (which are parallel os threads on remote ...
11
votes
3answers
7k views

Choosing a database for storing large amount of data and allowing for thousands of writes [closed]

I am working on a project that has some serious requirements regarding its database and having hard time choosing the best solution. The details are: Database will easily reach tens of terabytes of ...
10
votes
1answer
4k views

CAP Theorem vs. BASE (NoSQL)

CAP Theorem vs. BASE (NoSQL) Hi, I’m trying to write a small paper for my work about NoSQL and have described the CAP Theorem as, if not all, then most NoSQL databases adheres to. I later read a ...
10
votes
3answers
6k views

Database suggestion for a social network/ knowledge base community?

I am looking into various database types and DBMS's for a new project I am wanting to start in the summer. I have built systems in MySQL and postgreSQL , now I am wanting to expand my knowledge and ...
10
votes
2answers
665 views

What are some good resources for learning about document oriented databases?

I'm interested in learning about NoSQL databases and I decided to start with document oriented databases. What are some good resources to learn the concepts and good design of this type of database?
8
votes
3answers
2k views

Can NoSQL databases cause occasional data loss?

I am currently evaluating databases to use for a new project, which will require insertion and querying of large amounts of trading data. Our team is leaning towards Cassandra, but then I read this ...
8
votes
2answers
1k views

What fillfactor for caching table?

I have heavily updated / accessed table where I store serialized java objects. They are in the table for 2-3 hours (also are being updated during that period) and then removed. Size of table is around ...
8
votes
2answers
480 views

Is there any way to efficiently perform the equivalent of DENSE_RANK in MongoDB?

SQL Server and Oracle both have DENSE_RANK functions. Is there a way to do something similar in MongoDB without having to resort to MapReduce? In other words, suppose you have a T-SQL select clause ...
8
votes
2answers
535 views

NoSQL : What is unstructured data?

we are currently running at the edge of resources with our mssql server based solution. We have now many traditional options regarding the next move to tackle the load: buy faster CPUs and IO ...
8
votes
2answers
2k views

Is NoSQL a replacement for traditional SQL, or an addition? [closed]

I've been reading up on NoSQL, but I can't figure out one thing. Is it meant to be a replacement for traditional SQL, or is it meant to be used in conjunction with it? Basically, what I'm asking (I ...
7
votes
1answer
939 views

Why can't we perform joins in a distributed database like Bigtable?

From this answer to What database does Google use?, BigTable is not a relational database. It does not support joins nor does it support rich SQL-like queries. Is this obvious? I do not ...
7
votes
2answers
10k views

What is a good way to copy data from one Cassandra ColumnFamily to another on the same Keyspace (like SQL's INSERT INTO)?

Trying to find a way to easily transfer all the rows from a Cassandra ColumnFamily/Table to another. The COPY command, as I understand, is a good option. However, as it dumps all the data to .csv on ...
7
votes
1answer
2k views

Full text search through many tables in MySQL

We have high traffic NEWS websites, I want to add a feature that every user can search through over all content of site, such as news, polls, comments, galleries,etc . Each of contents type has its ...
6
votes
2answers
176 views

MongoDB vs RDBMS DBA duties

What are the differences between the daily tasks/duties of a Mongo DBA compared to a RDBMS DBA? For example, some sites claim that a MongoDB DBA would not require to do data modelling or designing ...
6
votes
2answers
10k views

Redis takes up all the Memory and Crashes

A redis server v2.8.4 is running on a Ubuntu 14.04 VPS with 8 GB RAM and 16 GB swap space (on SSDs). However htop shows that redis alone is taking up 22.4 G of memory! redis-server eventually crashed ...
5
votes
2answers
909 views

noSQL ACID and consistency for banking

We are building a real time banking platform and app. Our prime concern is safety and consistency of our data across multiple db servers. We need transactions and we can't afford to risk power ...
5
votes
2answers
3k views

“phpMyAdmin” for Cassandra

Is there a tool like phpMyAdmin for RDBMS-MySQL for a Cassandra DB? I know that there is less "runtime" config possible (column families can not be edited at runtime etc.). Nevertheless, it would be ...
5
votes
3answers
941 views

Replace relational database with “poor” design in software product with non-relational DB? [closed]

Edit: This question is about how to deal with many issues that arose from a overall system design, which made parts of the system deviate from common standards. For example, managing everything in the ...
5
votes
1answer
928 views

What are your use-cases for HandlerSocket?

There's a bit of hype around: HandlerSocket It seems like faster, nosql access to MySQL data is becoming more desirable. Percona Server is now shipping with HandlerSocket built in. My question is, ...
5
votes
1answer
1k views

How to handle “reference tables” in CouchDB?

What's the best way to handle "reference tables", tables that contain static data, for example a list with various kinds of ingredients for food? Multiple documents, one for each ingredient One ...
4
votes
4answers
1k views

In Memory Database for high transaction and volume spikes on a website [closed]

I am looking at the IA for a hypothetical application scenario, for example: A high demand application such as an online ticketing website where there can be demand for 100,000 tickets to be ...
4
votes
2answers
2k views

Sharded key-value store using MongoDB

Would like to set up a key-value store that is sharded across multiple machines. We are currently using MongoDB, is there a reason why we shouldn't use MongoDB for this purpose? We also use Redis, ...
4
votes
2answers
2k views

DynamoDB: searching with primary key or range key, which way is faster?

To those familiar with DynamoDB, I'm trying to make a table where items only have 2 entries. For example, . Most of the time I'll be searching the user_id with a facebook_id on hand. Amazon's ...
4
votes
2answers
263 views

Which database system can break me free?

I am currently running a MySQL Database for logging and analyzing those logs. My current table schema looks like this: CREATE TABLE `mylogs` ( `transfer_id` BIGINT UNSIGNED NOT NULL AUTO_INCREMENT ...
4
votes
3answers
610 views

Should I use MongoDB or a NoSQL solution at all for this?

I apologize if this belongs in web applications or something. I'm creating a web application that is sort of a similar concept to github. Basically I plan to allow someone to create a design of ...
4
votes
1answer
84 views

What exactly are secondary members acknowledging in replicasets with MongoDB?

I try to understand the mechanics and behavior of MongoDB's replica-features better. I hope to get some insightful information from someone who is familiar with mongo's internals and behaviour. My aim ...
4
votes
3answers
1k views

Are there any in-memory NoSQL databases?

Given that NoSQL databases are designed to support horizontal scalability by throwing in more servers, are there any that are designed to do entirely without persistent disk storage? I'm looking at ...
4
votes
1answer
66 views

Dynamic form builder database optimization Postgresql

Hi I have a project that create forms dynamically I use a model like the following: forms ----- id (PK) name (other fields) form_fields ------------- id (PK) form_id (FK to forms.id) ...
4
votes
0answers
128 views

Schema-less/flexible + ACID database? [duplicate]

Possible Duplicate: Schema-less/flexible + ACID Database? I am looking at rewriting a VB based on-premise (locally installed) application (invoicing+inventory) as a web based Clojure ...
3
votes
4answers
1k views

Advice on choosing a really fast DBMS

I am working on a project that does real-time monitoring of data being transmitted, and logs if there are any of the various type of errors, etc. The CRUD operations are real-time. We initially ...
3
votes
2answers
6k views

NoSQL, CouchDB vs. CouchBase, What should i do?

I started to encounter some issues on my production site, when having a web page that needs to load a very big ResultSet (currently coming from relational database, MySQL) it takes forever, and ...
3
votes
1answer
4k views

If foreign keys/cascade deletes are bad, why use a database-server with that feature?

I noticed wordpress/rails etc do not use foreign keys constraint or cascade deletes features from database. Instead they handle this in PHP/Ruby/scripting level! I have read this and this. Most ...
3
votes
1answer
300 views

to what “scale” of applications does nosql support?

Recently i came across the Nosql database concept, though i learnt how to and why of it, i did not get a proper answer to the question , to what scale of project does it support? Will it support ...
3
votes
2answers
853 views

Scalable DBaaS that can scale to hundreds of terabytes with easy backup and restore

I've gone over many DBaaS solutions, including Xeround (limited to 50G, in memory), NuoDB (currently in beta 7), DrawnToScale (not out yet), MongoDB (in memory), RavenDB (for ASP.NET, but NoSQL) and ...
3
votes
2answers
333 views

Database choices for big data

I have many text files, their total size is about 300GB ~ 400GB. They are all in this format key1 value_a key1 value_b key1 value_c key2 value_d key3 value_e .... each line is composed by a key and ...
3
votes
2answers
8k views

Is there any open source GUI tool to monitor cassandra? [closed]

I would like to monitor cassandra database as well as need to check the values in the database. Could any one suggest me best open source GUI tool ? Regards, Arun Raj.
3
votes
2answers
272 views

Scalability: Desiging a message table

This question might be deadly simple but I wanted to make sure I am going through the correct path and not making any simple and irrevertible mistakes. My project will be based on messaging and it ...
3
votes
3answers
2k views

Relational vs Non-Relational Database for Events Database

I'm trying to find out whether an SQL or no-SQL solution would be better for creating an events database. I'm creating a ticketing system, similar to ticket master. I know that for either database-...