A catch-all term describing database systems using various non-relational models. Such systems are usually engineered to be high-performance.

learn more… | top users | synonyms

2
votes
1answer
224 views

Google Datastore (NoSQL) backend for PHP CMS

I am working on a personal project where I am creating a small CMS using PHP as the developing language, but I want to be able to deploy it to the Google App Engine and I want to use its Google ...
1
vote
0answers
38 views

Dealing with joins in persistent key-value stores

One promising emerging category of NoSQL databases is key-value stores. These include Redis (disk-backed), Riak, Aerospike and others. The problem I struggle with the most is the lack of joins. ...
1
vote
1answer
81 views

cassandra in memory tables

I am planning to use Cassandra in memory tables for my particular work load. THe problem is I am worried if the node fails then what will happen to the data in memory that was not flushed to disk ? ...
1
vote
0answers
39 views

mongoDB - how to link one embedded object to another embedded object

Background Information I'm trying my hand at my first mongoDB database. So far, I've decided that I will need to use both references and embedded data models. One of the features of this application ...
1
vote
3answers
329 views

Sparse matrix - key-value db?

I have a huge sparse matrix ( 10^9 rows, 10^6 cols, density < 0.03% ), where each row has at least one nonzero column, but some column may contain only zeros. The cells are decimal numbers > 0. I ...
0
votes
1answer
183 views

A good dataset to experiment NoSQL databases [closed]

I need to do some experiments in HBase and Cassandra and to do that I need an adequate dataset. The dataset I'm looking for has to be large enough (i.e. more than 2GB) and the data in it has to be ...
1
vote
1answer
139 views

how to make secondary slave as readable in MongoDB?

How do I make a secondary slave as readable in MongoDB? We can do this via shell command rs.slaveOk() But how we can do it permanently for all session via config file?
1
vote
0answers
113 views

What kind of database is Cassandra DB?

I was taking some courses to understand better the way Cassandra works (at academy.datastax.com) and by what I gathered it came to me that it is a Key Value Database because of the way it stores data ...
0
votes
0answers
45 views

AWS DynamoDB structure and operations for product filtering

I'm having trouble with finding the right pattern to use in a "product" table. The site should be able to sort the products on date and price (asc and desc order). Besides that a user can apply a ...
0
votes
1answer
69 views

updating single row in MYSQL

We have a situation where we need to update on a single row several thousands time a second and this requirement lasts continuously for 5 hours every day due to the nature of the business. Design ...
1
vote
1answer
85 views

MongoLab: Does hardware effect performance of a find() query [closed]

I asked a pervious question on StackOverflow about if document size affected the performance of fetching that document (the document is 3MB in size) ...
0
votes
0answers
39 views

Challenged with modeling a big DB

I'm tasked to develop a gaming web application system with relatively large database - it should hold the data about 300 million players, the orders/payment of each player - ~3B records - , and other ...
1
vote
0answers
68 views

Couchbase data modeling

I come from the Relational DB world (SQL), and I'm getting started with NoSQL. So please consider that when answering. I have two Buckets: Apps and Users. A user may be subscribed to N ...
2
votes
1answer
103 views

Is there any database with versioning (column based) built in?

I'm wondering if there is a database (SQL or NOSQL) which provides versioning for for the records ( if the column/field/property is enabled for versioning). I'm developing an authentication software ...
1
vote
0answers
546 views

Creating Pandas DataFrame on Python From a MongoDB Document containing Embedded documents

I am working on a machine learning algorithm on python's scikit.learn, but this time the data are in Mongodb documents format. I would like to pull my data into a dataframe. Here is an exemple of the ...
1
vote
0answers
20 views

Does the consistency part of the CAP theorem apply to updates and not first-time writes?

Using this definition of the CAP theorem: Consistency All database clients see the same data, even with concurrent updates. Availability All database clients are able to access some version ...
1
vote
1answer
664 views

How do relations work in NOSQL? [closed]

I was using SQL in all my previous application and to understand the Parse.com db storage, I wanted to know NOSQL. I tried searching the differences between SQL and NOSQL for past 2 days & I ...
2
votes
1answer
165 views

PostgreSQL JSON data type used as NOSQL, But VIEW as Relational Data Structure

Could I create a VIEW from the JSON data type but have it as a relational structure? Example: SELECT * FROM json_test; Results [ { "name": "Roy", "Country": "USA", ...
1
vote
0answers
165 views

Can we query Accumulo data from Apache Drill

Accumulo uses HDFS where as HBase also works on top of HDFS. We can query HBase data through Drill. So can we query Accumulo data also from Apache Drill ?
3
votes
0answers
357 views

Are there any known benchmarks/statistics on UnQLite?

I came across UnQLite the other day in Stack Overflow and it has me intrigued for some software I'm working on. However, very few tests have been published on how well it performs. There are plenty of ...
0
votes
2answers
164 views

Strategies to import big data into Oracle

What strategies are available to import about 500 million small transactions every day from an external system? Oracle becomes very slow with very frequent commits. The transfer process which is ...
0
votes
1answer
55 views

Expand a date range in mongodb

I have a document structure like { "startDate": ISODate("2015-01-01T00:00:00Z"), "endDate" : ISODate("2015-01-10T00:00:00Z"), "foo" : "bar" } Is it possible to expand the date range like ...
0
votes
1answer
75 views

How Wide-columns databases achieve dynamic columns on the storage layout? [closed]

As known, in relational databases, when adding a new column, data must be reallocated (http://stackoverflow.com/questions/463677/alter-table-without-locking-the-table) to maintain a single row ...
0
votes
2answers
285 views

SQL Server vs SOLR (Or any document db)

I have my "customer" data in a normalized sql server database. Getting out the customer data in my app is taking too long. This is because I have to go to 10+ tables to get all the data I need. My ...
1
vote
1answer
428 views

Query MongoDB collection and find rows from 7 days ago

I have a MongoDB collection called messages and this is an example document for that collection: { "_id": { "$oid": "551943eee4c6acf40fe5a0f2" }, "sender_id": { "$oid": ...
1
vote
1answer
563 views

redis newbie - how to create hash within a hash?

I want to create this type of a structure in redis: (its basically json data) { "id": "0001", "name":"widget ABC", "model": "model123", "service":"standard", "admin_password": ...
1
vote
2answers
99 views

ElasticSearch: is this problem suitable for ElasticSearch DB? [closed]

I have some hardware instruments each one recording a signal and generating sequences of timestamp/value pairs. Timestamp is a basic UTC posix time and value is a double. I'd like to record such ...
0
votes
1answer
400 views

NoSQL DBs and 2-way synchronization

I've been told that MongoDb does not, but do any NoSQL DBs support this functionality?
0
votes
0answers
57 views

Metadata database on top of flat files

I have a bunch (millions) of flat files. I do sort them into subdirectories, but that doesn't really help searches. Is there some database software that could be fed metadata information and would ...
1
vote
0answers
55 views

Mongodb schema design validation

I am building an app which allows users to do some "tasks" to earn points. The "tasks" are part of a "campaign" which themselves are a part of "brands". I am confused about the schema for storing the ...
0
votes
1answer
237 views

Uber-wide tables: Time to switch to Mongo?

As a web developer, I've typically only worked with nice, normalized tables in SQL-based RDBMS, but I'm doing some data consolidation for a researcher who will be analyzing correlations between all ...
0
votes
0answers
31 views

Is there a Document based nosql with deep json update?

I'm currently looking in a Document based nosql (possibly with sharding/replication/NSPOF) database that allow (is specialized in) deep json document update. By that I mean that I would like a nosql ...
1
vote
0answers
101 views

Good way to store daily train data in MongoDB

I am preparing to collect large amounts of information about trains in my country. Each train in my country has a number. I've already collected all of these numbers. There are about 4000 of them. ...
0
votes
1answer
115 views

About schema design of NoSQL DB.(How to query multiple data?)

I just got a requirement, to build a web only with Redis. Data of the web is something like this(I write as RDBMS): User Info: user_id,first_name,last_name,age,..... Address: ...
0
votes
1answer
86 views

Alternative to RDBMS: Modeling Exam/Testing data

I'm a born and bred relational database guy and C# programmer dude. IBM DB2 & VB.Net in school. TSQL & C# at work. I'm planning a project for fun: Designing a Testing platform that goes from ...
-1
votes
1answer
162 views

Database migration for Large Data Set from MySQL to NoSQL

I have an existing APP that has N types of products that is normalized with MySQL. Each types of products have over 500K skus, and one of them are in the in 2M currently. We are currently tracking on ...
0
votes
1answer
72 views

What's the best database if i want save data temporally? [closed]

I want to create a datalog system so I need to store some int data temporally. What would be the best database (Relational, NO-SQL or some specific) for that purpose? And what would be the best way to ...
1
vote
0answers
81 views

Nosql multiple database design to handle sharing scenarios

This question is regarding design of a database in mongodb. The scenario: A user has a drive which he can share with others. Drive has two categories: docs and others. The user has three choices in ...
1
vote
0answers
307 views

How Do I Get DB2 NoSQL User-Defined Functions to Work

I am using NoSQL in DB2 10.5 FP4. I am creating and connecting to the database with the 'db2admin' administrator user ID on my Windows machine. I also used the 'db2 attach to DB2_01 as db2admin' ...
0
votes
2answers
273 views

Loading XML data from SQL Server directly into MarkLogic?

Has anyone loaded XML data from SQL Server to a MarkLogic document store? This would be preferable to dumping XML to file system and then using mlcp. Maybe with SSIS?
1
vote
1answer
575 views

Improve the insertion rate of mongo sharded cluster

I can't disable the write concern while i mongorestore with .bson file. It totally damages the insertion rate (insert/sec). This is my sharding status. mongos> sh.status() --- Sharding Status --- ...
0
votes
1answer
66 views

Design: Fitting variable hierarchy of text files into a relational db

I have a large data corpus (several TB) made up of data gathered through customer support queries. I've been asked to set up a database to make this data more accessible, but as I'm kind of new to ...
1
vote
1answer
195 views

Date model for commenting system stored in a key-value NoSQL DB?

I'm trying to leverage Cassandra's strong support for time series data to build a commenting system. So far I'm thinking that each row would be a particular topic, and each comment would be a new ...
2
votes
1answer
2k views

Can I copy a collection in mongoDB from one database to another by copying the db files directly?

I tried using cloneCollection http://docs.mongodb.org/manual/reference/command/cloneCollection/ , but clonecollection takes a lot of time in case of big collection because it starts indexing the data. ...
0
votes
1answer
61 views

Time Series data for controllers connected to other devices [closed]

We have a relatively large number of controllers deployed to the field (4500). Each of these controllers have multiple other devices connected to them. These controllers are now going to be able to ...
1
vote
1answer
342 views

No-SQL Database Design for restaurant app

I've been working with SQL databases all my life and I am now trying to get into the NoSQL world. I am a looking for a piece of advice on whats the best practice in order to achieve this. Suppose I ...
1
vote
3answers
272 views

Working NoSQL scheme for a betting app

I'm building an app where a user can bet on the result of a sports game. Basically, we feed the database with competitions and games, and the users can place their bet in the form of a score ...
1
vote
1answer
55 views

Database setup for datalogging

We're currently starting to build a version 2 of our system and one of the things we've noticed with version 1 is that we'll have quite a bit of data so we started to rethink our approach to how to ...
3
votes
1answer
61 views

What are some databases that are schema-full but not relational

What are some databases/datastores that are schema-full, but not relational? In other word I'm after some NoSql databases that are not schema-less. By schema-full I mean that, like in a traditional ...
5
votes
3answers
926 views

Replace relational database with “poor” design in software product with non-relational DB? [closed]

Edit: This question is about how to deal with many issues that arose from a overall system design, which made parts of the system deviate from common standards. For example, managing everything in the ...