A catch-all term describing database systems using various non-relational models. Such systems are usually engineered to be high-performance.

learn more… | top users | synonyms

0
votes
1answer
100 views

Optimizing an Informix query — Specify architectural solutions if possible too (like caching service)

We have a huge query on an Informix database that is not performing well. The query is doing a join of 9 different tables. Maximum row count is just 40,000 rows. The query also has 9 sub-queries, and ...
1
vote
1answer
32 views

What kind of database should I use?

I'm designing a new system and I'm wondering what kind of DB should I use for my needs. I have a tree structure of nodes, where each node has historic values. For each historic value it should hold 2 ...
7
votes
2answers
66 views

NoSQL : What is unstructured data?

we are currently running at the edge of resources with our mssql server based solution. We have now many traditional options regarding the next move to tackle the load: buy faster CPUs and IO ...
1
vote
1answer
277 views

Elasticsearch: Versioning a document on revisions

I currently have a document which gets revised regularly, I want to keep track of the document by keeping each old version of the document. So if document A has a summary and update date I want to, ...
0
votes
0answers
11 views

How to merge numerous collections within one colection in MongoDB?

Here is the scenario: In one collection name is "Parent" I have the following document {"_id" : ObjectId("4f7ee46e08403d063ab0b4f9"), "name" : "MongoDB", "range" : "spec", "notes" : { { ...
0
votes
1answer
24 views

Based from experience, is dreamfactory better paired with a RDBMS like MySQL or NoSQL like MongoDB

This is our first time to create a data logging web application and we have chosen to use Dreamfactory as the backend framework. We have been used to with MySQL from the past with small amount of data ...
0
votes
0answers
40 views

mysql - suggestions for table design with huge number of columns

We have a table that consists of a huge number of columns (usually between 500 to 1000, depends on our clients websites). We are suffering from speed issues due to this, and we're looking for the best ...
1
vote
1answer
347 views

Use cases for NoSQL databases: Time series

I need to set up a database that will record temporal series data (sensors). A friend of mine has recommended me to use a NoSQL database instead of using Oracle (for instance). There're also some ...
21
votes
2answers
13k views

Timeseries: SQL or NoSQL?

I don't care about the general differences between SQL and NoSQL (or their traditional differences). I am currently looking at altering the storage of our internal time series. They all contain ...
0
votes
1answer
2k views

Storing multidimensional array in MongoDB

I am attempting to convert a large MySQL database of product information (dimensions, specifications, etc) to MongoDB for flexibility and to move away from the restriction of a column based table. I ...
1
vote
1answer
1k views

Can I copy a collection in mongoDB from one database to another by copying the db files directly?

I tried using cloneCollection http://docs.mongodb.org/manual/reference/command/cloneCollection/ , but clonecollection takes a lot of time in case of big collection because it starts indexing the data. ...
0
votes
0answers
21 views

MongoDB: Multiple timezone support

In Mongodb how to support multiple timezones? Say every client has his own timezone. I want to group by dates. Records are in different timezones before aggregation. The report should be aggregated ...
0
votes
2answers
54 views

MongoDB document delete and fragmentation

I've a MongoDB collection that works like a queue: new documents are insert and old documents (after 60days) are removed. I can see a rapid grown of the datafile size, too rapid. I can be reasonable ...
0
votes
1answer
63 views

A good dataset to experiment NoSQL databases [closed]

I need to do some experiments in HBase and Cassandra and to do that I need an adequate dataset. The dataset I'm looking for has to be large enough (i.e. more than 2GB) and the data in it has to be ...
1
vote
1answer
18 views

cassandra in memory tables

I am planning to use Cassandra in memory tables for my particular work load. THe problem is I am worried if the node fails then what will happen to the data in memory that was not flushed to disk ? ...
1
vote
3answers
200 views

Working NoSQL scheme for a betting app

I'm building an app where a user can bet on the result of a sports game. Basically, we feed the database with competitions and games, and the users can place their bet in the form of a score ...
11
votes
3answers
4k views

Choosing a database for storing large amount of data and allowing for thousands of writes [closed]

I am working on a project that has some serious requirements regarding its database and having hard time choosing the best solution. The details are: Database will easily reach tens of terabytes of ...
0
votes
0answers
25 views

Can we swap out SQL Server with HBase on our .Net application?

In a current application we use SQL Server. The data flow consists of using TVPs for better-than-bulk-insert performance by passing in DataTables. As part of the data addition process, old records ...
0
votes
0answers
12 views

Would a nosql db handle sorting by latitude and longitude queries as well as a mysql db?

I have a table with a couple hundred advertisers including the latitude and longitude of the centroid of their zip code. I will also know the centroid of the zip code of website visitors. What I want ...
0
votes
0answers
27 views

Running out of disk space when removing documents error

I'm trying to remove unused document from a production instance of MongoDB but, when I try to execute this query: db.collection.remove( { date: {$lt: new Date((new Date())-1000*60*60*24*90)} } ) ...
1
vote
1answer
52 views

How to Query Properties of an Entity in Apache Cassandra

I am new to Apache Cassandra, and I would like to know how to create a table in which I can filter rows by non-key columns. In relational databases, I would simply create a table with an ID as a ...
2
votes
1answer
49 views

Google Datastore (NoSQL) backend for PHP CMS

I am working on a personal project where I am creating a small CMS using PHP as the developing language, but I want to be able to deploy it to the Google App Engine and I want to use its Google ...
1
vote
0answers
22 views

Dealing with joins in persistent key-value stores

One promising emerging category of NoSQL databases is key-value stores. These include Redis (disk-backed), Riak, Aerospike and others. The problem I struggle with the most is the lack of joins. ...
0
votes
2answers
55 views

Sparse matrix - key-value db?

I have a huge sparse matrix ( 10^9 rows, 10^6 cols, density < 0.03% ), where each row has at least one nonzero column, but some column may contain only zeros. The cells are decimal numbers > 0. I ...
1
vote
0answers
30 views

mongoDB - how to link one embedded object to another embedded object

Background Information I'm trying my hand at my first mongoDB database. So far, I've decided that I will need to use both references and embedded data models. One of the features of this application ...
0
votes
1answer
46 views

how to make secondary slave as readable in MongoDB?

How do I make a secondary slave as readable in MongoDB? We can do this via shell command rs.slaveOk() But how we can do it permanently for all session via config file?
1
vote
0answers
38 views

What kind of database is Cassandra DB?

I was taking some courses to understand better the way Cassandra works (at academy.datastax.com) and by what I gathered it came to me that it is a Key Value Database because of the way it stores data ...
0
votes
0answers
21 views

AWS DynamoDB structure and operations for product filtering

I'm having trouble with finding the right pattern to use in a "product" table. The site should be able to sort the products on date and price (asc and desc order). Besides that a user can apply a ...
0
votes
1answer
111 views

Two types of data, so two type of databases?

For a social network site, I need to propose a DB. The application is written in Java & will be hosted on VPS(s) initially. Broadly classified there is two type of data to be stored at backend: ...
0
votes
1answer
56 views

updating single row in MYSQL

We have a situation where we need to update on a single row several thousands time a second and this requirement lasts continuously for 5 hours every day due to the nature of the business. Design ...
0
votes
2answers
168 views

Loading XML data from SQL Server directly into MarkLogic?

Has anyone loaded XML data from SQL Server to a MarkLogic document store? This would be preferable to dumping XML to file system and then using mlcp. Maybe with SSIS?
8
votes
2answers
2k views

Is NoSQL a replacement for traditional SQL, or an addition? [closed]

I've been reading up on NoSQL, but I can't figure out one thing. Is it meant to be a replacement for traditional SQL, or is it meant to be used in conjunction with it? Basically, what I'm asking (I ...
1
vote
1answer
45 views

MongoLab: Does hardware effect performance of a find() query [closed]

I asked a pervious question on StackOverflow about if document size affected the performance of fetching that document (the document is 3MB in size) ...
1
vote
1answer
315 views

Improve the insertion rate of mongo sharded cluster

I can't disable the write concern while i mongorestore with .bson file. It totally damages the insertion rate (insert/sec). This is my sharding status. mongos> sh.status() --- Sharding Status --- ...
0
votes
0answers
33 views

In face of a network partition (P), does Neo4J HA allow read stale data?

In Neo4j docs it says that it is partition tolerant, but in further descriptions their docs does not make clear what happens if a network partition occurs. It enables a fault-tolerant database ...
0
votes
0answers
37 views

Challenged with modeling a big DB

I'm tasked to develop a gaming web application system with relatively large database - it should hold the data about 300 million players, the orders/payment of each player - ~3B records - , and other ...
0
votes
0answers
41 views

Couchbase data modeling

I come from the Relational DB world (SQL), and I'm getting started with NoSQL. So please consider that when answering. I have two Buckets: Apps and Users. A user may be subscribed to N ...
0
votes
1answer
36 views

Expand a date range in mongodb

I have a document structure like { "startDate": ISODate("2015-01-01T00:00:00Z"), "endDate" : ISODate("2015-01-10T00:00:00Z"), "foo" : "bar" } Is it possible to expand the date range like ...
2
votes
1answer
51 views

Is there any database with versioning (column based) built in?

I'm wondering if there is a database (SQL or NOSQL) which provides versioning for for the records ( if the column/field/property is enabled for versioning). I'm developing an authentication software ...
1
vote
0answers
173 views

Best database for fast read all in one table [closed]

I currently have a large database in SQLite that I was using for rapid-prototyping for a software I am working on. Now that I am planning to move it to another database that should give better ...
1
vote
0answers
151 views

Creating Pandas DataFrame on Python From a MongoDB Document containing Embedded documents

I am working on a machine learning algorithm on python's scikit.learn, but this time the data are in Mongodb documents format. I would like to pull my data into a dataframe. Here is an exemple of the ...
1
vote
0answers
13 views

Does the consistency part of the CAP theorem apply to updates and not first-time writes?

Using this definition of the CAP theorem: Consistency All database clients see the same data, even with concurrent updates. Availability All database clients are able to access some version ...
0
votes
0answers
32 views

What is the graveyard compaction in cassandra?

Cassandra noob here. While going through the documentation etc, I'm repetitevely finding references to graveyard compaction (and occasionally tombstones), example: $ cassandra-cli [default@unknown] ...
6
votes
2answers
849 views

What fillfactor for caching table?

I have heavily updated / accessed table where I store serialized java objects. They are in the table for 2-3 hours (also are being updated during that period) and then removed. Size of table is around ...
1
vote
1answer
87 views

redis newbie - how to create hash within a hash?

I want to create this type of a structure in redis: (its basically json data) { "id": "0001", "name":"widget ABC", "model": "model123", "service":"standard", "admin_password": ...
0
votes
0answers
20 views

write data on multiple storageNodes in oracle NoSQL

I'm using oracle NoSQL on ubuntu (newbie to both) and created 3 storageNodes (with 3 RN on each) in one computer on different ports (5000,6000 and 7000) in a store named mystore. Now I need to write 1 ...
1
vote
1answer
82 views

How do relations work in NOSQL? [closed]

I was using SQL in all my previous application and to understand the Parse.com db storage, I wanted to know NOSQL. I tried searching the differences between SQL and NOSQL for past 2 days & I ...
0
votes
1answer
61 views

Strategies to import big data into oracle

Which strategies are available to import very larg amount of data from an external system which is delivering about 500 million small transactions every day? Oracle becomes very slow with high ...
2
votes
1answer
82 views

PostgreSQL JSON data type used as NOSQL, But VIEW as Relational Data Structure

Could I create a VIEW from the JSON data type but have it as a relational structure? Example: SELECT * FROM json_test; Results [ { "name": "Roy", "Country": "USA", ...
1
vote
0answers
73 views

Can we query Accumulo data from Apache Drill

Accumulo uses HDFS where as HBase also works on top of HDFS. We can query HBase data through Drill. So can we query Accumulo data also from Apache Drill ?