1

I'm trying to figure out which database to use for storing and querying on ~1 billion JSON documents about the size of 2KB each. About 2 TB of data.

Nature of JSON documents:

  • 3 types of documents (structure is loosely defined)
  • Nested, multi level, sparse

Things that I'm looking for are:

  • High throughput
  • Secondary indexes support
  • Queries over JSON

Nice to haves:

  • SQL like query interface

Things I'm looking at:

  • Cassandra
  • Storing JSON in Postgres
  • Riak
  • HBase

If more details I missed regarding usage or the data I missed that would help make the decision, please let me know

Improve this question
5
  • What do your billion documents represent? – I Support The Boycott Jun 7 '17 at 0:46
  • 2
    The number of shopping list questions found on this site :| – Nick.McDermaid Jun 7 '17 at 0:47
  • I just always wonder if million+ is projected growth, or real. – I Support The Boycott Jun 7 '17 at 1:12
  • @EvanCarroll: Real estate data, it's real, currently stored in S3. – Akshit Khurana Jun 7 '17 at 17:40
  • 2
    @Nick.McDermaid Please let me know if there's a better place to ask these questions. Or how to put this in a better way for this to be useful. – Akshit Khurana Jun 7 '17 at 17:42

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Browse other questions tagged or ask your own question.