I'm trying to figure out which database to use for storing and querying on ~1 billion JSON documents about the size of 2KB each. About 2 TB of data.

Nature of JSON documents:

  • 3 types of documents (structure is loosely defined)
  • Nested, multi level, sparse

Things that I'm looking for are:

  • High throughput
  • Secondary indexes support
  • Queries over JSON

Nice to haves:

  • SQL like query interface

Things I'm looking at:

  • Cassandra
  • Storing JSON in Postgres
  • Riak
  • HBase

If more details I missed regarding usage or the data I missed that would help make the decision, please let me know

  • What do your billion documents represent? Commented Jun 7, 2017 at 0:46
  • 2
    The number of shopping list questions found on this site :|
    – Nick.Mc
    Commented Jun 7, 2017 at 0:47
  • I just always wonder if million+ is projected growth, or real. Commented Jun 7, 2017 at 1:12
  • @EvanCarroll: Real estate data, it's real, currently stored in S3. Commented Jun 7, 2017 at 17:40
  • 2
    @Nick.McDermaid Please let me know if there's a better place to ask these questions. Or how to put this in a better way for this to be useful. Commented Jun 7, 2017 at 17:42


Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.