We have come to a point where for a few of our customers' systems, at peak times, events are generated at that crazy rate. That is, millions of new events per minute (between 1M and 2M).
The records/docs size are 1.5Kb on average.
Is there a database that can handle such radical write speed out there (16K - 32k inserts per second)?
There are several candidates out there, Cassandra, Hive, Hadoop, HBase, Riak and perhaps a few others, but I would like to know from someone else's experience and not just quoting from each database system's website self testimonials.
If you have handled such load at your work, your advice is highly appreciated.