What would be an appropriate / suitable database sans Oracle that would be suitable for the following conditions?

  1. data mining includes but does not limit to the following: a. clicking on links b. capture geolocation data, platform details c. user behaviours

  2. there will be a foreseen exponential surge of data being captured as more apps / sites being deployed

  3. for now, there are on average 60,000 ~ 80,000 data being captured every 15 minutes for 2 main sites / apps

  4. In the near future, we are also planning to release all these data to the various parties involved where they can use it for their own apps / sites.

As of now, we are using mySQL but we found that it becomes very costly as we started to scale up. As such, any advice would be good as a starting point.

  • maybe you should start with what budget is available and what storage solution fits that.
    – ik_zelf
    Feb 5, 2013 at 17:39
  • I'm not sure about storage solution, hence I'm asking that question. As for budget, as low as possible if not 0. Mainly because we are investing most of our resources on bandwidth and we already have 2 racks of server space available for our own use
    – Gino
    Feb 6, 2013 at 6:57

1 Answer 1


Mahout with HBase is probably a good option for very large datasets.

It is designed to run on many cheap commodity servers.

Also, monetDB is an open-source column-wise database which is very fast for data warehouses.

  • Ok, I'll take a look at that. I have read up hadoop briefly. Will that also be appropriate in our requirements?
    – Gino
    Feb 6, 2013 at 6:59
  • Hadoop is a distributed file system and parallel processing framework. It could do what you want to do. HBase and Mahout build on top of Hadoop. HBase allows for random access reads (it's a database on top of Hadoop), and Mahout is a distributed data mining library that can use Hadoop or HBase. Feb 6, 2013 at 19:07

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.