We have over 5TB compressed web server log in a HDFS and we often analyse using Hadoop.
It is painful to run map reduce on 5TB of data and most importantly, not many developer are familiar with it.
I am thinking if we should store the data in columnar database such as Greenplum or other MySQL column store which are aimed to store the analytical data in a efficient manner but able to support raipid query, which is quite important lately.
What are base you would recommend? Anything I should consider before the move? (I will do my own test anyway)