Apache Hadoop is a framework that allows for the distributed processing of large data sets across clusters of computers. It is designed to scale up from single servers to thousands of machines. The library itself is designed to detect and handle failures at the application layer, so delivering a ...

learn more… | top users | synonyms

1
vote
1answer
137 views

MapReduce performance on a single PC [closed]

I have heard that Hadoop has better performance than MySQL. Until now, I have used relational databases so this is really new technology for me. I have a 6 core PC. Suppose I have a table with 20 ...
1
vote
0answers
110 views

Enabling JMX For Hadoop HDFS & Also MapReduce

I'm having a hard time figuring out how to enable JMX to submit metrics for HDFS and MapReduce jobs in Hadoop (CDH4). I've seen several links and read through 'The Definitive Guide' and 'Hadoop ...
1
vote
0answers
101 views

Where Hadoop Stands at MongoDB Side [closed]

I am making a research about Machine Learning and planning to use NoSQL databases. I know that MongoDB is a powerful solution. However I want to learn that where Hadoop stands for MongoDB side. My ...
0
votes
1answer
37 views

MySQL Rows to Columns to HBase (using Sqoop)

I have a table that looks like this in MySQL: id | date | num | avg I have found that I can use this for rows to columns and it works so far: SELECT CONCAT(id, '-', date), MAX(IF(`num` = ...
0
votes
1answer
215 views

Storing 5TB web server access log vs OLAP DB

We have over 5TB compressed web server log in a HDFS and we often analyse using Hadoop. It is painful to run map reduce on 5TB of data and most importantly, not many developer are familiar with it. ...
0
votes
0answers
22 views

Cassandra with Hadoop

Cassandra uses Cassandra File System (CFS) and Hadoop uses Hadoop Distributed File System (HDFS) I'm already using Pig over HDFS and i would like to install Cassandra. Having additional servers for ...
0
votes
0answers
4 views

Are rfiles in Accumulo and hfiles in Hbase similar in structure and purpose?

I cannot seem to find much info on rfiles other than the Accumulo site and from what I can gather from the information I cannot deduce whether like hfiles they are based on Mapfiles and meant to store ...
0
votes
0answers
33 views

How often does the Impala StateStore refresh?

I am using Hive and Impala on the same cluster. I find that when I create new tables, the Impala StateStore does not refresh automatically even after a few hours. I know that I can accomplish this by ...
-1
votes
0answers
13 views

Best way to create a messaging system in terms of perfomance

I plan on creating a messaging system (1 user to 1 user) as an educational experience. I am in the design and research phase trying to find the right technologies. The database will have have about a ...