Take the 2-minute tour ×
Database Administrators Stack Exchange is a question and answer site for database professionals who wish to improve their database skills and learn from others in the community. It's 100% free, no registration required.

I have heard that Hadoop has better performance than MySQL. Until now, I have used relational databases so this is really new technology for me. I have a 6 core PC. Suppose I have a table with 20 columns and 5million rows. Does Hadoop give better performance for operations like Select, Insert, and Update?

What is the equivalent command of Create Table, Select, Update, Insert, etc. in Hadoop 1.1?

share|improve this question

closed as not constructive by Mark Storey-Smith, RolandoMySQLDBA, Paul White, Derek Downey, Mike Walsh Dec 19 '12 at 2:43

As it currently stands, this question is not a good fit for our Q&A format. We expect answers to be supported by facts, references, or expertise, but this question will likely solicit debate, arguments, polling, or extended discussion. If you feel that this question can be improved and possibly reopened, visit the help center for guidance.If this question can be reworded to fit the rules in the help center, please edit the question.

1  
No. Hadoop is a framework intended to support distributed computation. –  Mark Storey-Smith Dec 18 '12 at 0:22

1 Answer 1

up vote 5 down vote accepted

Traditionally the use-case for Hadoop is when you need to split your data storage over dozens or more of machines, and you're not using a traditional RDBMS solution. When you only have one machine, you're likely to negate any potential gains the use of Hadoop would have provided.

Additionally, 20 columns * 5 million rows is considered by most DBA to be a small database, and aside from index lookups is not worth much in the way of optimization because most DBMS would handle this amount of information quite quickly.

Back to the topic of Hadoop, however, is this: Hadoop is a distributed file system, not an outright database. A potential use (and one I know fairly well) of Hadoop is when you have large sets of binary files, which have a common data format, and you need to run the same operations on each binary file, or you need to find those binary files quickly. In this case, Hadoop is effectively a massive lookup engine for all the files on the DFS. This way you can quickly find the files that you need to work with to run the parallel data analysis. One such group using Hadoop for such a goal is CERN.

I would not encourage you to consider transitioning your data to Hadoop when a traditional RDBMS would work well for your needs.

share|improve this answer

Not the answer you're looking for? Browse other questions tagged or ask your own question.