Several years ago, I've created search engine using PHP with MySQL (MyISAM)
The "Related search" pick 5 most similar search title.
The data has growing bigger in matter of days.
Each submission has category. When trying to get the "Related search" from the same category, it works fine (get from the same category is smaller scope, of course it works)
But when getting from every submission no matter of the category, the "Related search" sidebar section become blank.
(I don't count how many data in the database, but backup take so long)
Now, I'm going to create similar search engine, but using C++ with Hypertable.
I'm worried the "Related search" become blank again when getting from millions of submission.
Is there any trick to prevent that from happen (like sort the data or any other ways)?