Tell me more ×
Database Administrators Stack Exchange is a question and answer site for database professionals who wish to improve their database skills and learn from others in the community. It's 100% free, no registration required.
up vote 0 down vote favorite

I am tasked with developing a system that stores massive quantities of machine generated data (syslogs) from a number of server farms and I am wondering what tools you fine folks use such instances. Our project will need to keep up to 10 TB of data (maybe more in the future) and serve queries fairly quickly. I have been reading about columnular rdms' as well as nosql options, which all seem promising.

share|improve this question
Define 'fairly quickly',what kind of budget, and what kind of queries. – rfusca Nov 5 '12 at 20:05
Fairly quickly = a couple seconds or less, as inexpensive as possible (already have hardware), fairly simple joins on two tables (SQL right now) – somecallmemike Nov 5 '12 at 20:10
1  
What hardware do you have? Crunching 10TB requires non-trivial hardware and what you have will determine possible solutions if you don't intend to buy anything or buy extremely little. – rfusca Nov 6 '12 at 13:31

Know someone who can answer? Share a link to this question via email, Google+, Twitter, or Facebook.

Your Answer

 
discard

By posting your answer, you agree to the privacy policy and terms of service.

Browse other questions tagged or ask your own question.