Take the 2-minute tour ×
Database Administrators Stack Exchange is a question and answer site for database professionals who wish to improve their database skills and learn from others in the community. It's 100% free, no registration required.

I am in the process of evaluating the best design for our Cassandra installation.

There is not so much information out there on the Internet about using the first two levels of access that Cassandra provides—keyspaces and column families.

I am wondering if and what the penalties will be if you choose to create an extensive amount of keyspaces or column families (>10.000).

An old blog post somewhere suggested that Cassandra reserves memory for each column family. The article was about the 0.6 version and the current version is 1.0. Is this still the case and a real problem?

What are the penalties of using many thousands of column families or keyspaces in Cassandra?

share|improve this question

migrated from stackoverflow.com Feb 6 '12 at 15:40

This question came from our site for professional and enthusiast programmers.

    
stackoverflow.com/questions/8937515/… Check the link. This might help –  Tamil Feb 6 '12 at 5:04
    
Thank you Tamil, this is also very interesting :) –  favo Feb 6 '12 at 7:29
add comment

2 Answers

up vote 5 down vote accepted

Cassandra 1.0 uses a minimum of 1MB of heap per CF. So, 1000 or 2000 CFs will be okay for typical heap sizes, but 10000 will probably not be. JVM GC does poorly with very large heaps; I recommend staying under 8GB.

share|improve this answer
add comment

Starting up a Cassandra node will start taking a lot longer if you have lots of column families. It will also affect the amount of memory is being used.

Thus that amount of memory will not be used for row/key-caches and indexing. Performance might degrade further as you keep adding column families, depending on the specific hardware of your nodes.

share|improve this answer
add comment

Your Answer

 
discard

By posting your answer, you agree to the privacy policy and terms of service.

Not the answer you're looking for? Browse other questions tagged or ask your own question.