Take the 2-minute tour ×
Database Administrators Stack Exchange is a question and answer site for database professionals who wish to improve their database skills and learn from others in the community. It's 100% free, no registration required.

I am using Hive and Impala on the same cluster. I find that when I create new tables, the Impala StateStore does not refresh automatically even after a few hours.

I know that I can accomplish this by running "refresh" in impala-shell (in a cron job if need be), but I would like to know: how often does impalad refresh metadata and can I set this interval to be shorter? If so, how?

share|improve this question

1 Answer 1

It is my understanding that impala does not automatically refresh the metadata. If you create new tables etc through impala (1.2 and higher) it will update the other impala nodes, however if you create new tables etc in hive you will have to manually refresh the impala metadata.

You can manually refresh the metadata on either a table basis with 'REFRESH table_name' or you can do this for all tables with 'INVALIDATE METADATA'. Also, note that if you update the files on HDFS you will have to refresh the table to pickup the new data as well.

share|improve this answer

Your Answer

 
discard

By posting your answer, you agree to the privacy policy and terms of service.

Not the answer you're looking for? Browse other questions tagged or ask your own question.