For simple key/value storage, you might like to consider Berkeley DB, though I would not think Git would be the best for 'version control'. You can use Ruby bindingsRuby bindings with BDB.
Since your edit, I'm left wondering If you want an open-source implementation of something like Amazon S3